00000100:00100000:0.0:1746126986.630379:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c95fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126986.630569:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.630606:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.631569:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20154 00000100:00100000:0.0:1746126986.631577:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991056768:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126986.631584:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126986.631620:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6258 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e50eae expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126986.631632:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126986.631634:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126986.631643:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6258 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eae expref: 30 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126986.631657:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6258 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eae expref: 30 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126986.631666:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46600, rc 0) 00000100:00100000:0.0:1746126986.632331:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991056768:12345-192.168.203.42@tcp:101:cat.0 Request processed in 753us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126986.632337:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20154 00002000:00010000:0.0:1746126986.633908:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746126984 -> 1746126985 00002000:00010000:0.0:1746126986.633914:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746126984 -> 1746126985 00002000:00010000:0.0:1746126986.633915:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746126984 -> 1746126985 00000100:00100000:0.0:1746126986.633934:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994021248:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126986.633962:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef624a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ea0 expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126986.633980:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef624a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ea0 expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126986.633988:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47a00, rc 0) 00000100:00100000:0.0:1746126986.634035:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991056512:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3885us (3987us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126986.634042:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20152 00000100:00100000:0.0:1746126986.637820:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.637873:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.642239:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.642266:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991057280 00000100:00100000:0.0:1746126986.642271:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991057280 00002000:00100000:0.0:1746126986.642309:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (24576->98303) req@ffff88012d3ff480 x1830945991057280/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:747/0 lens 488/0 e 0 to 0 dl 1746126997 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126986.642317:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff480 with x1830945991057280 ext(24576->98303) 00010000:00010000:0.0:1746126986.642323:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef61fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->98303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e8b expref: 17 pid: 11152 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746126986.642339:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef61fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->98303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e8b expref: 17 pid: 11152 timeout: 981 lvb_type: 0 00002000:00010000:0.0:1746126986.642344:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d3ff480 00000100:00100000:0.0:1746126986.642453:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1698 00000100:00100000:0.0:1746126986.642460:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991057280:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126986.649743:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.649872:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.653072:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.656417:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.668393:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.676709:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.689430:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.691956:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.705587:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.738206:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.751474:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.755907:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.755964:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.779505:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.785852:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126986.787325:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6ef62b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787334:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6ef62b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:0.0:1746126986.787386:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126986.787389:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126986.787407:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6ef62b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787418:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6ef62b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787427:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e400/0x34dc807b6ef62a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787433:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e400/0x34dc807b6ef62a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787439:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e400/0x34dc807b6ef62a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787444:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213e400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126986.787448:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e400/0x34dc807b6ef62a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787454:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e400/0x34dc807b6ef62a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787464:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126986.787467:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126986.787471:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e400/0x34dc807b6ef62a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787475:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e400/0x34dc807b6ef62a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787503:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6ef62ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787508:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6ef62ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787513:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6ef62ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787516:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213f600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126986.787518:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6ef62ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787526:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6ef62ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787533:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4916e00) 00010000:00010000:0.0:1746126986.787535:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126986.787537:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6ef62ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787541:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6ef62ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126986.787578:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fa00/0x34dc807b6ef629e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ed8 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126986.787590:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6ef62b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ed8 expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126986.787596:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126986.787598:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126986.787600:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213ee00, rc 0) 00000100:00100000:0.0:1746126986.787636:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:3512:x1830945991060096:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 6451us (8140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126986.787642:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16953 00000100:00100000:0.0:1746126986.789308:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.797553:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20161 00000100:00100000:0.0:1746126986.797563:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991060608:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126986.797571:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126986.797581:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e50eed expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126986.797595:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126986.797596:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126986.797602:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126986.797613:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126986.797621:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918aa00, rc 0) 00000100:00100000:0.0:1746126986.797639:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991060608:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 79us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126986.797969:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20161 00000100:00100000:0.0:1746126986.798005:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.798046:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.798068:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991061248 00000100:00100000:0.0:1746126986.798072:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991061248 00010000:00010000:0.0:1746126986.798089:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1ae000/0x34dc807b6ef61a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e68 expref: 20 pid: 1964 timeout: 981 lvb_type: 1 00000100:00100000:0.0:1746126986.798108:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9269 00000100:00100000:0.0:1746126986.798114:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991061248:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126986.798123:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126986.798176:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d1ae000/0x34dc807b6ef61a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e68 expref: 20 pid: 1964 timeout: 981 lvb_type: 1 00010000:00010000:0.0:1746126986.798187:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d1ae000/0x34dc807b6ef61a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e68 expref: 20 pid: 1964 timeout: 981 lvb_type: 1 00010000:00010000:0.0:1746126986.798202:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d1ae000/0x34dc807b6ef61a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e68 expref: 20 pid: 1964 timeout: 981 lvb_type: 1 00010000:00010000:0.0:1746126986.798214:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126986.798229:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991061248:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 115us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126986.798235:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9269 00000100:00100000:0.0:1746126986.803806:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.810444:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.813712:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.814255:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.823791:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.829521:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991063168 00000100:00100000:0.0:1746126986.829530:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991063168 00000100:00100000:0.0:1746126986.829571:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6379 00000100:00100000:0.0:1746126986.829579:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:3517:x1830945991063168:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746126986.829790:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+21:3517:x1830945991063168:12345-192.168.203.42@tcp:35:cat.0 Request processed in 210us (595us total) trans 8589937819 rc 0/0 00000100:00100000:0.0:1746126986.829797:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6379 00000100:00100000:0.0:1746126986.832073:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.832916:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991063680 00000100:00100000:0.0:1746126986.832919:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991063680 00000100:00100000:0.0:1746126986.832944:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20166 00000100:00100000:0.0:1746126986.832949:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991063680:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126986.832957:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126986.832971:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918b000/0x34dc807b6ef6354 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e50f2c expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126986.833018:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994022656:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126986.833066:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c95ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126986.834330:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.835651:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.841330:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.850983:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.856809:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.859638:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.863503:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.865650:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.882223:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.884557:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.887359:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.888243:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.888299:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.897332:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.905118:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.911901:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.926310:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.929942:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.930901:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.931110:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1703 00000100:00100000:0.0:1746126986.932868:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991067648:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126986.965039:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.965112:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.966841:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.983373:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126986.983421:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.010105:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.015001:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126987.016480:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126987.016651:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994024192:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.016662:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994024320:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.016670:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994024448:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.016698:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [2019328->2080767] (req 2019328->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 43 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.016712:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb200, rc 0) 00000100:00100000:0.0:1746126987.016737:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:3525:x1830945991069952:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4475us (6642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.016743:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20173 00000100:00100000:0.0:1746126987.017193:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126987.018682:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126987.019031:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991070464 00000100:00100000:0.0:1746126987.019035:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991070464 00010000:00010000:0.0:1746126987.019309:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a46800/0x34dc807b6ef618d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e53 expref: 20 pid: 9612 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.019325:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9280 00000100:00100000:0.0:1746126987.019330:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991070464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.019340:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.019625:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a46800/0x34dc807b6ef618d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e53 expref: 20 pid: 9612 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.019634:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a46800/0x34dc807b6ef618d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e53 expref: 20 pid: 9612 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.019646:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a46800/0x34dc807b6ef618d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e53 expref: 20 pid: 9612 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.019669:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.019672:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.019679:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.019687:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.021250:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.021270:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994024576:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126987.021350:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c95fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.022993:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991070720 00000100:00100000:0.0:1746126987.022997:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991070720 00000100:00100000:0.0:1746126987.023025:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 982 00000100:00100000:0.0:1746126987.023030:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991070720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.023040:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.023063:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef63d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f72 expref: 23 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.023078:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126987.023082:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.023112:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991070720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 76us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.023119:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 982 00000100:00100000:0.0:1746126987.024971:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994024576:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126987.024982:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.025015:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991070464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5684us (6017us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.025023:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9280 00000100:00100000:0.0:1746126987.028815:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.030504:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.042988:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.058180:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.138386:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.169492:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.176024:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.176098:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.176116:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991072512 00000100:00100000:0.0:1746126987.176118:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991072512 00000100:00100000:0.0:1746126987.176179:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20178 00000100:00100000:0.0:1746126987.176186:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+19:3527:x1830945991072512:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126987.176201:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.176213:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e50f95 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.176231:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6ef614e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e30 expref: 41 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.176238:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.176244:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e96a00/0x34dc807b6ef6186 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e4c expref: 20 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.176248:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.176250:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.176253:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 20 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.176273:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e96a00/0x34dc807b6ef6186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e4c expref: 20 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.176281:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e96a00/0x34dc807b6ef6186 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e4c expref: 20 pid: 16295 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.176290:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994025472:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.176349:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.176445:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 11 pid: 11152 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.176454:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994025600:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.176478:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6ef614e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e30 expref: 41 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.176485:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6ef614e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e30 expref: 41 pid: 9612 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.176492:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994025728:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.176507:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c95fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.185470:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994025472:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.185498:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994025600:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.185517:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994025728:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.185538:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 20 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.185549:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47e00, rc 0) 00000100:00100000:0.0:1746126987.185580:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+20:3527:x1830945991072512:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 9394us (9481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.185586:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20178 00000100:00100000:0.0:1746126987.185618:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.185674:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.185703:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.185715:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991072768 00000100:00100000:0.0:1746126987.185717:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991072768 00010000:00010000:0.0:1746126987.185731:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6ef62d6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50efb expref: 14 pid: 9612 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.185745:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991072896 00000100:00100000:0.0:1746126987.185746:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991072896 00010000:00010000:0.0:1746126987.185754:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880121600600/0x34dc807b6ef6266 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ebc expref: 20 pid: 1964 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.185764:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991073152 00000100:00100000:0.0:1746126987.185766:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991073152 00010000:00010000:0.0:1746126987.185772:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e96a00/0x34dc807b6ef6186 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e4c expref: 20 pid: 16295 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.185783:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9282 00000100:00100000:0.0:1746126987.185787:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991072768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.185794:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.185807:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6ef62d6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50efb expref: 14 pid: 9612 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.185815:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6ef62d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50efb expref: 14 pid: 9612 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.185827:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.185838:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991072768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 51us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.185843:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9282 00000100:00100000:0.0:1746126987.185873:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9284 00000100:00100000:0.0:1746126987.185877:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991073152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.185882:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.185889:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e96a00/0x34dc807b6ef6186 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e4c expref: 20 pid: 16295 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.185896:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e96a00/0x34dc807b6ef6186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e4c expref: 20 pid: 16295 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.185907:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e96a00/0x34dc807b6ef6186 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e4c expref: 20 pid: 16295 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.185919:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.185932:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991073152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.185937:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9284 00000100:00100000:0.0:1746126987.185959:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.185969:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991073280 00000100:00100000:0.0:1746126987.185971:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991073280 00010000:00010000:0.0:1746126987.185981:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6ef614e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e30 expref: 42 pid: 9612 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.185990:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9285 00000100:00100000:0.0:1746126987.185994:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991073280:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.186000:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.186006:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6ef614e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e30 expref: 42 pid: 9612 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.186013:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6ef614e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e30 expref: 42 pid: 9612 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.186023:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6ef614e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50e30 expref: 42 pid: 9612 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.186031:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.186044:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991073280:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 49us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.186049:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9285 00000100:00100000:0.0:1746126987.186105:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.186115:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991073024 00000100:00100000:0.0:1746126987.186118:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991073024 00010000:00010000:0.0:1746126987.186143:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 12 pid: 11152 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.186167:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9286 00000100:00100000:0.0:1746126987.186172:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991073024:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.186179:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.186185:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 12 pid: 11152 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.186197:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 12 pid: 11152 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.186207:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef62c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eed expref: 12 pid: 11152 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.186213:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.186215:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.186218:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 18 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.186224:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 18 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.186243:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 18 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.186253:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994025856:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126987.186291:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c95ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.191535:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991074688 00000100:00100000:0.0:1746126987.191540:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991074688 00002000:00100000:0.0:1746126987.191558:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1875968->1880063) req@ffff8801220f3b80 x1830945991074688/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/0 e 0 to 0 dl 1746126998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.191564:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f3b80 with x1830945991074688 ext(1875968->1880063) 00002000:00010000:0.0:1746126987.191567:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801220f3b80 00000100:00100000:0.0:1746126987.191578:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7908 00000100:00100000:0.0:1746126987.191582:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991074688:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126987.191639:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991074688:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 55us (144us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126987.191644:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7908 00002000:00100000:0.0:1746126987.191648:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1875968->1880063) req@ffff8801220f3b80 x1830945991074688/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/4536 e 0 to 0 dl 1746126998 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.191654:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f3b80 with x1830945991074688 ext(1875968->1880063) 00002000:00010000:0.0:1746126987.191656:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801220f3b80 00000100:00100000:0.0:1746126987.197004:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.214891:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.216088:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991075712 00000100:00100000:0.0:1746126987.216091:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991075712 00010000:00010000:0.0:1746126987.216111:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 43 pid: 1964 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.216148:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9287 00000100:00100000:0.0:1746126987.216154:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991075712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.216181:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.216195:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 43 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.216207:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 43 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.216552:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995eb200/0x34dc807b6ef63bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f6b expref: 43 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.216579:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.216602:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.216690:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995eac00/0x34dc807b6ef6449 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fc6 expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.216699:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995eac00/0x34dc807b6ef6449 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fc6 expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.216778:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800995eac00/0x34dc807b6ef6449 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fc6 expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.216789:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994026880:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126987.216857:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c95ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.223657:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.234173:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.234227:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.257991:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.267066:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.270205:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.274424:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.345532:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.347745:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.350425:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126987.352426:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef647a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352434:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef647a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:0.0:1746126987.352475:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126987.352479:0:10958:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126987.352493:0:10958:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef647a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352502:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef647a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352512:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352517:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352522:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352527:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352532:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126987.352535:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352541:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352548:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126987.352551:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126987.352554:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.352559:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef646c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353357:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6ef6473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353364:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6ef6473 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353368:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6ef6473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353372:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126987.353375:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6ef6473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353380:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6ef6473 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353387:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829300) 00010000:00010000:0.0:1746126987.353390:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126987.353392:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6ef6473 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353397:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6ef6473 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126987.353424:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef6465 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fdb expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.353434:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef647a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fdb expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.353439:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126987.353442:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126987.353444:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82400, rc 0) 00000100:00100000:0.0:1746126987.353506:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:3543:x1830945991077376:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 7692us (7981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.353513:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16962 00000100:00100000:0.0:1746126987.356665:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.357190:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.357215:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.357229:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.357259:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.357272:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991078144 00000100:00100000:0.0:1746126987.357275:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991078144 00000100:00100000:0.0:1746126987.357305:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20188 00000100:00100000:0.0:1746126987.357310:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991078272:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126987.357319:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.357329:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6ef6488 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e50ff7 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.357345:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.357346:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.357353:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6ef6488 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff7 expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.357364:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6ef6488 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff7 expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.357373:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e981400, rc 0) 00000100:00100000:0.0:1746126987.357404:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991078272:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.357412:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20188 00000100:00100000:0.0:1746126987.357421:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20190 00000100:00100000:0.0:1746126987.357425:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991078400:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126987.357430:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.357437:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e980a00/0x34dc807b6ef6496 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e50ffe expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.357445:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.357446:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.357450:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980a00/0x34dc807b6ef6496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ffe expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.357459:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e980a00/0x34dc807b6ef6496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ffe expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.357471:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e980a00, rc 0) 00000100:00100000:0.0:1746126987.357485:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991078400:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.357490:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20190 00000100:00100000:0.0:1746126987.362263:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.365195:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.367635:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.370075:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.372117:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.372198:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.372211:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.372228:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991079424 00000100:00100000:0.0:1746126987.372233:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991079424 00000100:00100000:0.0:1746126987.372255:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991079680 00000100:00100000:0.0:1746126987.372257:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991079680 00000100:00100000:0.0:1746126987.372279:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991079936 00000100:00100000:0.0:1746126987.372281:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991079936 00000100:00100000:0.0:1746126987.372294:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20192 00000100:00100000:0.0:1746126987.372300:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991079424:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126987.372328:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372343:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 19 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372349:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126987.372350:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126987.372353:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372376:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 19 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372387:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be47e00/0x34dc807b6ef6403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f95 expref: 19 pid: 1964 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.372399:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994027776:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.372453:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c95ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.372469:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20193 00000100:00100000:0.0:1746126987.372474:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991079680:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126987.372492:0:1964:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef64dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372502:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6ef645e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fd4 expref: 19 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372508:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6ef648f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff0 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.372514:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.372515:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.372517:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef64dc lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372531:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6ef648f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff0 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.372538:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6ef648f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff0 expref: 15 pid: 12333 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.372546:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994027904:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.372571:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6ef645e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fd4 expref: 19 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.372579:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6ef645e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50fd4 expref: 19 pid: 9611 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.372592:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095caa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994028032:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.372607:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094bd4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.373203:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.373304:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.373332:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.373467:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20197 00000100:00100000:0.0:1746126987.373473:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991079808:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126987.373485:0:11152:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef64f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.373493:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6200/0x34dc807b6ef6362 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f3a expref: 19 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.373500:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6ef6488 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff7 expref: 17 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.373507:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099159800/0x34dc807b6ef6393 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f4f expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.373511:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.373513:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.373515:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef64f8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.373527:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099159800/0x34dc807b6ef6393 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f4f expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.373535:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099159800/0x34dc807b6ef6393 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f4f expref: 31 pid: 1964 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.373542:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cabb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994028672:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.373562:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6ef6488 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff7 expref: 17 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.373569:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6ef6488 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50ff7 expref: 17 pid: 1964 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.373577:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994028928:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.373596:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac6200/0x34dc807b6ef6362 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f3a expref: 19 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.373953:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6200/0x34dc807b6ef6362 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f3a expref: 19 pid: 1964 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.373963:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994029184:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.377686:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.377758:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.379495:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.383114:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991081088 00000100:00100000:0.0:1746126987.383118:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991081088 00010000:00010000:0.0:1746126987.383149:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096658000/0x34dc807b6ef625f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eb5 expref: 32 pid: 1964 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.383173:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991081344 00000100:00100000:0.0:1746126987.383176:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991081344 00010000:00010000:0.0:1746126987.383184:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099159800/0x34dc807b6ef6393 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f4f expref: 33 pid: 1964 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.383195:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9299 00000100:00100000:0.0:1746126987.383199:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991081088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.383205:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.383213:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096658000/0x34dc807b6ef625f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eb5 expref: 33 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.383220:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096658000/0x34dc807b6ef625f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eb5 expref: 33 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.383231:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096658000/0x34dc807b6ef625f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50eb5 expref: 33 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.383241:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.383243:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.383245:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012158da00/0x34dc807b6ef64ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.383250:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012158da00/0x34dc807b6ef64ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.383262:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.383280:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991081088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.383285:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9299 00000100:00100000:0.0:1746126987.383294:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9300 00000100:00100000:0.0:1746126987.383298:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991081344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.383303:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.383309:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099159800/0x34dc807b6ef6393 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f4f expref: 31 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.383316:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099159800/0x34dc807b6ef6393 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f4f expref: 31 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.383325:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099159800/0x34dc807b6ef6393 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50f4f expref: 31 pid: 1964 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.383333:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.383345:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991081344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.383350:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9300 00000100:00100000:0.0:1746126987.383688:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.384559:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126987.390669:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390678:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390697:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390704:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390711:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390717:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e980600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126987.390720:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390727:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390738:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.390744:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef64d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.392200:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991079424:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 19894us (20080us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.392210:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20192 00000100:00100000:0.0:1746126987.397217:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.401340:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.404568:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.404592:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.404615:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.405492:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000001:00080000:0.0:1746126987.407939:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937833 is committed 00000004:00080000:0.0:1746126987.407943:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1229 committed 00000004:00080000:0.0:1746126987.407951:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1192 committed 00000004:00080000:0.0:1746126987.407961:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1191 committed 00000004:00080000:0.0:1746126987.407962:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1190 committed 00000004:00080000:0.0:1746126987.407964:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1189 committed 00000004:00080000:0.0:1746126987.407965:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1228 committed 00000004:00080000:0.0:1746126987.407966:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1188 committed 00000004:00080000:0.0:1746126987.407967:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1227 committed 00000004:00080000:0.0:1746126987.407968:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1187 committed 00000004:00080000:0.0:1746126987.407970:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1226 committed 00000004:00080000:0.0:1746126987.407971:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1225 committed 00000004:00080000:0.0:1746126987.407972:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1224 committed 00000004:00080000:0.0:1746126987.407973:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1186 committed 00000004:00080000:0.0:1746126987.407975:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1185 committed 00000004:00080000:0.0:1746126987.407976:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1223 committed 00000004:00080000:0.0:1746126987.407978:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1222 committed 00000004:00080000:0.0:1746126987.407979:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1184 committed 00000001:00080000:0.0:1746126987.407985:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937830 is committed 00000001:00080000:0.0:1746126987.407988:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937829 is committed 00000100:00100000:0.0:1746126987.408046:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994030080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408085:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.408110:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994030592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408125:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994030208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408170:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.408182:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994030720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408193:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.408212:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994030080 00000100:00100000:0.0:1746126987.408216:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994030080 00000100:00100000:0.0:1746126987.408246:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994029952 00000100:00100000:0.0:1746126987.408248:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994029952 00000100:00100000:0.0:1746126987.408255:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994030208 00000100:00100000:0.0:1746126987.408256:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994030208 00000100:00100000:0.0:1746126987.408263:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994030720 00000100:00100000:0.0:1746126987.408265:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994030720 00000100:00100000:0.0:1746126987.408272:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994030848 00000100:00100000:0.0:1746126987.408274:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994030848 00000100:00100000:0.0:1746126987.408282:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20199 00000100:00100000:0.0:1746126987.408286:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3783:x1830945994029952:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746126987.408345:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126987.408354:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20201 00000100:00100000:0.0:1746126987.408358:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3783:x1830945994030464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408413:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3783:x1830945994030464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (227us total) trans 21474842588 rc 0/0 00000100:00100000:0.0:1746126987.408418:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20201 00000100:00100000:0.0:1746126987.408426:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20203 00000100:00100000:0.0:1746126987.408429:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3783:x1830945994030336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126987.408458:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746126987.408460:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126987.408462:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126987.408463:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126987.408465:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:0.0:1746126987.408477:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3783:x1830945994030336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (264us total) trans 21474842590 rc 0/0 00000100:00100000:0.0:1746126987.408482:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20203 00000004:00080000:0.0:1746126987.408509:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede3480/2, rc 0, transno 21474842587 00000100:00100000:0.0:1746126987.408516:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994030208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.408524:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e2a00/2, rc 0, transno 21474842589 00000100:00100000:0.0:1746126987.408527:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994030720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408538:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.408554:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994030592 00000100:00100000:0.0:1746126987.408556:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994030592 00000100:00100000:0.0:1746126987.408567:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20205 00000100:00100000:0.0:1746126987.408570:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d7a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3784:x1830945994030592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408608:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d7a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994030592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (69us total) trans 21474842593 rc 0/0 00000100:00100000:0.0:1746126987.408615:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20205 00000004:00080000:0.0:1746126987.408628:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e1500/2, rc 0, transno 21474842593 00000100:00100000:0.0:1746126987.408631:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994030592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.408636:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede2a00/2, rc 0, transno 21474842592 00000100:00100000:0.0:1746126987.408639:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994030080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408664:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3783:x1830945994029952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 377us (541us total) trans 21474842586 rc 0/0 00000100:00100000:0.0:1746126987.408668:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20199 00000004:00080000:0.0:1746126987.408834:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede0a80/2, rc 0, transno 21474842590 00000100:00100000:0.0:1746126987.408838:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994030336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.408846:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e2680/2, rc 0, transno 21474842591 00000100:00100000:0.0:1746126987.408849:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994030848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.408853:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede3b80/2, rc 0, transno 21474842586 00000100:00100000:0.0:1746126987.408856:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994029952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.408861:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e1f80/2, rc 0, transno 21474842588 00000100:00100000:0.0:1746126987.408864:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994030464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.408934:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.408947:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994030976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.408964:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.408975:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994031488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.408986:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.408995:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746126987.408999:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994031360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409012:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.409019:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994031872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409029:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.409041:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409053:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.409061:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409071:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.409085:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746126987.409088:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409100:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.409105:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409116:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.409127:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994031744 00000100:00100000:0.0:1746126987.409144:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994031744 00000100:00100000:0.0:1746126987.409153:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20207 00000100:00100000:0.0:1746126987.409166:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3783:x1830945994031488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409234:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3783:x1830945994031488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (247us total) trans 17179875357 rc 0/0 00000100:00100000:0.0:1746126987.409240:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20207 00000100:00100000:0.0:1746126987.409248:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20210 00000100:00100000:0.0:1746126987.409251:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3785:x1830945994031232:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.409285:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0c000/2, rc 0, transno 17179875356 00000100:00100000:0.0:1746126987.409288:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994031360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.409294:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0c700/2, rc 0, transno 17179875358 00000100:00100000:0.0:1746126987.409296:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994031872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.409301:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0d500/2, rc 0, transno 17179875355 00000100:00100000:0.0:1746126987.409303:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994030976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.409307:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0d880/2, rc 0, transno 17179875357 00000100:00100000:0.0:1746126987.409309:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994031488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.409340:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3785:x1830945994031232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (286us total) trans 17179875359 rc 0/0 00000100:00100000:0.0:1746126987.409344:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20210 00000100:00100000:0.0:1746126987.409352:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20213 00000100:00100000:0.0:1746126987.409356:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3785:x1830945994031616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126987.409387:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746126987.409390:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126987.409391:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126987.409393:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126987.409395:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746126987.409409:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3785:x1830945994031616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (292us total) trans 17179875361 rc 0/0 00000100:00100000:0.0:1746126987.409414:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20213 00000004:00080000:0.0:1746126987.409429:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0ca80/2, rc 0, transno 17179875362 00000100:00100000:0.0:1746126987.409432:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.409437:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0f480/2, rc 0, transno 17179875361 00000100:00100000:0.0:1746126987.409439:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.409445:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0d180/2, rc 0, transno 17179875359 00000100:00100000:0.0:1746126987.409447:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.409451:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0e300/2, rc 0, transno 17179875360 00000100:00100000:0.0:1746126987.409454:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994031744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.411715:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.411751:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.414614:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.416638:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.421843:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.421878:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.421903:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.421928:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.421949:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.422959:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.422989:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.423003:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991084160 00000100:00100000:0.0:1746126987.423005:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991084160 00000100:00100000:0.0:1746126987.423017:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20216 00000100:00100000:0.0:1746126987.423021:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991084032:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126987.423029:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.423043:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6ef6561 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5104b expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126987.423060:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c889, atime: 0x6813c889, ctime: 0x6813c889, blocks: 0x800 00010000:00010000:0.0:1746126987.423072:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.423074:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.423081:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6ef6561 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5104b expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.423092:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6ef6561 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5104b expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.423100:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47600, rc 0) 00000100:00100000:0.0:1746126987.423149:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991084032:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 128us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.423163:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20216 00000100:00100000:0.0:1746126987.423175:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20218 00000100:00100000:0.0:1746126987.423179:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991083648:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126987.423184:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.423190:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f44000/0x34dc807b6ef6576 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51036 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126987.423202:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c889, atime: 0x6813c888, ctime: 0x6813c889, blocks: 0x7e0 00010000:00010000:0.0:1746126987.423207:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.423208:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.423212:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f44000/0x34dc807b6ef6576 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51036 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.423219:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f44000/0x34dc807b6ef6576 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51036 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.423224:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44000, rc 0) 00000100:00100000:0.0:1746126987.423609:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991083648:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 429us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.423746:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20218 00000100:00100000:0.0:1746126987.425282:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.428677:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.428715:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.428741:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.429255:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.429551:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.429573:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.429795:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20223 00000100:00100000:0.0:1746126987.429801:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991085312:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.429807:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.429813:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef65a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51083 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.429827:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.429828:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.429832:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef65a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51083 expref: 21 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.429840:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef65a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51083 expref: 21 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.429846:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be42e00, rc 0) 00000100:00100000:0.0:1746126987.430029:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991085312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 229us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.430034:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20223 00000100:00100000:0.0:1746126987.431631:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.445790:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.445862:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.446091:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.446108:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991086080 00000100:00100000:0.0:1746126987.446111:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991086080 00002000:00100000:0.0:1746126987.446202:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012225ca80 x1830945991086080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/0 e 0 to 0 dl 1746126998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.446212:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012225ca80 with x1830945991086080 ext(1048576->2097151) 00002000:00010000:0.0:1746126987.446216:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012225ca80 00000100:00100000:0.0:1746126987.446244:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7913 00000100:00100000:0.0:1746126987.446249:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991086080:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126987.446835:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.446867:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.446881:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991086976 00000100:00100000:0.0:1746126987.446884:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991086976 00000100:00100000:0.0:1746126987.446905:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6388 00000100:00100000:0.0:1746126987.446910:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:3551:x1830945991086976:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746126987.447053:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:3551:x1830945991086976:12345-192.168.203.42@tcp:35:cat.0 Request processed in 142us (186us total) trans 8589937838 rc 0/0 00000100:00100000:0.0:1746126987.447060:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6388 00000100:00100000:0.0:1746126987.458422:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.463940:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991086592:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17037us (17103us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126987.463947:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7916 00002000:00100000:0.0:1746126987.463952:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012225d880 x1830945991086592/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/440 e 0 to 0 dl 1746126998 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.463957:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012225d880 with x1830945991086592 ext(1048576->2097151) 00002000:00010000:0.0:1746126987.463960:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012225d880 00000100:00100000:0.0:1746126987.469630:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991087488 00000100:00100000:0.0:1746126987.469634:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991087488 00000100:00100000:0.0:1746126987.469658:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20227 00000100:00100000:0.0:1746126987.469666:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991087232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.469685:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.469704:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6ef65f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5109f expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.469728:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.469730:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.469739:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6ef65f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5109f expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.469755:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6ef65f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5109f expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.469765:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915be00, rc 0) 00000100:00100000:0.0:1746126987.469812:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991087232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 147us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.469819:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20227 00000100:00100000:0.0:1746126987.469834:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20228 00000100:00100000:0.0:1746126987.469839:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991087360:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.469845:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.469854:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef65fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510a6 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.469865:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.469866:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.469870:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef65fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510a6 expref: 43 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.469879:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef65fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510a6 expref: 43 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.469886:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915ba00, rc 0) 00000100:00100000:0.0:1746126987.469900:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991087360:12345-192.168.203.42@tcp:101:cat.0 Request processed in 61us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.469908:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20228 00000100:00100000:0.0:1746126987.469916:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20229 00000100:00100000:0.0:1746126987.469920:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991087488:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.469924:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.469929:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915a200/0x34dc807b6ef6602 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510ad expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.469937:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.469939:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.469942:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009915a200/0x34dc807b6ef6602 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510ad expref: 43 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.469950:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915a200/0x34dc807b6ef6602 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510ad expref: 43 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.469956:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915a200, rc 0) 00000100:00100000:0.0:1746126987.469970:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991087488:12345-192.168.203.42@tcp:101:cat.0 Request processed in 49us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.469974:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20229 00000100:00100000:0.0:1746126987.470019:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.470064:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.470077:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991087616 00000100:00100000:0.0:1746126987.470080:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991087616 00000100:00100000:0.0:1746126987.470094:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991087744 00000100:00100000:0.0:1746126987.470096:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991087744 00000100:00100000:0.0:1746126987.470106:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20230 00000100:00100000:0.0:1746126987.470110:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991087616:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.470116:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.470123:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef6609 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510b4 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.470149:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.470150:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.470162:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef6609 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510b4 expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.470171:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef6609 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510b4 expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.470177:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341ac00, rc 0) 00000100:00100000:0.0:1746126987.470192:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991087616:12345-192.168.203.42@tcp:101:cat.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.470196:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20230 00000100:00100000:0.0:1746126987.470206:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20231 00000100:00100000:0.0:1746126987.470210:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991087744:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.470215:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.470220:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915b200/0x34dc807b6ef6610 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510bb expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.470229:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.470230:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.470234:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915b200/0x34dc807b6ef6610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510bb expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.470241:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915b200/0x34dc807b6ef6610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510bb expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.470247:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915b200, rc 0) 00000100:00100000:0.0:1746126987.470259:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991087744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.470263:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20231 00000100:00100000:0.0:1746126987.470350:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.470389:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991087872 00000100:00100000:0.0:1746126987.470391:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991087872 00000100:00100000:0.0:1746126987.470409:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20232 00000100:00100000:0.0:1746126987.470413:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991087872:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.470418:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.470425:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdad600/0x34dc807b6ef6617 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510c2 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.470434:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.470435:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.470440:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdad600/0x34dc807b6ef6617 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510c2 expref: 44 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.470447:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdad600/0x34dc807b6ef6617 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510c2 expref: 44 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.470453:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdad600, rc 0) 00000100:00100000:0.0:1746126987.470471:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991087872:12345-192.168.203.42@tcp:101:cat.0 Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.470476:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20232 00000100:00100000:0.0:1746126987.471727:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.479868:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.480235:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.480288:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.480343:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.481421:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991088896 00000100:00100000:0.0:1746126987.481425:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991088896 00002000:00100000:0.0:1746126987.481442:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a8eeb480 x1830945991088896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:748/0 lens 488/0 e 0 to 0 dl 1746126998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.481449:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb480 with x1830945991088896 ext(1048576->2097151) 00002000:00010000:0.0:1746126987.481453:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8eeb480 00000100:00100000:0.0:1746126987.481482:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7918 00000100:00100000:0.0:1746126987.481488:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991088896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126987.485560:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.485898:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.485962:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991089664 00000100:00100000:0.0:1746126987.485968:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991089664 00002000:00100000:0.0:1746126987.486002:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a8ee9500 x1830945991089664/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/0 e 0 to 0 dl 1746126998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.486011:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9500 with x1830945991089664 ext(2097152->4194303) 00002000:00010000:0.0:1746126987.486016:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8ee9500 00000100:00100000:0.0:1746126987.486036:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7922 00000100:00100000:0.0:1746126987.486042:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991089664:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126987.520888:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.525171:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.525215:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.526117:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16976 00000100:00100000:0.0:1746126987.526123:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:3545:x1830945991090432:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126987.526146:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.526148:0:7260:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746126987.526189:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef65ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51098 expref: 31 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.526205:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126987.526208:0:7260:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126987.526214:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef6648 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510d7 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.526248:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126987.526279:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef6656 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126987.526285:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126987.526452:0:7260:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef6656 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126987.526471:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746126987.526536:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991089920:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5070us (5659us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746126987.526544:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7923 00002000:00100000:0.0:1746126987.526560:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a8eea680 x1830945991089920/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/440 e 0 to 0 dl 1746126998 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.526568:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eea680 with x1830945991089920 ext(4194304->4829183) 00002000:00010000:0.0:1746126987.526571:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8eea680 00000100:00100000:0.0:1746126987.528837:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.528866:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.528896:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.528935:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.529355:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991091200 00000100:00100000:0.0:1746126987.529358:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991091200 00010000:00010000:0.0:1746126987.529371:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef6537 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51028 expref: 9 pid: 11634 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.529387:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9309 00000100:00100000:0.0:1746126987.529392:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991091200:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.529399:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.529404:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef6537 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51028 expref: 9 pid: 11634 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.529412:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef6537 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51028 expref: 9 pid: 11634 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.529429:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126987.529433:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef6656 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126987.529440:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef6656 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126987.529448:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.529489:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991091200:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 95us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.529494:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9309 00000100:00100000:0.0:1746126987.529555:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7925 00000100:00100000:0.0:1746126987.529561:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991090944:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126987.530786:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.530815:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991091328 00000100:00100000:0.0:1746126987.530819:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991091328 00000100:00100000:0.0:1746126987.530839:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16977 00000100:00100000:0.0:1746126987.530844:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:3549:x1830945991091328:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.530854:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.530864:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea600/0x34dc807b6ef665d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510de expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.530903:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126987.530909:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea600/0x34dc807b6ef665d lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510de expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.530920:0:13448:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126987.530928:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea600/0x34dc807b6ef665d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510de expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.530941:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126987.530943:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126987.530945:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126987.530950:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caea600, rc 0) 00000100:00100000:0.0:1746126987.530969:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:3549:x1830945991091328:12345-192.168.203.42@tcp:101:cat.0 Request processed in 124us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.530974:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16977 00000100:00100000:0.0:1746126987.536885:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994032512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.536930:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.536966:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994033024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.536981:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.536994:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126987.536998:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994032640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.537011:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.537022:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994033152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.537033:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.537054:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994032896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.537067:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.537076:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.537089:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.537100:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746126987.537105:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.537120:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.537150:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994032768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.537177:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.537188:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.537210:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126987.538103:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099425500/2, rc 0, transno 21474842602 00000100:00100000:0.0:1746126987.538107:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.538112:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.538801:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126987.538823:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099426a00/2, rc 0, transno 21474842601 00000100:00100000:0.0:1746126987.538826:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994032896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.538833:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099425c00/2, rc 0, transno 21474842599 00000100:00100000:0.0:1746126987.538836:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.538845:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0ce00/2, rc 0, transno 17179875363 00000100:00100000:0.0:1746126987.538848:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.538853:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099426680/2, rc 0, transno 21474842600 00000100:00100000:0.0:1746126987.538855:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994032768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.538980:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0dc00/2, rc 0, transno 17179875370 00000100:00100000:0.0:1746126987.538983:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994033792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.545955:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126987.546214:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126987.546222:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7260 initiator: MDT0 00000040:00080000:0.0:1746126987.546434:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1226, 88 off115480 00000004:00080000:0.0:1746126987.546439:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588308962ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546532:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1263, 88 off118824 00000004:00080000:0.0:1746126987.546536:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588406922ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126987.546553:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1264, 88 off118912 00000004:00080000:0.0:1746126987.546556:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588426452ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126987.546564:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1227, 88 off115568 00000004:00080000:0.0:1746126987.546566:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588437077ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546585:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1228, 88 off115656 00000004:00080000:0.0:1746126987.546588:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588458602ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546596:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1265, 88 off119000 00000004:00080000:0.0:1746126987.546598:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588468730ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126987.546607:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1266, 88 off119088 00000004:00080000:0.0:1746126987.546609:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588479952ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126987.546617:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1267, 88 off119176 00000004:00080000:0.0:1746126987.546619:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588490059ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126987.546628:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1229, 88 off115744 00000004:00080000:0.0:1746126987.546631:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588501417ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546647:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1268, 88 off119264 00000004:00080000:0.0:1746126987.546650:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588520819ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126987.546659:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1230, 88 off115832 00000004:00080000:0.0:1746126987.546662:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588532679ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546669:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1269, 88 off119352 00000004:00080000:0.0:1746126987.546673:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588543554ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126987.546681:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1231, 88 off115920 00000004:00080000:0.0:1746126987.546684:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588554480ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546694:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1232, 88 off116008 00000004:00080000:0.0:1746126987.546696:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588566437ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546703:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1233, 88 off116096 00000004:00080000:0.0:1746126987.546706:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588576494ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546720:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1234, 88 off116184 00000004:00080000:0.0:1746126987.546722:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 882588592902ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126987.546731:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1270, 88 off119440 00000004:00080000:0.0:1746126987.546733:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882588604212ns, next at 847916249980ns, rc = 0 00000100:00100000:0.0:1746126987.548921:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126987.553561:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef664f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510d7 expref: 30 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.553572:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126987.553574:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746126987.553578:0:7260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea600/0x34dc807b6ef665d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510de expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.553587:0:7260:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea600/0x34dc807b6ef665d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510de expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.553593:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea600/0x34dc807b6ef665d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510de expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.553599:0:7260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2800/0x34dc807b6ef6664 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510e5 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.553604:0:7260:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2800/0x34dc807b6ef6664 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510e5 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.553612:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2800/0x34dc807b6ef6664 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510e5 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.553632:0:7260:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2800/0x34dc807b6ef6664 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510e5 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.553640:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994036864:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126987.553705:0:7260:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea600/0x34dc807b6ef665d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510de expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.553712:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994036992:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126987.553729:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094bd4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.553740:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994035072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.553818:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.553834:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994035584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.553846:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.553856:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994036096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.553874:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.553885:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994036608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.553897:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.553905:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746126987.553909:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994035968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.553925:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994035584 00000100:00100000:0.0:1746126987.553928:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994035584 00000100:00100000:0.0:1746126987.553939:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994036096 00000100:00100000:0.0:1746126987.553941:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994036096 00000100:00100000:0.0:1746126987.553947:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994036608 00000100:00100000:0.0:1746126987.553949:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994036608 00000100:00100000:0.0:1746126987.553954:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994035200 00000100:00100000:0.0:1746126987.553956:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994035200 00000100:00100000:0.0:1746126987.553963:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20253 00000100:00100000:0.0:1746126987.553967:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3783:x1830945994035072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126987.554010:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746126987.554012:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554015:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554016:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554018:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746126987.554417:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3783:x1830945994035072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 449us (599us total) trans 21474842606 rc 0/0 00000100:00100000:0.0:1746126987.554423:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20253 00000100:00100000:0.0:1746126987.554433:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20254 00000100:00100000:0.0:1746126987.554437:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3785:x1830945994035328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.554482:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3785:x1830945994035328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (649us total) trans 21474842608 rc 0/0 00000100:00100000:0.0:1746126987.554487:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20254 00000100:00100000:0.0:1746126987.554495:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20256 00000100:00100000:0.0:1746126987.554499:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3785:x1830945994035712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126987.554541:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126987.554543:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554545:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554547:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554549:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126987.554561:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3785:x1830945994035712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (703us total) trans 17179875371 rc 0/0 00000100:00100000:0.0:1746126987.554566:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20256 00000100:00100000:0.0:1746126987.554573:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20257 00000100:00100000:0.0:1746126987.554576:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3783:x1830945994036096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126987.554600:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126987.554602:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554603:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746126984 -> 1746126984 00002000:00010000:0.0:1746126987.554605:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746126985 -> 1746126985 00002000:00010000:0.0:1746126987.554607:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746126987.554621:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3783:x1830945994036096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (747us total) trans 17179875372 rc 0/0 00000100:00100000:0.0:1746126987.554625:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20257 00000100:00100000:0.0:1746126987.554632:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20258 00000100:00100000:0.0:1746126987.554636:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3783:x1830945994036608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.554670:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3783:x1830945994036608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 34us (773us total) trans 17179875373 rc 0/0 00000100:00100000:0.0:1746126987.554675:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20258 00000100:00100000:0.0:1746126987.554681:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20260 00000100:00100000:0.0:1746126987.554685:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3785:x1830945994035200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126987.554710:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746126987.554712:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126987.554714:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126987.554715:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126987.554718:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:0.0:1746126987.554877:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3785:x1830945994035200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (960us total) trans 21474842610 rc 0/0 00000100:00100000:0.0:1746126987.554883:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20260 00000100:00100000:0.0:1746126987.554891:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994036736 00000100:00100000:0.0:1746126987.554893:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994036736 00000100:00100000:0.0:1746126987.554905:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20263 00000100:00100000:0.0:1746126987.554908:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+82:3785:x1830945994036736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.554962:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3785:x1830945994036736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (142us total) trans 17179875376 rc 0/0 00000100:00100000:0.0:1746126987.554967:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20263 00000100:00100000:0.0:1746126987.554981:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126987.554993:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994036480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.555005:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126987.555018:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22f480/2, rc 0, transno 21474842606 00000100:00100000:0.0:1746126987.555021:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994035072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.555028:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22ca80/2, rc 0, transno 21474842609 00000100:00100000:0.0:1746126987.555030:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994035584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126987.555036:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cabb80/2, rc 0, transno 17179875372 00000100:00100000:0.0:1746126987.555038:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994036096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126987.555043:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f2a00/2, rc 0, transno 17179875373 00000100:00100000:0.0:1746126987.555045:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994036608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.555068:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20266 00000100:00100000:0.0:1746126987.555072:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3784:x1830945994037120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126987.555119:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3784:x1830945994037120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (97us total) trans 21474842612 rc 0/0 00000100:00100000:0.0:1746126987.555125:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20266 00000004:00080000:0.0:1746126987.555163:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cab100/2, rc 0, transno 17179875377 00000100:00100000:0.0:1746126987.555166:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994035968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126987.558397:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.558428:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.558453:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991091712 00000100:00100000:0.0:1746126987.558460:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991091712 00000100:00100000:0.0:1746126987.558508:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6390 00000100:00100000:0.0:1746126987.558516:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:3551:x1830945991091712:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:0.0:1746126987.558602:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:3551:x1830945991091712:12345-192.168.203.42@tcp:49:cat.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.558610:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6390 00000100:00100000:0.0:1746126987.558680:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.562894:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.569862:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.572330:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.572362:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.572394:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.572412:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991092352 00000100:00100000:0.0:1746126987.572416:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991092352 00000100:00100000:0.0:1746126987.572474:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20268 00000100:00100000:0.0:1746126987.572480:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:3545:x1830945991092352:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126987.572492:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.572503:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01200/0x34dc807b6ef6679 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e510fa expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.572527:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6ef6568 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5103d expref: 13 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.572534:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef65fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510a6 expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.572541:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef65ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5106e expref: 26 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.572546:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.572548:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.572551:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01200/0x34dc807b6ef6679 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1277952->2039807] (req 1277952->2039807) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510fa expref: 46 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.572569:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef65ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5106e expref: 26 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.572577:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef65ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5106e expref: 26 pid: 3542 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.572586:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994037632:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.572640:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef65fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510a6 expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.572647:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef65fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510a6 expref: 46 pid: 3148 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.572660:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994037760:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126987.572804:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6ef6568 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5103d expref: 13 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126987.572813:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6ef6568 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5103d expref: 13 pid: 3542 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.572820:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994037888:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.572839:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8dd1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.572911:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.572954:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.576683:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.576743:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.576975:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.577030:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.579918:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.581549:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.581581:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.581613:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.581735:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7929 00000100:00100000:0.0:1746126987.581742:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991094400:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126987.581814:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991094400:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 72us (200us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126987.581849:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7929 00002000:00100000:0.0:1746126987.581855:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1277952->1282047) req@ffff88008c5be300 x1830945991094400/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:748/0 lens 488/4536 e 0 to 0 dl 1746126998 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.581862:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5be300 with x1830945991094400 ext(1277952->1282047) 00002000:00010000:0.0:1746126987.581864:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c5be300 00000100:00100000:0.0:1746126987.583260:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991094656 00000100:00100000:0.0:1746126987.583264:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991094656 00002000:00100000:0.0:1746126987.583284:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800a1788e00 x1830945991094656/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:748/0 lens 488/0 e 0 to 0 dl 1746126998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.583291:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788e00 with x1830945991094656 ext(3145728->4194303) 00002000:00010000:0.0:1746126987.583295:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1788e00 00000100:00100000:0.0:1746126987.583315:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7930 00000100:00100000:0.0:1746126987.583321:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991094656:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126987.586851:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.586995:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.588676:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991095040 00000100:00100000:0.0:1746126987.588679:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991095040 00010000:00010000:0.0:1746126987.588695:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6ef6561 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5104b expref: 15 pid: 12333 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746126987.588721:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9319 00000100:00100000:0.0:1746126987.588725:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2029:x1830945991094912:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.588733:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.588742:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef6609 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510b4 expref: 35 pid: 12333 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.588754:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef6609 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510b4 expref: 35 pid: 12333 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.588766:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef6609 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510b4 expref: 35 pid: 12333 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.588777:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126987.588798:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991094912:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126987.588803:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9319 00000100:00100000:0.0:1746126987.588814:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9320 00000100:00100000:0.0:1746126987.588818:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991095040:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.588823:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.588829:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6ef6561 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5104b expref: 15 pid: 12333 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.588836:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6ef6561 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5104b expref: 15 pid: 12333 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.588845:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6ef6561 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5104b expref: 15 pid: 12333 timeout: 982 lvb_type: 1 00010000:00010000:0.0:1746126987.588852:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.588858:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.588863:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 19 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.588870:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 19 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.588893:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 19 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.588902:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994038784:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126987.588944:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8dd1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.593386:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.597038:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.597102:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.598183:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.598476:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.607896:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.617960:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.618002:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.705367:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.708342:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.710763:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.715119:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.723206:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.738906:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.743211:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.752513:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.754790:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.755765:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.758673:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.760926:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.760958:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.761047:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.761791:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.761811:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.761839:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.777777:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.777889:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.792396:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.792445:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.793013:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.793037:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991101440 00000100:00100000:0.0:1746126987.793040:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991101440 00000100:00100000:0.0:1746126987.793060:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20282 00000100:00100000:0.0:1746126987.793066:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:3564:x1830945991101440:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126987.793074:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126987.793325:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef673d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51178 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.793347:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7200/0x34dc807b6ef6672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510f3 expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.793353:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126987.793356:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126987.793359:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef673d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51178 expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.793978:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7200/0x34dc807b6ef6672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510f3 expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.793990:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7200/0x34dc807b6ef6672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510f3 expref: 25 pid: 9613 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746126987.794003:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994040320:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126987.802003:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.811640:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.817645:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.818383:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.818511:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.818554:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991102336 00000100:00100000:0.0:1746126987.818557:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991102336 00002000:00100000:0.0:1746126987.818578:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a5b99f80 x1830945991102336/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:748/0 lens 488/0 e 0 to 0 dl 1746126998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.818587:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99f80 with x1830945991102336 ext(1048576->2097151) 00002000:00010000:0.0:1746126987.818590:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b99f80 00000100:00100000:0.0:1746126987.818620:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7942 00000100:00100000:0.0:1746126987.821595:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.821630:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.821656:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991102848 00000100:00100000:0.0:1746126987.821662:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991102848 00002000:00100000:0.0:1746126987.821905:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4825087) req@ffff8800a5b99880 x1830945991102848/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/0 e 0 to 0 dl 1746126998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.821960:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99880 with x1830945991102848 ext(4194304->4825087) 00002000:00010000:0.0:1746126987.821965:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b99880 00000100:00100000:0.0:1746126987.821983:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7943 00000100:00100000:0.0:1746126987.821990:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991102848:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126987.830694:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.838494:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.850308:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991103104:12345-192.168.203.42@tcp:4:cat.0 Request processed in 10256us (11806us total) trans 21474842613 rc 0/0 00000100:00100000:0.0:1746126987.850320:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1711 00002000:00100000:0.0:1746126987.850334:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1515519) req@ffff880096633800 x1830945991103104/t21474842613(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:748/0 lens 488/448 e 0 to 0 dl 1746126998 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126987.850343:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096633800 with x1830945991103104 ext(1048576->1515519) 00010000:00010000:0.0:1746126987.850353:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 22 pid: 12333 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.850367:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 22 pid: 12333 timeout: 982 lvb_type: 0 00002000:00010000:0.0:1746126987.850374:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096633800 00000100:00100000:0.0:1746126987.856663:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.859269:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9323 00000100:00100000:0.0:1746126987.859285:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991103232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126987.859302:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126987.859329:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 22 pid: 12333 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.859393:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 22 pid: 12333 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.859418:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeae00/0x34dc807b6ef6687 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51108 expref: 22 pid: 12333 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746126987.859767:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.859769:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126987.859777:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009914a200/0x34dc807b6ef6791 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51194 expref: 32 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.859786:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009914a200/0x34dc807b6ef6791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51194 expref: 32 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126987.859823:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009914a200/0x34dc807b6ef6791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51194 expref: 32 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126987.859835:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096630380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994040704:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126987.859944:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8dd1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126987.870696:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.904923:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.956813:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.960427:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.960898:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.966190:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.976840:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.978213:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.982353:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.983592:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126987.985476:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.000390:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.000499:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.003972:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.004057:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.004227:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991106560 00000100:00100000:0.0:1746126988.004231:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991106560 00002000:00100000:0.0:1746126988.004260:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1605632->2097151) req@ffff88007ec7b480 x1830945991106560/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:749/0 lens 488/0 e 0 to 0 dl 1746126999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.004268:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7b480 with x1830945991106560 ext(1605632->2097151) 00002000:00010000:0.0:1746126988.004272:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec7b480 00000100:00100000:0.0:1746126988.004286:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7949 00000100:00100000:0.0:1746126988.004291:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991106560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126988.006099:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.009811:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994041984:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126988.009831:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126988.009862:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991106688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4446us (4517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.009872:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9330 00000100:00100000:0.0:1746126988.019634:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.024634:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991107712 00000100:00100000:0.0:1746126988.024641:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991107712 00000100:00100000:0.0:1746126988.024678:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20290 00000100:00100000:0.0:1746126988.024683:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:3573:x1830945991107712:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.024697:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.024712:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099158200/0x34dc807b6ef67de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e511c5 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.024733:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918a400/0x34dc807b6ef67d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511b7 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.024740:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126988.024741:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126988.024745:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158200/0x34dc807b6ef67de lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511c5 expref: 22 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.024770:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009918a400/0x34dc807b6ef67d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511b7 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.024781:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009918a400/0x34dc807b6ef67d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511b7 expref: 32 pid: 9613 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746126988.024793:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994042496:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126988.024841:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8dd1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.026360:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.026393:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.026460:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994042496:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126988.026484:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099158200/0x34dc807b6ef67de lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511c5 expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.026502:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158200, rc 0) 00000100:00100000:0.0:1746126988.026537:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:3573:x1830945991107712:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1854us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.026544:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20290 00000100:00100000:0.0:1746126988.027283:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.034779:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991108224:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 7334us (7494us total) trans 21474842614 rc 0/0 00000100:00100000:0.0:1746126988.034788:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1712 00002000:00100000:0.0:1746126988.034794:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1622016->2097151) req@ffff88007ec79180 x1830945991108224/t21474842614(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:749/0 lens 488/448 e 0 to 0 dl 1746126999 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.034800:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79180 with x1830945991108224 ext(1622016->2097151) 00010000:00010000:0.0:1746126988.034808:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918a400/0x34dc807b6ef67d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511b7 expref: 34 pid: 9613 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746126988.034823:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918a400/0x34dc807b6ef67d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511b7 expref: 34 pid: 9613 timeout: 983 lvb_type: 0 00002000:00010000:0.0:1746126988.034830:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ec79180 00000100:00100000:0.0:1746126988.036893:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.041295:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.054498:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.057781:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.063538:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991109376:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 5423us (5752us total) trans 21474842615 rc 0/0 00000100:00100000:0.0:1746126988.063555:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1713 00002000:00100000:0.0:1746126988.063567:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2527231) req@ffff88007ec7aa00 x1830945991109376/t21474842615(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:749/0 lens 488/448 e 0 to 0 dl 1746126999 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.063576:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7aa00 with x1830945991109376 ext(2097152->2527231) 00010000:00010000:0.0:1746126988.063586:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef67d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511be expref: 35 pid: 9613 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746126988.063603:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef67d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511be expref: 35 pid: 9613 timeout: 983 lvb_type: 0 00002000:00010000:0.0:1746126988.063610:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ec7aa00 00000100:00100000:0.0:1746126988.067630:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.079494:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.100807:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.122078:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.156879:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.159657:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.163415:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.163450:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.163474:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.163498:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.163543:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991110912 00000100:00100000:0.0:1746126988.163551:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991110912 00000100:00100000:0.0:1746126988.163586:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991111040 00000100:00100000:0.0:1746126988.163587:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991111040 00000100:00100000:0.0:1746126988.163605:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991111168 00000100:00100000:0.0:1746126988.163608:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991111168 00000100:00100000:0.0:1746126988.163617:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991111296 00000100:00100000:0.0:1746126988.163618:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991111296 00000100:00100000:0.0:1746126988.163630:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20292 00000100:00100000:0.0:1746126988.163637:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991110912:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.163653:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.163670:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bffa00/0x34dc807b6ef6832 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e511e1 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126988.163721:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994043136:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126988.163801:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8dd1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.163818:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20293 00000100:00100000:0.0:1746126988.163823:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991111040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.163830:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.163839:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bffc00/0x34dc807b6ef6839 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e511e8 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126988.163862:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994043264:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126988.163882:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8dd1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.163896:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20294 00000100:00100000:0.0:1746126988.163901:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991111168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.163906:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.163912:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bfea00/0x34dc807b6ef6840 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e511ef expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.163922:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.163924:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.163932:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bfea00/0x34dc807b6ef6840 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511ef expref: 38 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.163945:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bfea00/0x34dc807b6ef6840 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511ef expref: 38 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.163954:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfea00, rc 0) 00000100:00100000:0.0:1746126988.163976:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991111168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 73us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.163982:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20294 00000100:00100000:0.0:1746126988.163997:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20295 00000100:00100000:0.0:1746126988.164001:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991111296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.164007:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.164012:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bff800/0x34dc807b6ef6847 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e511f6 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.164021:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.164023:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.164027:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff800/0x34dc807b6ef6847 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511f6 expref: 38 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.164035:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bff800/0x34dc807b6ef6847 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511f6 expref: 38 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.164041:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bff800, rc 0) 00000100:00100000:0.0:1746126988.164056:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991111296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 55us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.164064:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20295 00000100:00100000:0.0:1746126988.164268:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126988.164298:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126988.164321:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991111552 00000100:00100000:0.0:1746126988.164325:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991111552 00000100:00100000:0.0:1746126988.164346:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6399 00000100:00100000:0.0:1746126988.164351:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:3578:x1830945991111552:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746126988.164521:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:3578:x1830945991111552:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 170us (253us total) trans 8589937857 rc 0/0 00000100:00100000:0.0:1746126988.164526:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6399 00000100:00100000:0.0:1746126988.172087:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.175115:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.185215:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991111808:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 9755us (10089us total) trans 21474842617 rc 0/0 00000100:00100000:0.0:1746126988.185228:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1714 00002000:00100000:0.0:1746126988.185241:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (8192->1048575) req@ffff8800997dbb80 x1830945991111808/t21474842617(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:749/0 lens 504/448 e 0 to 0 dl 1746126999 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.185249:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dbb80 with x1830945991111808 ext(8192->1048575) 00010000:00010000:0.0:1746126988.185259:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009914a600/0x34dc807b6ef6798 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5119b expref: 25 pid: 12333 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746126988.185275:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009914a600/0x34dc807b6ef6798 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5119b expref: 25 pid: 12333 timeout: 983 lvb_type: 0 00002000:00010000:0.0:1746126988.185282:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800997dbb80 00000100:00100000:0.0:1746126988.187865:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.193344:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.210057:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.213405:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.225455:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991112448:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 11815us (12039us total) trans 17179875381 rc 0/0 00000100:00100000:0.0:1746126988.225469:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1715 00002000:00100000:0.0:1746126988.225481:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1605631) req@ffff880095c02300 x1830945991112448/t17179875381(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:749/0 lens 488/448 e 0 to 0 dl 1746126999 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.225491:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c02300 with x1830945991112448 ext(1048576->1605631) 00010000:00010000:0.0:1746126988.225503:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008bebfc00/0x34dc807b6ef67c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511a9 expref: 28 pid: 9613 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746126988.225520:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008bebfc00/0x34dc807b6ef67c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511a9 expref: 28 pid: 9613 timeout: 983 lvb_type: 0 00002000:00010000:0.0:1746126988.225527:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c02300 00000100:00100000:0.0:1746126988.229359:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.229406:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.236467:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.239060:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991113216 00000100:00100000:0.0:1746126988.239069:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991113216 00002000:00100000:0.0:1746126988.239109:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880095c07800 x1830945991113216/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:749/0 lens 488/0 e 0 to 0 dl 1746126999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.239119:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07800 with x1830945991113216 ext(1048576->2097151) 00002000:00010000:0.0:1746126988.239123:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c07800 00000100:00100000:0.0:1746126988.239182:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7958 00000100:00100000:0.0:1746126988.239190:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991113216:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126988.246262:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.246317:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.246366:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991113728 00000100:00100000:0.0:1746126988.246374:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991113728 00000100:00100000:0.0:1746126988.246416:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991113856 00000100:00100000:0.0:1746126988.246419:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991113856 00000100:00100000:0.0:1746126988.246433:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20298 00000100:00100000:0.0:1746126988.246440:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991113728:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.246459:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.246477:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099159000/0x34dc807b6ef687f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51212 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.246501:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.246504:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.246512:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099159000/0x34dc807b6ef687f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51212 expref: 25 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.246526:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099159000/0x34dc807b6ef687f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51212 expref: 25 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.246536:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159000, rc 0) 00000100:00100000:0.0:1746126988.246582:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991113728:12345-192.168.203.42@tcp:101:cat.0 Request processed in 142us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.246588:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20298 00000100:00100000:0.0:1746126988.246605:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20299 00000100:00100000:0.0:1746126988.246609:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991113856:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.246617:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.246625:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef6886 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51219 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.246636:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.246637:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.246641:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef6886 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51219 expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.246649:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef6886 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51219 expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.246655:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158800, rc 0) 00000100:00100000:0.0:1746126988.246668:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991113856:12345-192.168.203.42@tcp:101:cat.0 Request processed in 59us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.246674:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20299 00000100:00100000:0.0:1746126988.261851:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.271180:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.285230:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.285435:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991114112:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22694us (23588us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126988.285445:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7959 00002000:00100000:0.0:1746126988.285456:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880095c03800 x1830945991114112/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:749/0 lens 488/440 e 0 to 0 dl 1746126999 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.285464:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c03800 with x1830945991114112 ext(0->1048575) 00002000:00010000:0.0:1746126988.285470:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c03800 00000100:00100000:0.0:1746126988.297894:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.334482:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.334531:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.344730:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.349632:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.352235:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.354496:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.357721:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.357763:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.364860:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.365604:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.366965:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991117184 00000100:00100000:0.0:1746126988.366969:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991117184 00000100:00100000:0.0:1746126988.367003:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20304 00000100:00100000:0.0:1746126988.367009:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:3590:x1830945991117184:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126988.367019:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.367030:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef68ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5124a expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.367048:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef673d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51178 expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.367677:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f86a00/0x34dc807b6ef6767 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51186 expref: 29 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.367685:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.367687:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.367691:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef68ef lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1609728->2035711] (req 1609728->2035711) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5124a expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.367710:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f86a00/0x34dc807b6ef6767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51186 expref: 29 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126988.367719:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f86a00/0x34dc807b6ef6767 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51186 expref: 29 pid: 9613 timeout: 983 lvb_type: 1 00000100:00100000:0.0:1746126988.367728:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c42bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994044928:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126988.367773:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef673d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51178 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.367780:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef673d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51178 expref: 45 pid: 12333 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746126988.367787:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994045056:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126988.367802:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.370210:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994044800:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126988.370222:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126988.370241:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991116928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4421us (4637us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.370248:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9341 00000100:00100000:0.0:1746126988.370601:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c42bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994044928:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126988.370608:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c429500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994045056:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126988.370625:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef68ef lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1609728->2035711] (req 1609728->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5124a expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.370636:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867fa00, rc 0) 00000100:00100000:0.0:1746126988.370668:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:3590:x1830945991117184:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3659us (4116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.370674:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20304 00000100:00100000:0.0:1746126988.374430:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.374466:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.374547:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.380429:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.380475:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.380504:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991118464 00000100:00100000:0.0:1746126988.380510:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991118464 00002000:00100000:0.0:1746126988.380540:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1609728->1613823) req@ffff88009c428e00 x1830945991118464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:749/0 lens 488/0 e 0 to 0 dl 1746126999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.380549:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428e00 with x1830945991118464 ext(1609728->1613823) 00002000:00010000:0.0:1746126988.380553:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c428e00 00000100:00100000:0.0:1746126988.380567:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7964 00000100:00100000:0.0:1746126988.380573:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991118464:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126988.380676:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991118464:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 102us (200us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126988.380682:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7964 00002000:00100000:0.0:1746126988.380687:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1609728->1613823) req@ffff88009c428e00 x1830945991118464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:749/0 lens 488/4536 e 0 to 0 dl 1746126999 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.380693:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428e00 with x1830945991118464 ext(1609728->1613823) 00002000:00010000:0.0:1746126988.380696:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c428e00 00000100:00100000:0.0:1746126988.381521:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.381537:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991118720 00000100:00100000:0.0:1746126988.381540:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991118720 00002000:00100000:0.0:1746126988.381556:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff88009c429880 x1830945991118720/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:749/0 lens 488/0 e 0 to 0 dl 1746126999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.381563:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429880 with x1830945991118720 ext(4825088->4829183) 00002000:00010000:0.0:1746126988.381566:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c429880 00000100:00100000:0.0:1746126988.381576:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7965 00000100:00100000:0.0:1746126988.381580:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991118720:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126988.381634:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991118720:12345-192.168.203.42@tcp:3:cat.0 Request processed in 53us (113us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126988.381638:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7965 00002000:00100000:0.0:1746126988.381643:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff88009c429880 x1830945991118720/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:749/0 lens 488/4536 e 0 to 0 dl 1746126999 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.381649:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429880 with x1830945991118720 ext(4825088->4829183) 00002000:00010000:0.0:1746126988.381651:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c429880 00000100:00100000:0.0:1746126988.391025:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.397162:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.431311:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.432814:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.522963:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126988.524731:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746126988.533893:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.537045:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.537096:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.540226:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.540366:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.551381:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.580628:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.584499:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.591302:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.605943:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.606006:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.606686:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.612704:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.613030:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.613362:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.630869:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.630915:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.630957:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991123584 00000100:00100000:0.0:1746126988.630966:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991123584 00000100:00100000:0.0:1746126988.631025:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20311 00000100:00100000:0.0:1746126988.631032:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:3602:x1830945991123584:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.631051:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.631068:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9c00/0x34dc807b6ef6966 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51290 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.631469:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef68ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5124a expref: 27 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.631476:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126988.631477:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126988.631481:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9c00/0x34dc807b6ef6966 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51290 expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.631513:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef68ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2035711) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5124a expref: 27 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.631524:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef68ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2035711) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5124a expref: 27 pid: 9613 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746126988.631536:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994046080:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126988.632257:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.635289:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994046080:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126988.635313:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9c00/0x34dc807b6ef6966 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51290 expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.635327:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9c00, rc 0) 00000100:00100000:0.0:1746126988.635356:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:3602:x1830945991123584:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4325us (4440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.635364:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20311 00000100:00100000:0.0:1746126988.648993:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991124352 00000100:00100000:0.0:1746126988.649004:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991124352 00000100:00100000:0.0:1746126988.649066:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20312 00000100:00100000:0.0:1746126988.649074:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991124352:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.649091:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.649108:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef6982 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51297 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126988.649200:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994046464:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126988.649299:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.653634:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.658229:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.659218:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.676223:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.677643:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.710963:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.786065:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.791761:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.791808:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.791923:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9350 00000100:00100000:0.0:1746126988.791931:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991125888:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126988.791943:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126988.791963:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6ef6920 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5125f expref: 25 pid: 1507 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746126988.791972:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6ef6920 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5125f expref: 25 pid: 1507 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746126988.791992:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6ef6920 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5125f expref: 25 pid: 1507 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746126988.792006:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126988.792023:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991125888:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126988.792030:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9350 00000100:00100000:0.0:1746126988.792110:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9351 00000100:00100000:0.0:1746126988.792117:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099422680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991126016:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126988.792123:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126988.792172:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef68e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5123c expref: 40 pid: 9613 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746126988.792183:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef68e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5123c expref: 40 pid: 9613 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746126988.792196:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef68e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5123c expref: 40 pid: 9613 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746126988.792205:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.792206:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126988.792213:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4200/0x34dc807b6ef6990 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512a5 expref: 39 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126988.792220:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4200/0x34dc807b6ef6990 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512a5 expref: 39 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126988.797025:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.811076:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.812284:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.816309:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.816708:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.817121:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.817421:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991127296 00000100:00100000:0.0:1746126988.817424:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991127296 00000100:00100000:0.0:1746126988.817455:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6406 00000100:00100000:0.0:1746126988.817460:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:3600:x1830945991127296:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746126988.818283:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:3600:x1830945991127296:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 819us (1159us total) trans 8589937871 rc 0/0 00000100:00100000:0.0:1746126988.818290:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6406 00000100:00100000:0.0:1746126988.819853:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.824327:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.827057:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.827093:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.837467:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.879667:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.884476:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.891179:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.891221:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.891355:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20319 00000100:00100000:0.0:1746126988.891362:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991128960:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.891370:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.891380:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef69d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e512cf expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126988.891410:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994048384:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126988.891565:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.901683:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.901721:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.901863:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.902076:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991129600 00000100:00100000:0.0:1746126988.902079:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991129600 00002000:00100000:0.0:1746126988.902094:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (0->978943) req@ffff880094e6d880 x1830945991129600/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:749/0 lens 488/0 e 0 to 0 dl 1746126999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.902099:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d880 with x1830945991129600 ext(0->978943) 00002000:00010000:0.0:1746126988.902101:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6d880 00000100:00100000:0.0:1746126988.902839:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7981 00000100:00100000:0.0:1746126988.902845:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991129600:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126988.928102:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.928226:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.928665:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20321 00000100:00100000:0.0:1746126988.928672:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991129984:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126988.928680:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126988.928689:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01c00/0x34dc807b6ef69e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e512dd expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126988.928711:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994048640:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126988.928737:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126988.939025:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.941183:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.941484:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.944773:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.944874:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.946494:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.950697:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.950717:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.950742:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.955996:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.956772:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.957449:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.962398:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.968254:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.971422:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.971456:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.974083:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.977169:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.982365:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2027:x1830945991133056:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9585us (9785us total) trans 17179875384 rc 0/0 00000100:00100000:0.0:1746126988.982377:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1722 00002000:00100000:0.0:1746126988.982386:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff880123477800 x1830945991133056/t17179875384(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:749/0 lens 504/448 e 0 to 0 dl 1746126999 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126988.982396:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477800 with x1830945991133056 ext(3145728->4194303) 00010000:00010000:0.0:1746126988.982404:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef6997 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512ac expref: 49 pid: 1507 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126988.982417:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef6997 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3788799) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512ac expref: 49 pid: 1507 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746126988.982423:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880123477800 00000001:00080000:0.0:1746126988.984387:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875384 is committed 00000001:00080000:0.0:1746126988.984396:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875383 is committed 00000001:00080000:0.0:1746126988.984419:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875378 is committed 00000001:00080000:0.0:1746126988.984505:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875315 is committed 00000100:00100000:0.0:1746126988.990622:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126988.990668:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.002400:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126989.002909:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126989.011257:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.020311:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.020400:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.029826:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.029864:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.029905:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.047544:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.048319:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.049568:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20332 00000100:00100000:0.0:1746126989.049576:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991136000:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126989.049584:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.049592:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967bf400/0x34dc807b6ef6a77 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51338 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.049606:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.049608:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.049614:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967bf400/0x34dc807b6ef6a77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51338 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.049626:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967bf400/0x34dc807b6ef6a77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51338 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.049638:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967bf400, rc 0) 00000100:00100000:0.0:1746126989.049677:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991136000:12345-192.168.203.42@tcp:101:cat.0 Request processed in 102us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.049683:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20332 00000100:00100000:0.0:1746126989.050528:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.050642:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.053247:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.058713:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.064196:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.064780:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.083599:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.094611:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.096989:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.097013:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991138304 00000100:00100000:0.0:1746126989.097018:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991138304 00000100:00100000:0.0:1746126989.097050:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16999 00000100:00100000:0.0:1746126989.097054:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:3624:x1830945991138304:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126989.097070:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.097082:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561800/0x34dc807b6ef6ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5135b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.097170:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097180:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097192:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097202:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097207:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097212:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097289:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560e00/0x34dc807b6ef6acb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097298:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560e00/0x34dc807b6ef6acb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097304:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560e00/0x34dc807b6ef6acb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:0.0:1746126989.097311:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746126989.097367:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097373:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097377:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097382:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097393:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f560c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126989.097397:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097401:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097410:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126989.097412:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126989.097415:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097420:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560c00/0x34dc807b6ef6abd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097444:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097448:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097453:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097456:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f561600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126989.097459:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097463:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097469:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f200) 00010000:00010000:0.0:1746126989.097471:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126989.097473:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097480:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6ef6ac4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.097511:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561800/0x34dc807b6ef6ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5135b expref: 49 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.097520:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560e00/0x34dc807b6ef6acb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5135b expref: 48 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.097526:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.097528:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126989.097530:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f560e00, rc 0) 00000100:00100000:0.0:1746126989.097550:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:3624:x1830945991138304:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 496us (565us total) trans 8589937880 rc 0/0 00000100:00100000:0.0:1746126989.097556:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16999 00000100:00100000:0.0:1746126989.100903:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.100938:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.100982:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.101192:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 989 00000100:00100000:0.0:1746126989.101198:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2028:x1830945991138688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.101205:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.101223:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560e00/0x34dc807b6ef6acb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5135b expref: 48 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.101233:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.101237:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.101266:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2028:x1830945991138688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 68us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.101272:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 989 00000100:00100000:0.0:1746126989.103596:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.108390:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.146885:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.146975:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.158455:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.162819:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.176412:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991140480 00000100:00100000:0.0:1746126989.176423:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991140480 00000100:00100000:0.0:1746126989.176516:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17000 00000100:00100000:0.0:1746126989.176523:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:3628:x1830945991140480:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.176598:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.176617:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561200/0x34dc807b6ef6ae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51369 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.176676:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6ae7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176687:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176698:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176708:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561a00/0x34dc807b6ef6aee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176712:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561a00/0x34dc807b6ef6aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176720:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561a00/0x34dc807b6ef6aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176782:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef6af5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176790:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6ef6974 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51289 expref: 30 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.176796:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef6af5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.176824:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6ef6974 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51289 expref: 30 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.176836:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6ef6974 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51289 expref: 30 pid: 7260 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.176848:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994051456:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.176944:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.181525:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.186563:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.191364:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.191660:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.191746:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.191776:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.191790:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.191819:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.191840:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991140992 00000100:00100000:0.0:1746126989.191848:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991140992 00000100:00100000:0.0:1746126989.191884:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991141120 00000100:00100000:0.0:1746126989.191886:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991141120 00000100:00100000:0.0:1746126989.191905:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991141376 00000100:00100000:0.0:1746126989.191906:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991141376 00000100:00100000:0.0:1746126989.191914:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991141248 00000100:00100000:0.0:1746126989.191916:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991141248 00000100:00100000:0.0:1746126989.191926:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991141632 00000100:00100000:0.0:1746126989.191928:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991141632 00000100:00100000:0.0:1746126989.191935:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991141504 00000100:00100000:0.0:1746126989.191937:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991141504 00000100:00100000:0.0:1746126989.191946:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20337 00000100:00100000:0.0:1746126989.191953:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991140992:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.191971:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.191988:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef6afc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51370 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.192011:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192013:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192023:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef6afc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51370 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192037:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef6afc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51370 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192049:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad800, rc 0) 00000100:00100000:0.0:1746126989.192092:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991140992:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 139us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.192098:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20337 00000100:00100000:0.0:1746126989.192113:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20338 00000100:00100000:0.0:1746126989.192118:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991141120:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.192125:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.192184:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef6b03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51377 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.192196:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192197:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192202:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef6b03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51377 expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192211:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef6b03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51377 expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192218:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dadc00, rc 0) 00000100:00100000:0.0:1746126989.192234:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991141120:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 115us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.192239:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20338 00000100:00100000:0.0:1746126989.192249:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20339 00000100:00100000:0.0:1746126989.192253:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991141376:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.192258:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.192271:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef6b0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51385 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.192281:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192282:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192286:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef6b0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51385 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192299:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef6b0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51385 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192306:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad000, rc 0) 00000100:00100000:0.0:1746126989.192319:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991141376:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 66us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.192324:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20339 00000100:00100000:0.0:1746126989.192333:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20340 00000100:00100000:0.0:1746126989.192337:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991141248:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.192342:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.192348:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef6b11 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5137e expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.192389:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994051584:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126989.192446:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.192467:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20341 00000100:00100000:0.0:1746126989.192473:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991141632:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.192478:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.192485:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009caeae00/0x34dc807b6ef6b18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51393 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.192507:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994051712:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126989.192526:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.192541:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20342 00000100:00100000:0.0:1746126989.192546:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991141504:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.192552:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.192557:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5138c expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.192567:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192568:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.192572:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192581:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.192588:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caea200, rc 0) 00000100:00100000:0.0:1746126989.192602:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991141504:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 56us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.192607:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20342 00000100:00080000:0.0:1746126989.192746:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126989.201344:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991141888 00000100:00100000:0.0:1746126989.201354:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991141888 00000100:00100000:0.0:1746126989.201408:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17001 00000100:00100000:0.0:1746126989.201415:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:3628:x1830945991141888:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.201434:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.201450:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561a00/0x34dc807b6ef6b26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5139a expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.201543:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6b2d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.201557:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef6af5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51369 expref: 10 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.201564:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6b2d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.201592:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef6af5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51369 expref: 10 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.201602:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef6af5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51369 expref: 10 pid: 7260 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.201613:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994051840:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.201692:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.204980:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.207367:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.213337:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991142272 00000100:00100000:0.0:1746126989.213343:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991142272 00010000:00010000:0.0:1746126989.213374:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6b2d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5139a expref: 12 pid: 7260 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.213406:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9370 00000100:00100000:0.0:1746126989.213412:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991142272:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.213424:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.213429:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6b2d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5139a expref: 12 pid: 7260 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.213438:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6b2d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5139a expref: 12 pid: 7260 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.213461:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef6b2d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5139a expref: 12 pid: 7260 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.213477:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.213481:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5c00/0x34dc807b6ef6b42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.213491:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5c00/0x34dc807b6ef6b42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.213498:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5c00/0x34dc807b6ef6b42 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126989.213517:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.213567:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991142272:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 153us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.213572:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9370 00000100:00100000:0.0:1746126989.218529:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.218586:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.219185:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20344 00000100:00100000:0.0:1746126989.219191:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991142528:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.219197:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.219207:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f560600/0x34dc807b6ef6b50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e513af expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.219235:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cbb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994052096:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126989.219316:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.229113:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.236377:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.236419:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.236449:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.236463:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.236488:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.236516:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.236549:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991142912 00000100:00100000:0.0:1746126989.236552:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991142912 00000100:00100000:0.0:1746126989.236572:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991143424 00000100:00100000:0.0:1746126989.236573:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991143424 00000100:00100000:0.0:1746126989.236773:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20346 00000100:00100000:0.0:1746126989.236780:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991143552:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126989.236801:0:3148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f560e00/0x34dc807b6ef6b73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.236814:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a4400/0x34dc807b6ef6aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51354 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.236821:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126989.236823:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126989.236826:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f560e00/0x34dc807b6ef6b73 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.236859:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a4400/0x34dc807b6ef6aaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2760703) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51354 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.236872:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944a4400/0x34dc807b6ef6aaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2760703) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51354 expref: 8 pid: 16295 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.236893:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cbb1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994052352:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.236973:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.236994:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20348 00000100:00100000:0.0:1746126989.236999:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991143168:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126989.237016:0:3542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef6b81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237026:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef6ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51362 expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237031:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126989.237032:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126989.237034:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef6b81 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237049:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef6ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2076671) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51362 expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237057:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef6ad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2076671) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51362 expref: 26 pid: 16295 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.237065:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cbb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994052736:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.237085:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.237103:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20349 00000100:00100000:0.0:1746126989.237109:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991143424:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126989.237127:0:12340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237178:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef6a69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5132a expref: 26 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237186:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 17 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.237193:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef6a7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5133f expref: 42 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.237199:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.237200:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.237202:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237219:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef6a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5133f expref: 42 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.237227:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef6a7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5133f expref: 42 pid: 9613 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.237236:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994052992:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126989.237268:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 17 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.237281:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 17 pid: 1964 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.237288:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994053248:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126989.237313:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef6a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5132a expref: 26 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.237322:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef6a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5132a expref: 26 pid: 9612 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.237330:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994053504:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.237345:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.241811:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994052992:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.241859:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994053248:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.241916:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994053120:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.241925:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994053376:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.250117:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.251977:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.252024:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.252176:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991144960 00000100:00100000:0.0:1746126989.252179:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991144960 00010000:00010000:0.0:1746126989.252196:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef6b0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51385 expref: 18 pid: 11152 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.252219:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9372 00000100:00100000:0.0:1746126989.252224:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991145088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.252231:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.252241:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099158200/0x34dc807b6ef67de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511c5 expref: 27 pid: 16295 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.252249:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099158200/0x34dc807b6ef67de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511c5 expref: 27 pid: 16295 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.252269:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099158200/0x34dc807b6ef67de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511c5 expref: 27 pid: 16295 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.252287:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.252338:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991145088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 112us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.252345:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9372 00000100:00100000:0.0:1746126989.252359:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9373 00000100:00100000:0.0:1746126989.252363:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2028:x1830945991144960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.252377:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.252383:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef6b0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51385 expref: 18 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.252395:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef6b0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51385 expref: 18 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.252416:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef6b0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51385 expref: 18 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.252424:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.252443:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2028:x1830945991144960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 79us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.252448:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9373 00000100:00100000:0.0:1746126989.259218:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.259257:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.259276:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.259289:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.259313:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.259339:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991143808 00000100:00100000:0.0:1746126989.259347:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991143808 00010000:00010000:0.0:1746126989.259380:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef6a70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51331 expref: 26 pid: 9613 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.259404:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991144192 00000100:00100000:0.0:1746126989.259406:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991144192 00010000:00010000:0.0:1746126989.259414:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef6a7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5133f expref: 42 pid: 9613 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.259424:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9374 00000100:00100000:0.0:1746126989.259430:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991143808:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.259443:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.259461:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef6a70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51331 expref: 26 pid: 9613 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259473:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef6a70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51331 expref: 26 pid: 9613 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259493:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef6a70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51331 expref: 26 pid: 9613 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259518:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.259554:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991143808:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 124us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.259560:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9374 00000100:00100000:0.0:1746126989.259570:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991143936 00000100:00100000:0.0:1746126989.259572:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991143936 00010000:00010000:0.0:1746126989.259579:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef6afc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51370 expref: 17 pid: 11152 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.259586:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991144320 00000100:00100000:0.0:1746126989.259588:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991144320 00010000:00010000:0.0:1746126989.259596:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967bf400/0x34dc807b6ef6a77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51338 expref: 9 pid: 16295 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.259604:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9375 00000100:00100000:0.0:1746126989.259608:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991144192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.259613:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.259619:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef6a7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5133f expref: 42 pid: 9613 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259631:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef6a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5133f expref: 42 pid: 9613 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259641:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef6a7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5133f expref: 42 pid: 9613 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259646:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.259656:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991144192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 48us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.259661:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9375 00000100:00100000:0.0:1746126989.259667:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9376 00000100:00100000:0.0:1746126989.259670:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991143936:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.259675:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.259679:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef6afc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51370 expref: 17 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259686:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef6afc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51370 expref: 17 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259695:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef6afc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51370 expref: 17 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259700:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.259702:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.259707:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.259715:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.259733:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.259743:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991143936:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.259747:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9376 00000100:00100000:0.0:1746126989.259752:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9377 00000100:00100000:0.0:1746126989.259756:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991144320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.259761:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.259771:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967bf400/0x34dc807b6ef6a77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51338 expref: 9 pid: 16295 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259778:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967bf400/0x34dc807b6ef6a77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51338 expref: 9 pid: 16295 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259790:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967bf400/0x34dc807b6ef6a77 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51338 expref: 9 pid: 16295 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259799:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.259811:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991144320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 54us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.259816:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9377 00000100:00100000:0.0:1746126989.259847:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.259860:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991144448 00000100:00100000:0.0:1746126989.259863:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991144448 00010000:00010000:0.0:1746126989.259871:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 16 pid: 1964 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.259884:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9378 00000100:00100000:0.0:1746126989.259888:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991144448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.259893:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.259900:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 16 pid: 1964 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259907:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 16 pid: 1964 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259917:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caea200/0x34dc807b6ef6b1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5138c expref: 16 pid: 1964 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.259944:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.259957:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991144448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 68us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.259963:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9378 00000100:00100000:0.0:1746126989.260003:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.260011:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991144576 00000100:00100000:0.0:1746126989.260014:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991144576 00010000:00010000:0.0:1746126989.260027:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef6b03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51377 expref: 11 pid: 11152 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.260038:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9379 00000100:00100000:0.0:1746126989.260042:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012225c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991144576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.260047:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.260052:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef6b03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51377 expref: 11 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.260059:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef6b03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51377 expref: 11 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.260068:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef6b03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51377 expref: 11 pid: 11152 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.260074:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.260084:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012225c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991144576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 42us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.260088:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9379 00000100:00100000:0.0:1746126989.260113:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.260159:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.260167:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991144704 00000100:00100000:0.0:1746126989.260169:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991144704 00010000:00010000:0.0:1746126989.260177:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bfea00/0x34dc807b6ef6840 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511ef expref: 41 pid: 1964 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.260187:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9380 00000100:00100000:0.0:1746126989.260191:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991144704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.260196:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.260202:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bfea00/0x34dc807b6ef6840 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511ef expref: 41 pid: 1964 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.260213:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bfea00/0x34dc807b6ef6840 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511ef expref: 41 pid: 1964 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.260222:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bfea00/0x34dc807b6ef6840 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e511ef expref: 41 pid: 1964 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746126989.260228:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.260229:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.260232:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260238:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260248:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.260257:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991144704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 66us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.260261:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9380 00000100:00100000:0.0:1746126989.260296:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.260303:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991145344 00000100:00100000:0.0:1746126989.260305:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991145344 00010000:00010000:0.0:1746126989.260311:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef6a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5132a expref: 25 pid: 9612 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.260320:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9381 00000100:00100000:0.0:1746126989.260324:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991145344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.260330:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.260335:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef6a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5132a expref: 25 pid: 9612 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260341:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef6a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5132a expref: 25 pid: 9612 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260349:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef6a69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5132a expref: 25 pid: 9612 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260355:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.260356:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.260359:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260364:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260374:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.260383:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991145344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 58us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.260386:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9381 00000100:00100000:0.0:1746126989.260421:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.260428:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991145216 00000100:00100000:0.0:1746126989.260431:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991145216 00010000:00010000:0.0:1746126989.260439:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012158c800/0x34dc807b6ef6a62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51323 expref: 27 pid: 9612 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.260455:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9382 00000100:00100000:0.0:1746126989.260459:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991145216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.260463:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.260469:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012158c800/0x34dc807b6ef6a62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51323 expref: 27 pid: 9612 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260476:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012158c800/0x34dc807b6ef6a62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51323 expref: 27 pid: 9612 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260487:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012158c800/0x34dc807b6ef6a62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51323 expref: 27 pid: 9612 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260495:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.260496:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.260499:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260505:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260516:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.260528:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991145216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 69us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.260533:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9382 00010000:00010000:0.0:1746126989.260613:0:12340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260626:0:12340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260639:0:12340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260645:0:12340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260652:0:12340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260657:0:12340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f560a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126989.260661:0:12340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260667:0:12340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260677:0:12340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260683:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef6b88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.260724:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991143424:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 23615us (24207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.260731:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20349 00010000:00010000:0.0:1746126989.260783:0:1507:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260790:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260802:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260807:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260813:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260819:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096658000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126989.260821:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260827:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260835:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.260841:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096658000/0x34dc807b6ef6b8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.260877:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991143040:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 23701us (24512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.260881:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20350 00000100:00100000:0.0:1746126989.260901:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991143680 00000100:00100000:0.0:1746126989.260904:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991143680 00002000:00100000:0.0:1746126989.260930:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2314240->2760703) req@ffff88009ab0f800 x1830945991143680/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:750/0 lens 488/0 e 0 to 0 dl 1746127000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126989.260939:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0f800 with x1830945991143680 ext(2314240->2760703) 00010000:00010000:0.0:1746126989.260945:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800944a4400/0x34dc807b6ef6aaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51354 expref: 8 pid: 16295 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260954:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800944a4400/0x34dc807b6ef6aaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2314240->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51354 expref: 8 pid: 16295 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746126989.260959:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ab0f800 00000100:00100000:0.0:1746126989.260969:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991144064 00000100:00100000:0.0:1746126989.260971:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991144064 00002000:00100000:0.0:1746126989.260978:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1503232->2076671) req@ffff880099426d80 x1830945991144064/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:750/0 lens 488/0 e 0 to 0 dl 1746127000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126989.260984:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099426d80 with x1830945991144064 ext(1503232->2076671) 00010000:00010000:0.0:1746126989.260988:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef6ad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51362 expref: 26 pid: 16295 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.260994:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef6ad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51362 expref: 26 pid: 16295 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746126989.261003:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099426d80 00000100:00100000:0.0:1746126989.261012:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1725 00000100:00100000:0.0:1746126989.261016:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991143680:12345-192.168.203.42@tcp:4:multiop.0 00010000:00010000:0.0:1746126989.261204:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261211:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261222:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261227:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261232:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261237:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800967e4000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126989.261239:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261243:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261254:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261259:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6ef6b6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.261285:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991143296:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 24689us (24865us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.261290:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20345 00000100:00100000:0.0:1746126989.261310:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1726 00000100:00100000:0.0:1746126989.261315:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991144064:12345-192.168.203.42@tcp:4:multiop.0 00010000:00010000:0.0:1746126989.261423:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261430:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261442:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261447:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261452:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261461:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a46600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126989.261463:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261468:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261475:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.261480:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a46600/0x34dc807b6ef6b7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.261509:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991142912:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 24599us (25044us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.261513:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20347 00000100:00100000:0.0:1746126989.286779:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.286836:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.301730:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.303245:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.303258:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991145984 00000100:00100000:0.0:1746126989.303262:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991145984 00010000:00010000:0.0:1746126989.304069:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2800/0x34dc807b6ef6664 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e510e5 expref: 47 pid: 11634 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.304086:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991146496 00000100:00100000:0.0:1746126989.304090:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991146496 00010000:00010000:0.0:1746126989.304101:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e88f400/0x34dc807b6ef6a07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512e4 expref: 48 pid: 7260 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.304115:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9389 00000100:00100000:0.0:1746126989.304120:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991146496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.304155:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.304160:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e88f400/0x34dc807b6ef6a07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512e4 expref: 48 pid: 7260 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.304167:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e88f400/0x34dc807b6ef6a07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512e4 expref: 48 pid: 7260 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.305006:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e88f400/0x34dc807b6ef6a07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e512e4 expref: 48 pid: 7260 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.305032:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.305036:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561800/0x34dc807b6ef6b96 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.305042:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.305071:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991146496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 949us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.305077:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9389 00000001:00080000:0.0:1746126989.311473:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937885 is committed 00000004:00080000:0.0:1746126989.311486:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1253 committed 00000004:00080000:0.0:1746126989.311596:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1219 committed 00000004:00080000:0.0:1746126989.312300:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1218 committed 00000004:00080000:0.0:1746126989.312304:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1217 committed 00000004:00080000:0.0:1746126989.312307:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1216 committed 00000004:00080000:0.0:1746126989.312309:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1252 committed 00000004:00080000:0.0:1746126989.312311:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1215 committed 00000004:00080000:0.0:1746126989.312312:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1251 committed 00000004:00080000:0.0:1746126989.312314:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1214 committed 00000004:00080000:0.0:1746126989.312315:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1250 committed 00000004:00080000:0.0:1746126989.312317:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1249 committed 00000004:00080000:0.0:1746126989.312318:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1248 committed 00000004:00080000:0.0:1746126989.312319:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1213 committed 00000004:00080000:0.0:1746126989.312321:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1212 committed 00000004:00080000:0.0:1746126989.312323:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1247 committed 00000004:00080000:0.0:1746126989.312324:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1246 committed 00000004:00080000:0.0:1746126989.312330:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1211 committed 00000001:00080000:0.0:1746126989.312343:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937882 is committed 00000001:00080000:0.0:1746126989.312349:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937881 is committed 00000100:00100000:0.0:1746126989.312434:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994056448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.312486:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994056576:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1746126989.312543:0:7258:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a1789c00 reply state ffff88007d74bc00 transno 8589937885 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561800/0x34dc807b6ef6b96 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.312562:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561800/0x34dc807b6ef6b96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.312571:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.312573:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746126989.312578:0:7258:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746126989.313604:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126989.314342:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994056960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.314373:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126989.314400:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994057472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126989.314425:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126989.314457:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994057984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126989.314474:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126989.314496:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d28b100/2, rc 0, transno 17179875390 00000100:00100000:0.0:1746126989.314500:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994056448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.314550:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994057216 00000100:00100000:0.0:1746126989.314555:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994057216 00000100:00100000:0.0:1746126989.314578:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994058240 00000100:00100000:0.0:1746126989.314581:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994058240 00000100:00100000:0.0:1746126989.314592:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20359 00000100:00100000:0.0:1746126989.314598:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+82:3785:x1830945994057728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126989.314711:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+84:3785:x1830945994057728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (168us total) trans 21474842624 rc 0/0 00000100:00100000:0.0:1746126989.314717:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20359 00000100:00100000:0.0:1746126989.314738:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126989.314758:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994057088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.314777:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126989.314820:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880123476680/2, rc 0, transno 21474842623 00000100:00100000:0.0:1746126989.314835:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994057472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126989.314846:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c01880/2, rc 0, transno 21474842627 00000100:00100000:0.0:1746126989.314850:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994057984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126989.314858:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099427800/2, rc 0, transno 17179875391 00000100:00100000:0.0:1746126989.314861:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994056960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.314870:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994058496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126989.314893:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126989.314927:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099427100/2, rc 0, transno 17179875394 00000100:00100000:0.0:1746126989.314931:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994056576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126989.314939:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e6fb80/2, rc 0, transno 17179875395 00000100:00100000:0.0:1746126989.314941:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994057088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126989.314992:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c03480/2, rc 0, transno 21474842630 00000100:00100000:0.0:1746126989.314996:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994058496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126989.316496:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.321764:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.321801:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.322400:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.322532:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.322548:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991147136 00000100:00100000:0.0:1746126989.322550:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991147136 00000100:00100000:0.0:1746126989.322565:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991147008 00000100:00100000:0.0:1746126989.322567:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991147008 00000100:00100000:0.0:1746126989.322588:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20369 00000100:00100000:0.0:1746126989.322593:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991147136:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.322604:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.322622:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f120800/0x34dc807b6ef6bb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e513d9 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126989.322644:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c88b, atime: 0x6813c88b, ctime: 0x6813c88b, blocks: 0x808 00010000:00010000:0.0:1746126989.322662:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.322664:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.322672:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120800/0x34dc807b6ef6bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513d9 expref: 9 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.322687:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f120800/0x34dc807b6ef6bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513d9 expref: 9 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.322697:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f120800, rc 0) 00000100:00100000:0.0:1746126989.322735:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991147136:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 142us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.322744:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20369 00000100:00100000:0.0:1746126989.322796:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.322821:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.322850:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20373 00000100:00100000:0.0:1746126989.322855:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991147520:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126989.322862:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.322868:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f120200/0x34dc807b6ef6bd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e513ee expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126989.322878:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c88b, atime: 0x6813c88b, ctime: 0x6813c88b, blocks: 0x1008 00010000:00010000:0.0:1746126989.322885:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.322886:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.322889:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120200/0x34dc807b6ef6bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513ee expref: 10 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.322897:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f120200/0x34dc807b6ef6bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513ee expref: 10 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.322903:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f120200, rc 0) 00000100:00100000:0.0:1746126989.322917:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991147520:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 62us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.322921:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20373 00000100:00100000:0.0:1746126989.329535:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991147648 00000100:00100000:0.0:1746126989.329541:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991147648 00000100:00100000:0.0:1746126989.329579:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20375 00000100:00100000:0.0:1746126989.329585:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991148032:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746126989.329640:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991148032:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 55us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.329649:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20375 00000100:00100000:0.0:1746126989.329666:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20377 00000100:00100000:0.0:1746126989.329670:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991147904:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746126989.329703:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991147904:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 32us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.329708:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20377 00000100:00100000:0.0:1746126989.332299:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.332325:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.332349:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.332374:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.332387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.332476:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.334953:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.339790:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.345057:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.345094:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.345175:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.345705:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.345719:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991150336 00000100:00100000:0.0:1746126989.345722:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991150336 00000100:00100000:0.0:1746126989.345744:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8001 00000100:00100000:0.0:1746126989.345749:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991150336:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746126989.345764:0:29586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007f120000/0x34dc807b6ef6bf1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.345771:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.345773:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.345775:0:29586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f120000/0x34dc807b6ef6bf1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.345783:0:29586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f120000/0x34dc807b6ef6bf1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.346627:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.346642:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991150592 00000100:00100000:0.0:1746126989.346645:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991150592 00000100:00100000:0.0:1746126989.346682:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8002 00000100:00100000:0.0:1746126989.346687:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+20:2027:x1830945991150592:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746126989.346704:0:29584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007f121600/0x34dc807b6ef6bf8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.346712:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.346714:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.346716:0:29584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121600/0x34dc807b6ef6bf8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.346729:0:29584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f121600/0x34dc807b6ef6bf8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.349503:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.350088:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.350157:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.351297:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8004 00000100:00100000:0.0:1746126989.351308:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991151360:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746126989.351339:0:29585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.351350:0:29585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.351351:0:29585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.351355:0:29585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.351365:0:29585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.353752:0:9616:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880077c34800/0x34dc807b6ef6be3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.353767:0:9616:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880077c34800/0x34dc807b6ef6be3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.353776:0:9616:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880077c34800/0x34dc807b6ef6be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.353787:0:9616:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c34800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126989.353792:0:9616:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880077c34800/0x34dc807b6ef6be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.353799:0:9616:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880077c34800/0x34dc807b6ef6be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.353814:0:9616:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880077c34800/0x34dc807b6ef6be3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.353820:0:9616:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c34800/0x34dc807b6ef6be3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.354342:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+22:2027:x1830945991149824:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 8936us (9241us total) trans 0 rc 1040384/1040384 00000100:00100000:0.0:1746126989.354352:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7999 00010000:00010000:0.0:1746126989.372046:0:29585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.372063:0:29585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.372072:0:29585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.372078:0:29585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f121e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126989.372082:0:29585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.372091:0:29585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.372109:0:29585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.372116:0:29585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f121e00/0x34dc807b6ef6c06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.372216:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991151360:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 20906us (22082us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126989.372226:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8004 00000100:00100000:0.0:1746126989.374291:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994058880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746126989.374339:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126989.375958:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994058880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746126989.382209:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.383970:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.386174:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.387480:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.389307:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.390529:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.391983:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.393707:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.395330:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.397512:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.399917:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126989.400282:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96c00/0x34dc807b6ef6c37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51411 expref: 16 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.400296:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ece4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994060160:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126989.400361:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099bec840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.402003:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.404696:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.407725:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.408222:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.408295:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.408329:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.408716:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.408737:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.408957:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20399 00000100:00100000:0.0:1746126989.408965:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991153792:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746126989.409013:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746126989.409015:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.409016:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.409017:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746126987 -> 1746126988 00002000:00010000:0.0:1746126989.409019:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746126989.409034:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2026:x1830945991153792:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 71us (297us total) trans 21474842634 rc 0/0 00000100:00100000:0.0:1746126989.409038:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20399 00000100:00100000:0.0:1746126989.409242:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991153408:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746126989.409281:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126989.409282:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.409283:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.409284:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746126987 -> 1746126988 00002000:00010000:0.0:1746126989.409285:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126989.409306:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991153408:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 1010us (1085us total) trans 17179875399 rc 0/0 00000100:00100000:0.0:1746126989.409309:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20395 00000100:00100000:0.0:1746126989.412099:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.415870:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126989.416051:0:24187:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03e00/0x34dc807b6ef6c45 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746126989.416058:0:24187:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03e00/0x34dc807b6ef6c45 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24187 initiator: MDT0 00000040:00080000:0.0:1746126989.416524:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1244, 88 off117064 00000004:00080000:0.0:1746126989.416529:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458399328ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416557:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1279, 88 off120232 00000004:00080000:0.0:1746126989.416560:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458430813ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.416576:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1280, 88 off120320 00000004:00080000:0.0:1746126989.416579:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458449670ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.416587:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1245, 88 off117152 00000004:00080000:0.0:1746126989.416589:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458460096ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416598:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1246, 88 off117240 00000004:00080000:0.0:1746126989.416600:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458471108ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416624:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1281, 88 off120408 00000004:00080000:0.0:1746126989.416628:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458498165ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.416636:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1282, 88 off120496 00000004:00080000:0.0:1746126989.416639:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458509231ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.416646:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1283, 88 off120584 00000004:00080000:0.0:1746126989.416649:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458519528ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.416657:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1247, 88 off117328 00000004:00080000:0.0:1746126989.416659:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458529961ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416671:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1284, 88 off120672 00000004:00080000:0.0:1746126989.416673:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458543921ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.416682:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1248, 88 off117416 00000004:00080000:0.0:1746126989.416684:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458554681ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416692:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1285, 88 off120760 00000004:00080000:0.0:1746126989.416694:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458565089ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.416702:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1249, 88 off117504 00000004:00080000:0.0:1746126989.416704:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458575151ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416712:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1250, 88 off117592 00000004:00080000:0.0:1746126989.416715:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458585275ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416722:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1251, 88 off117680 00000004:00080000:0.0:1746126989.416725:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458595903ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416733:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1252, 88 off117768 00000004:00080000:0.0:1746126989.416736:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884458606233ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.416743:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1286, 88 off120848 00000004:00080000:0.0:1746126989.416746:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884458616540ns, next at 847916249980ns, rc = 0 00010000:00010000:0.0:1746126989.419009:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6ef6c14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.419018:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6ef6c14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.419028:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6ef6c14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.419034:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7d28a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126989.419038:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6ef6c14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.419044:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6ef6c14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.419058:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.419060:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126989.419063:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6ef6c14 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.419067:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6ef6c14 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00000004:00010000:0.0:1746126989.419110:0:24187:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a8c39450 reply state ffff88009d166c00 transno 8589937887 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03e00/0x34dc807b6ef6c45 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746126989.419120:0:24187:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03e00/0x34dc807b6ef6c45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746126989.419126:0:24187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.419158:0:24187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746126989.419162:0:24187:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746126989.419167:0:24187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.419169:0:24187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126989.419175:0:24187:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef6b5e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513b6 expref: 7 pid: 7260 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746126989.419769:0:24187:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746126989.419780:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8c39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:3628:x1830945991154176:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 7404us (7689us total) trans 8589937887 rc 0/0 00000100:00100000:0.0:1746126989.419787:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6413 00000100:00100000:0.0:1746126989.419822:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20411 00000100:00100000:0.0:1746126989.419827:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994060800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126989.419866:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126989.419868:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.419870:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.419871:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126988 -> 1746126988 00002000:00010000:0.0:1746126989.419873:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746126989.419892:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994060800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (577us total) trans 17179875404 rc 0/0 00000100:00100000:0.0:1746126989.419896:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20411 00000004:00080000:0.0:1746126989.419923:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099197b80/2, rc 0, transno 17179875404 00000100:00100000:0.0:1746126989.419927:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994060800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.419937:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20412 00000100:00100000:0.0:1746126989.419940:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994061312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126989.419971:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126989.419972:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.419974:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126989.419976:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746126988 -> 1746126988 00002000:00010000:0.0:1746126989.419977:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746126989.419995:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994061312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (654us total) trans 17179875405 rc 0/0 00000100:00100000:0.0:1746126989.420000:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20412 00000004:00080000:0.0:1746126989.420016:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099197100/2, rc 0, transno 17179875405 00000100:00100000:0.0:1746126989.420019:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994061312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.420029:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20413 00000100:00100000:0.0:1746126989.420033:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994061824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.420081:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994061824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (723us total) trans 17179875406 rc 0/0 00000100:00100000:0.0:1746126989.420086:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20413 00000004:00080000:0.0:1746126989.420103:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099195500/2, rc 0, transno 17179875406 00000100:00100000:0.0:1746126989.420106:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994061824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.420115:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20414 00000100:00100000:0.0:1746126989.420119:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994062336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.420198:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994062336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (822us total) trans 17179875407 rc 0/0 00000100:00100000:0.0:1746126989.420204:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20414 00000004:00080000:0.0:1746126989.420219:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a7a680/2, rc 0, transno 17179875407 00000100:00100000:0.0:1746126989.420222:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994062336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.421915:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.424415:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.445614:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.449229:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.450205:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.450258:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.451675:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.451710:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.455012:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.461678:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.461767:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.484989:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.491568:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.491639:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.491673:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991157504 00000100:00100000:0.0:1746126989.491679:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991157504 00010000:00010000:0.0:1746126989.491708:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6ef6c22 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513fc expref: 14 pid: 1964 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746126989.491747:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9400 00000100:00100000:0.0:1746126989.491754:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991157504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.491764:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.491780:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6ef6c22 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513fc expref: 14 pid: 1964 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.491791:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6ef6c22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e513fc expref: 14 pid: 1964 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.491810:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.491812:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.491817:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7a00/0x34dc807b6ef6cca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51457 expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.491825:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7a00/0x34dc807b6ef6cca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51457 expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.491870:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac7a00/0x34dc807b6ef6cca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51457 expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.491881:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994063616:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126989.491945:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.499810:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.507948:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.511932:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.515254:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.519075:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.520298:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.535948:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.538411:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.538787:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.546648:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.548316:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.548348:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.548642:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9404 00000100:00100000:0.0:1746126989.548648:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991160064:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.548655:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.548659:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6000/0x34dc807b6ef6c4c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5141f expref: 8 pid: 7258 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.548667:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6000/0x34dc807b6ef6c4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5141f expref: 8 pid: 7258 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.548683:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6000/0x34dc807b6ef6c4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5141f expref: 8 pid: 7258 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.548701:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.548705:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6ef6cfb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.548714:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6ef6cfb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.548720:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6ef6cfb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.548736:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.548765:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2027:x1830945991160064:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 117us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.548771:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9404 00010000:00010000:0.0:1746126989.548792:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6ef6cfb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126989.548797:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6ef6cfb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000040:00080000:0.0:1746126989.549087:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1253, 88 off117856 00000004:00080000:0.0:1746126989.549092:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884590962703ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549756:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1287, 88 off120936 00000004:00080000:0.0:1746126989.549761:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591631206ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.549782:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1288, 88 off121024 00000004:00080000:0.0:1746126989.549785:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591655377ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.549792:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1254, 88 off117944 00000004:00080000:0.0:1746126989.549795:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591666013ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549813:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1255, 88 off118032 00000004:00080000:0.0:1746126989.549816:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591686707ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549824:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1289, 88 off121112 00000004:00080000:0.0:1746126989.549826:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591697056ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.549833:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1290, 88 off121200 00000004:00080000:0.0:1746126989.549835:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591706144ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.549842:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1291, 88 off121288 00000004:00080000:0.0:1746126989.549844:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591715238ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.549850:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1256, 88 off118120 00000004:00080000:0.0:1746126989.549853:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591723607ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549861:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1292, 88 off121376 00000004:00080000:0.0:1746126989.549863:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591734081ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.549870:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1257, 88 off118208 00000004:00080000:0.0:1746126989.549872:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591743008ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549880:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1293, 88 off121464 00000004:00080000:0.0:1746126989.549883:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591753773ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126989.549889:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1258, 88 off118296 00000004:00080000:0.0:1746126989.549892:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591762577ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549899:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1259, 88 off118384 00000004:00080000:0.0:1746126989.549902:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591772661ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549915:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1260, 88 off118472 00000004:00080000:0.0:1746126989.549918:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591789181ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549926:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1261, 88 off118560 00000004:00080000:0.0:1746126989.549929:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 884591799274ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126989.549937:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1294, 88 off121552 00000004:00080000:0.0:1746126989.549940:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 884591810271ns, next at 847916249980ns, rc = 0 00000100:00100000:0.0:1746126989.552387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.556867:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994066560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126989.556902:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126989.557126:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994066560 00000100:00100000:0.0:1746126989.557155:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994066560 00000100:00100000:0.0:1746126989.557175:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20440 00000100:00100000:0.0:1746126989.557180:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+102:3783:x1830945994066560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126989.557235:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:0.0:1746126989.557237:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126989.557239:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126989.557241:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126989.557242:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:0.0:1746126989.557266:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+104:3783:x1830945994066560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (364us total) trans 21474842651 rc 0/0 00000100:00100000:0.0:1746126989.557272:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20440 00000004:00080000:0.0:1746126989.557293:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ced4000/2, rc 0, transno 21474842651 00000100:00100000:0.0:1746126989.557297:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994066560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126989.558365:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec7b800/2, rc 0, transno 17179875415 00000100:00100000:0.0:1746126989.558370:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994066304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126989.560406:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.565673:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.568650:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.569844:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.569886:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.575045:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.575084:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.578508:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.578556:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.582443:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991162240 00000100:00100000:0.0:1746126989.582452:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991162240 00002000:00100000:0.0:1746126989.582495:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009c42b800 x1830945991162240/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:750/0 lens 488/0 e 0 to 0 dl 1746127000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126989.582504:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b800 with x1830945991162240 ext(2097152->3145727) 00002000:00010000:0.0:1746126989.582509:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42b800 00000100:00100000:0.0:1746126989.582719:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8016 00000100:00100000:0.0:1746126989.582727:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991162240:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126989.587003:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.587090:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.604916:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.613278:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.616509:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991163648 00000100:00100000:0.0:1746126989.616517:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991163648 00000100:00100000:0.0:1746126989.616560:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20447 00000100:00100000:0.0:1746126989.616567:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:3640:x1830945991163648:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126989.616581:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.616595:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef6d33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e514b9 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.618416:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126989.618429:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef6d33 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e514b9 expref: 13 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.618442:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef6d33 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e514b9 expref: 13 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.618454:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8600, rc 0) 00000100:00100000:0.0:1746126989.618505:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:3640:x1830945991163648:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1938us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.618512:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20447 00000100:00100000:0.0:1746126989.635524:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.639253:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994067840:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126989.639267:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994067712:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126989.639289:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.639345:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991163776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3562us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.639356:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9407 00000100:00100000:0.0:1746126989.640953:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.644631:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991164544 00000100:00100000:0.0:1746126989.644640:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991164544 00002000:00100000:0.0:1746126989.644681:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c42bb80 x1830945991164544/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:750/0 lens 488/0 e 0 to 0 dl 1746127000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126989.644691:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42bb80 with x1830945991164544 ext(3145728->4194303) 00002000:00010000:0.0:1746126989.644697:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42bb80 00000100:00100000:0.0:1746126989.645091:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8022 00000100:00100000:0.0:1746126989.645098:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991164544:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126989.654276:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.658355:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.660501:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000001:00080000:0.0:1746126989.664609:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842652 is committed 00000001:00080000:0.0:1746126989.664663:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842634 is committed 00000001:00080000:0.0:1746126989.664686:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842621 is committed 00000001:00080000:0.0:1746126989.664692:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842620 is committed 00000100:00100000:0.0:1746126989.672883:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.677984:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.678764:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.690636:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.690699:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.733107:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.734669:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991166592 00000100:00100000:0.0:1746126989.734677:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991166592 00000100:00100000:0.0:1746126989.734719:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17018 00000100:00100000:0.0:1746126989.734725:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:3648:x1830945991166592:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126989.734745:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.734757:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87a00/0x34dc807b6ef6d6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e514d5 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.734813:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734823:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734832:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734842:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734848:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734853:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734928:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6ef6d80 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734937:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6ef6d80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.734943:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6ef6d80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:0.0:1746126989.734949:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746126989.735001:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735007:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735012:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735017:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735022:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011ea87c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126989.735025:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735030:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735039:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126989.735041:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126989.735046:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735050:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87c00/0x34dc807b6ef6d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735073:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735078:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735082:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735086:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011ea87e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126989.735088:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735093:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735099:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f600) 00010000:00010000:0.0:1746126989.735101:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126989.735103:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735108:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef6d79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.735178:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87a00/0x34dc807b6ef6d6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e514d5 expref: 32 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.735189:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6ef6d80 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e514d5 expref: 31 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.735197:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126989.735199:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126989.735200:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea87000, rc 0) 00000100:00100000:0.0:1746126989.740333:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.740396:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.744435:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.746423:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.751750:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.752037:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.752073:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.752118:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.752172:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991167616 00000100:00100000:0.0:1746126989.752175:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991167616 00000100:00100000:0.0:1746126989.752192:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991167744 00000100:00100000:0.0:1746126989.752194:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991167744 00000100:00100000:0.0:1746126989.752205:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991167872 00000100:00100000:0.0:1746126989.752206:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991167872 00000100:00100000:0.0:1746126989.752301:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20452 00000100:00100000:0.0:1746126989.752307:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991167744:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126989.752315:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.752324:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef6db8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e514f1 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.752335:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.752336:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126989.752340:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef6db8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e514f1 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.752352:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009867fa00/0x34dc807b6ef6db8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e514f1 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126989.752358:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867fa00, rc 0) 00000100:00100000:0.0:1746126989.752375:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991167744:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.752380:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20452 00000100:00100000:0.0:1746126989.752950:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.753707:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.754054:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.756657:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.760316:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.763668:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.766729:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.769515:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.802302:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.807344:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991170432 00000100:00100000:0.0:1746126989.807352:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991170432 00010000:00010000:0.0:1746126989.807378:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9400/0x34dc807b6ef6dc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e514ff expref: 10 pid: 9613 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746126989.807403:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9413 00000100:00100000:0.0:1746126989.807411:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991170304:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126989.807422:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126989.807442:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef6ced lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5147a expref: 8 pid: 11152 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.807452:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef6ced lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5147a expref: 8 pid: 11152 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.807486:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef6ced lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5147a expref: 8 pid: 11152 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746126989.807504:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126989.807538:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991170304:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 128us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126989.807544:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9413 00000100:00100000:0.0:1746126989.818236:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.819296:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.820422:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.822818:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991171328 00000100:00100000:0.0:1746126989.822824:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991171328 00000100:00100000:0.0:1746126989.822856:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20459 00000100:00100000:0.0:1746126989.822862:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991171328:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126989.822876:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.822889:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d20ee00/0x34dc807b6ef6e2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51537 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126989.822926:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994069760:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126989.822990:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.831901:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.837310:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.837860:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.837883:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.838730:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.842648:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.872467:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.893600:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.895790:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.927019:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.927054:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.938599:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.939018:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991174528 00000100:00100000:0.0:1746126989.939021:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991174528 00002000:00100000:0.0:1746126989.939038:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094e6ea00 x1830945991174528/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:750/0 lens 488/0 e 0 to 0 dl 1746127000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126989.939046:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6ea00 with x1830945991174528 ext(1048576->2097151) 00002000:00010000:0.0:1746126989.939049:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6ea00 00000100:00100000:0.0:1746126989.939058:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991174784 00000100:00100000:0.0:1746126989.939060:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991174784 00002000:00100000:0.0:1746126989.939068:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880094e6c380 x1830945991174784/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:750/0 lens 488/0 e 0 to 0 dl 1746127000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126989.939074:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6c380 with x1830945991174784 ext(1048576->2097151) 00002000:00010000:0.0:1746126989.939076:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6c380 00000100:00100000:0.0:1746126989.939094:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8037 00000100:00100000:0.0:1746126989.939099:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991174528:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126989.956399:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.960695:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.960740:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.963682:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.965274:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.967675:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.975780:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.975845:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17024 00000100:00100000:0.0:1746126989.975855:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:3663:x1830945991176320:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126989.975881:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126989.975897:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef6e7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51568 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.976206:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6ef6e83 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.976221:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef6e21 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51530 expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.976228:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87a00/0x34dc807b6ef6e4b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5153e expref: 14 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.976236:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6ef6e83 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126989.976263:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87a00/0x34dc807b6ef6e4b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5153e expref: 14 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.976274:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87a00/0x34dc807b6ef6e4b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5153e expref: 14 pid: 7259 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746126989.976286:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994071040:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126989.976370:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef6e21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51530 expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126989.976377:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef6e21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51530 expref: 36 pid: 7258 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746126989.976383:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994071168:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126989.976398:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126989.980017:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.980124:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.980891:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.983887:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.984704:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.989467:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.992694:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.996534:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126989.997278:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.003411:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.009631:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126990.013443:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126990.015565:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.022799:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.022840:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.023383:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8046 00000100:00100000:0.0:1746126990.023391:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991179648:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126990.045251:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.047795:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.052700:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.057219:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.067355:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.124818:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.124851:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.124894:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.124919:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991180672 00000100:00100000:0.0:1746126990.124927:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991180672 00000100:00100000:0.0:1746126990.124972:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991180800 00000100:00100000:0.0:1746126990.124974:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991180800 00000100:00100000:0.0:1746126990.124984:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991180928 00000100:00100000:0.0:1746126990.124986:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991180928 00000100:00100000:0.0:1746126990.124999:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20468 00000100:00100000:0.0:1746126990.125006:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991180672:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126990.125024:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.125040:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6ef6ea6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51584 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.125063:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.125066:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.125074:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6ef6ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51584 expref: 25 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.125088:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6ef6ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51584 expref: 25 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.125100:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643200, rc 0) 00000100:00100000:0.0:1746126990.125196:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991180672:12345-192.168.203.42@tcp:101:cat.0 Request processed in 190us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126990.125206:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20468 00000100:00100000:0.0:1746126990.125220:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20469 00000100:00100000:0.0:1746126990.125224:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991180800:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126990.125229:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.125235:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096643c00/0x34dc807b6ef6ead lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5158b expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126990.125270:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994072448:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126990.125330:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00080000:0.0:1746126990.125354:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126990.125365:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20470 00000100:00100000:0.0:1746126990.125369:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991180928:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126990.125375:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.125383:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51592 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.125392:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.125393:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.125398:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.125407:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.125413:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642600, rc 0) 00000100:00100000:0.0:1746126990.125424:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991180928:12345-192.168.203.42@tcp:101:cat.0 Request processed in 55us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126990.125429:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20470 00000100:00100000:0.0:1746126990.137542:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.154687:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.159051:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.171011:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.181490:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.181548:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.202305:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991182080:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20438us (20746us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746126990.202315:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8051 00002000:00100000:0.0:1746126990.202326:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009d1b6680 x1830945991182080/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:751/0 lens 488/440 e 0 to 0 dl 1746127001 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.202333:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6680 with x1830945991182080 ext(2097152->4194303) 00002000:00010000:0.0:1746126990.202338:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b6680 00000100:00100000:0.0:1746126990.215485:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.236486:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.279800:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.286000:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.286051:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.286093:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991182848 00000100:00100000:0.0:1746126990.286101:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991182848 00010000:00010000:0.0:1746126990.286186:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6ef6e83 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51568 expref: 36 pid: 7258 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746126990.286246:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9430 00000100:00100000:0.0:1746126990.286253:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991182976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126990.286261:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126990.286267:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad200/0x34dc807b6ef6ec9 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515a0 expref: 17 pid: 7258 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746126990.286280:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad200/0x34dc807b6ef6ec9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515a0 expref: 17 pid: 7258 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746126990.286341:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126990.286345:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126990.290346:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.294476:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.294514:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.294555:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.294602:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991183360 00000100:00100000:0.0:1746126990.294609:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991183360 00000100:00100000:0.0:1746126990.294670:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991183232 00000100:00100000:0.0:1746126990.294673:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991183232 00000100:00100000:0.0:1746126990.294871:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20475 00000100:00100000:0.0:1746126990.294878:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991183488:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126990.294891:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.294909:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef6efa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e515c3 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.294933:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.294935:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.294943:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef6efa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515c3 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.294959:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef6efa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515c3 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.294969:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd400, rc 0) 00000100:00100000:0.0:1746126990.306099:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.308526:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ba363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126990.320705:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec78380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994073088:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126990.320733:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb9d800/0x34dc807b6ef6f16 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746126990.323390:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.323413:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991184384 00000100:00100000:0.0:1746126990.323417:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991184384 00000100:00100000:0.0:1746126990.323726:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20477 00000100:00100000:0.0:1746126990.323733:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:3671:x1830945991184384:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126990.323744:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.323754:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6ef6f2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e515d8 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.323772:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef6ebb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51599 expref: 26 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.323780:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6ef6f01 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515bc expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.323787:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2a400/0x34dc807b6ef6ef3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515ae expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.323792:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.323794:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.323797:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6ef6f2b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3866624->4194303] (req 3866624->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515d8 expref: 26 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.323813:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2a400/0x34dc807b6ef6ef3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515ae expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.323822:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2a400/0x34dc807b6ef6ef3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515ae expref: 13 pid: 9613 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746126990.323830:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994073600:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126990.323878:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6ef6f01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515bc expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.323886:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6ef6f01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515bc expref: 10 pid: 9613 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746126990.323893:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994073728:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126990.323916:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef6ebb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51599 expref: 26 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.323923:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef6ebb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51599 expref: 26 pid: 9613 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746126990.323930:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994073856:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126990.327943:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.329309:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.329350:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.331285:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.332211:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994073856:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126990.332262:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6ef6f2b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3866624->4194303] (req 3866624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515d8 expref: 25 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.332274:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd200, rc 0) 00000100:00100000:0.0:1746126990.332304:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:3671:x1830945991184384:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8572us (8915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126990.332310:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20477 00000100:00100000:0.0:1746126990.333220:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.336779:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.336842:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.339332:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.340499:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.340517:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991186176 00000100:00100000:0.0:1746126990.340520:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991186176 00002000:00100000:0.0:1746126990.340545:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1187840->1191935) req@ffff88009da74700 x1830945991186176/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:751/0 lens 488/0 e 0 to 0 dl 1746127001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.340554:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74700 with x1830945991186176 ext(1187840->1191935) 00002000:00010000:0.0:1746126990.340559:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da74700 00000100:00100000:0.0:1746126990.340579:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8054 00000100:00100000:0.0:1746126990.340584:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991186176:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126990.341391:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991186176:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 805us (892us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126990.341400:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8054 00002000:00100000:0.0:1746126990.341404:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1187840->1191935) req@ffff88009da74700 x1830945991186176/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:751/0 lens 488/4536 e 0 to 0 dl 1746127001 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.341411:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74700 with x1830945991186176 ext(1187840->1191935) 00002000:00010000:0.0:1746126990.341414:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da74700 00000100:00100000:0.0:1746126990.349886:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.350851:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.360948:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991187456 00000100:00100000:0.0:1746126990.360951:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991187456 00000100:00100000:0.0:1746126990.360974:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20479 00000100:00100000:0.0:1746126990.360978:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:3671:x1830945991187456:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126990.360988:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.361005:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011de0d200/0x34dc807b6ef6f47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e515ed expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.361029:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef6e9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5157d expref: 16 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.361038:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef6efa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515c3 expref: 13 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.361043:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 35 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.361049:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.361051:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.361055:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de0d200/0x34dc807b6ef6f47 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->3678207] (req 3145728->3678207) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515ed expref: 35 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.361084:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 35 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.361094:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 35 pid: 1507 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746126990.361106:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994074368:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126990.361601:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef6efa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515c3 expref: 13 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.361610:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef6efa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e515c3 expref: 13 pid: 9612 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746126990.361619:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994074496:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126990.361647:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef6e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5157d expref: 16 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.361655:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef6e9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5157d expref: 16 pid: 12333 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746126990.361662:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994074624:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126990.361675:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126990.374491:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.374524:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.374571:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.374667:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9440 00000100:00100000:0.0:1746126990.374674:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991187584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126990.374683:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126990.374692:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 35 pid: 1507 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746126990.374712:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 35 pid: 1507 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746126990.374743:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096642600/0x34dc807b6ef6eb4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51592 expref: 35 pid: 1507 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746126990.374783:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126990.382275:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.382386:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.388499:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991188736 00000100:00100000:0.0:1746126990.388508:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991188736 00002000:00100000:0.0:1746126990.388558:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88007ec78000 x1830945991188736/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:751/0 lens 488/0 e 0 to 0 dl 1746127001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.388568:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec78000 with x1830945991188736 ext(3145728->4194303) 00002000:00010000:0.0:1746126990.388574:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec78000 00000100:00100000:0.0:1746126990.388605:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8057 00000100:00100000:0.0:1746126990.388612:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991188736:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126990.402620:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.408590:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.424115:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.430844:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.454868:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.469934:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.473690:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.486396:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.490971:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.506849:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.507631:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.507672:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.507691:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991191296 00000100:00100000:0.0:1746126990.507694:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991191296 00002000:00100000:0.0:1746126990.507720:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009ab0e300 x1830945991191296/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:751/0 lens 488/0 e 0 to 0 dl 1746127001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.507729:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0e300 with x1830945991191296 ext(2097152->4194303) 00002000:00010000:0.0:1746126990.507734:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0e300 00000100:00100000:0.0:1746126990.507746:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991191424 00000100:00100000:0.0:1746126990.507748:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991191424 00002000:00100000:0.0:1746126990.507759:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009ab0f480 x1830945991191424/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:751/0 lens 488/0 e 0 to 0 dl 1746127001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.507766:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0f480 with x1830945991191424 ext(2097152->4194303) 00002000:00010000:0.0:1746126990.507769:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0f480 00000100:00100000:0.0:1746126990.508896:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8062 00000100:00100000:0.0:1746126990.508903:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991191424:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126990.517778:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.524093:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.525324:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.533078:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.543062:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.584536:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.588837:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.588888:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.596499:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.598881:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.605294:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.612359:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.613436:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.630595:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.648041:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.650027:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.650060:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.651268:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126990.651554:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae800/0x34dc807b6ef6fcc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651563:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae800/0x34dc807b6ef6fcc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:0.0:1746126990.651612:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126990.651616:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126990.651630:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae800/0x34dc807b6ef6fcc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651639:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae800/0x34dc807b6ef6fcc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651648:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651654:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651658:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651664:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651669:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e980800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126990.651672:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651677:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651684:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126990.651686:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126990.651689:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651693:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980800/0x34dc807b6ef6fbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651722:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef6fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651727:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef6fc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651731:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef6fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651735:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e981200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126990.651737:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef6fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651741:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef6fc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651747:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a9a85d00) 00010000:00010000:0.0:1746126990.651748:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126990.651750:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef6fc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651755:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef6fc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746126990.651782:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef6fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51641 expref: 12 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.651792:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae800/0x34dc807b6ef6fcc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51641 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.651797:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126990.651799:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126990.651801:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d1ae800, rc 0) 00000100:00100000:0.0:1746126990.651852:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:3696:x1830945991194240:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 3636us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126990.651858:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17031 00000100:00100000:0.0:1746126990.653750:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.653782:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.653867:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.653951:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.654162:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20490 00000100:00100000:0.0:1746126990.654170:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991195008:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126990.654183:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.654197:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967fd800/0x34dc807b6ef6fda lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5164f expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126990.654212:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.654214:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126990.654221:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fd800/0x34dc807b6ef6fda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5164f expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.654233:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967fd800/0x34dc807b6ef6fda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5164f expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.654241:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fd800, rc 0) 00000100:00100000:0.0:1746126990.654272:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991195008:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 103us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126990.654278:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20490 00000100:00100000:0.0:1746126990.656498:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.658774:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.660829:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.663467:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.664442:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.670301:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.687272:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.693978:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.694031:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.695414:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.697615:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.705361:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.716797:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.716841:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.716887:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.720186:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.723055:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.755841:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.806713:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.806766:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.816494:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.816548:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.824535:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.828895:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.841210:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.845297:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.851670:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.852592:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991199744:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7133us (7301us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126990.852601:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8071 00002000:00100000:0.0:1746126990.852610:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88008c5be680 x1830945991199744/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:751/0 lens 488/440 e 0 to 0 dl 1746127001 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.852618:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5be680 with x1830945991199744 ext(2097152->3145727) 00002000:00010000:0.0:1746126990.852621:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5be680 00000100:00100000:0.0:1746126990.860490:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.866513:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.869963:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.870108:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.870637:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a178b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994078720:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126990.870665:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c35d400/0x34dc807b6ef7082 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e516c6 expref: 18 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.870675:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c35d400/0x34dc807b6ef7082 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e516c6 expref: 18 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126990.870700:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35d400, rc 0) 00000100:00100000:0.0:1746126990.870725:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991200384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1490us (1556us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126990.870731:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20503 00000100:00100000:0.0:1746126990.888192:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.888508:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991201408 00000100:00100000:0.0:1746126990.888512:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991201408 00002000:00100000:0.0:1746126990.888614:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3244032->4194303) req@ffff88011dc62300 x1830945991201408/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:751/0 lens 488/0 e 0 to 0 dl 1746127001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.888621:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc62300 with x1830945991201408 ext(3244032->4194303) 00002000:00010000:0.0:1746126990.888625:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc62300 00000100:00100000:0.0:1746126990.888643:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8075 00000100:00100000:0.0:1746126990.888648:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991201408:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126990.893883:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a178b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994078848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746126990.893950:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126990.894464:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a178b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994078848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746126990.895288:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.916542:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.923097:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.923544:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.923593:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.923617:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991202816 00000100:00100000:0.0:1746126990.923619:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991202816 00002000:00100000:0.0:1746126990.923635:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3244031) req@ffff8800a7c50000 x1830945991202816/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:751/0 lens 488/0 e 0 to 0 dl 1746127001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.923642:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50000 with x1830945991202816 ext(3145728->3244031) 00010000:00010000:0.0:1746126990.923648:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6ef7020 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51680 expref: 16 pid: 12333 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746126990.923660:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6ef7020 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3244031) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51680 expref: 16 pid: 12333 timeout: 985 lvb_type: 0 00002000:00010000:0.0:1746126990.923666:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c50000 00000100:00100000:0.0:1746126990.923678:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1742 00000100:00100000:0.0:1746126990.923682:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991202816:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126990.928948:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.928987:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.929732:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.929797:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.932237:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.943260:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.943294:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.943332:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.943356:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991203968 00000100:00100000:0.0:1746126990.943359:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991203968 00002000:00100000:0.0:1746126990.943377:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1679360->1683455) req@ffff8800a7c53480 x1830945991203968/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:751/0 lens 488/0 e 0 to 0 dl 1746127001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126990.943386:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53480 with x1830945991203968 ext(1679360->1683455) 00002000:00010000:0.0:1746126990.943389:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53480 00000100:00100000:0.0:1746126990.943403:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8078 00000100:00100000:0.0:1746126990.943410:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991203712:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126990.956754:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.956799:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.957301:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.965520:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20511 00000100:00100000:0.0:1746126990.965537:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991204992:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126990.965556:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126990.965574:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd00000/0x34dc807b6ef70ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e516fe expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126990.965627:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994080896:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126990.965688:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126990.973682:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126990.976437:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.012692:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.015871:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.021428:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.023472:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.029037:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.033383:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.042655:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.050719:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.092303:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.092360:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.108901:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.113641:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.113674:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.113704:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.130275:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.130544:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.141086:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.155920:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.160439:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.169202:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.174030:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.188598:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.193823:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.195931:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.201089:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.207252:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.208020:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.212290:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.254925:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.255638:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.267435:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.282503:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.290735:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.293965:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.298938:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.301777:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.302074:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991211520 00000100:00100000:0.0:1746126991.302078:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991211520 00000100:00100000:0.0:1746126991.302096:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20528 00000100:00100000:0.0:1746126991.302102:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991211520:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126991.302108:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126991.302115:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6ef7131 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51775 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.302125:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126991.302161:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6ef7131 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51775 expref: 22 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.302170:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6ef7131 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51775 expref: 22 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.302180:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076179400, rc 0) 00000100:00100000:0.0:1746126991.302197:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991211520:12345-192.168.203.42@tcp:101:cat.0 Request processed in 95us (134us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126991.302202:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20528 00000100:00100000:0.0:1746126991.302590:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.304594:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.305235:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.307556:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.307591:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.307621:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.308564:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.313873:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.316507:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.318244:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.321942:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.335702:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.335744:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.340352:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.342116:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.343444:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.351383:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.351966:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.369352:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.373834:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.376638:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.382381:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.382871:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991215360:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5199us (6235us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126991.382877:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8097 00002000:00100000:0.0:1746126991.382883:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009c4ced80 x1830945991215360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:752/0 lens 488/440 e 0 to 0 dl 1746127002 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126991.382891:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ced80 with x1830945991215360 ext(3145728->4194303) 00002000:00010000:0.0:1746126991.382894:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4ced80 00000100:00100000:0.0:1746126991.387182:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.389756:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.392389:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.394334:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.395597:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.401173:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.404944:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.418440:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.420890:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.420936:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126991.421025:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746126991.421051:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126991.427304:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.427783:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126991.434307:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126991.441506:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.445640:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.449948:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.453324:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.456186:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.456675:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.456880:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.456941:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.456952:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.456973:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.456986:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991219456 00000100:00100000:0.0:1746126991.456989:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991219456 00000100:00100000:0.0:1746126991.457008:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20551 00000100:00100000:0.0:1746126991.457013:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991219584:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126991.457029:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2000/0x34dc807b6ef721f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457038:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef7169 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e517ad expref: 22 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457045:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef71cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51801 expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.457051:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef7177 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e517bb expref: 40 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457057:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6ef6e98 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51576 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457063:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6ef7074 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e516b8 expref: 40 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457068:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126991.457070:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126991.457072:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2000/0x34dc807b6ef721f lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457086:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6ef7074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e516b8 expref: 40 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457093:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6ef7074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e516b8 expref: 40 pid: 12333 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746126991.457105:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093642d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994087040:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126991.457158:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6ef6e98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51576 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457166:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6ef6e98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51576 expref: 22 pid: 12333 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746126991.457173:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093641c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994087296:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126991.457198:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef7177 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e517bb expref: 40 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457206:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef7177 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e517bb expref: 40 pid: 3542 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746126991.457213:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093642680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994087552:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126991.457233:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef71cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51801 expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.457239:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef71cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51801 expref: 16 pid: 11152 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746126991.457245:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cabb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994087680:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126991.457258:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef7169 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e517ad expref: 22 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.457264:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef7169 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e517ad expref: 22 pid: 3542 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746126991.457271:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994087808:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126991.457280:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126991.471013:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.471038:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.471051:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473085:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473117:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473163:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473183:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473197:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473210:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473220:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473232:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473242:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473251:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473260:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473270:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473281:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473291:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473303:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473314:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473323:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473357:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.473410:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9486 00000100:00100000:0.0:1746126991.474369:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991220096:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126991.474376:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126991.474385:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef6cae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51442 expref: 31 pid: 9613 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746126991.474392:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef6cae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51442 expref: 31 pid: 9613 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746126991.474402:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef6cae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51442 expref: 31 pid: 9613 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746126991.474419:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126991.474420:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126991.474422:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc800/0x34dc807b6ef720a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.474428:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc800/0x34dc807b6ef720a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126991.474440:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126991.477706:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.480619:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994089216:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126991.480628:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994089344:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126991.481026:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.481509:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.481535:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.482353:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.487173:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ece4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994089984:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746126991.487197:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126991.487416:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126991.487810:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994090496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126991.487830:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126991.487838:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994091008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126991.487851:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126991.487858:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994091520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126991.487870:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126991.487879:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746126991.487882:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994091392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126991.487899:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746126991.487911:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126991.487918:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126991.487937:0:3784:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842652 gen 2 00000004:00080000:0.0:1746126991.487941:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cc700, transno 21474842531 00000004:00080000:0.0:1746126991.487946:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cc000, transno 21474842532 00000004:00080000:0.0:1746126991.487949:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fd8380, transno 21474842533 00000004:00080000:0.0:1746126991.487951:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cd500, transno 21474842534 00000004:00080000:0.0:1746126991.487953:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fd8000, transno 21474842535 00000004:00080000:0.0:1746126991.487954:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cfb80, transno 21474842536 00000004:00080000:0.0:1746126991.487956:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cea00, transno 21474842537 00000004:00080000:0.0:1746126991.487958:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fc9180, transno 21474842538 00000004:00080000:0.0:1746126991.487960:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c428380, transno 21474842539 00000004:00080000:0.0:1746126991.487962:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc61500, transno 21474842544 00000004:00080000:0.0:1746126991.487965:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc60000, transno 21474842545 00000004:00080000:0.0:1746126991.487967:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc62680, transno 21474842546 00000004:00080000:0.0:1746126991.487970:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc61c00, transno 21474842547 00000004:00080000:0.0:1746126991.487972:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc63b80, transno 21474842548 00000004:00080000:0.0:1746126991.487974:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc62a00, transno 21474842549 00000004:00080000:0.0:1746126991.487976:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc63480, transno 21474842550 00000004:00080000:0.0:1746126991.487978:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093643800, transno 21474842551 00000004:00080000:0.0:1746126991.488239:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc61180, transno 21474842552 00000004:00080000:0.0:1746126991.488285:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced5880, transno 21474842553 00000004:00080000:0.0:1746126991.488288:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced4700, transno 21474842554 00000004:00080000:0.0:1746126991.488289:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced4e00, transno 21474842555 00000004:00080000:0.0:1746126991.488291:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093640e00, transno 21474842556 00000004:00080000:0.0:1746126991.488293:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d288e00, transno 21474842557 00000004:00080000:0.0:1746126991.488295:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d288700, transno 21474842558 00000004:00080000:0.0:1746126991.488296:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d28a680, transno 21474842559 00000004:00080000:0.0:1746126991.488298:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d288000, transno 21474842560 00000004:00080000:0.0:1746126991.488300:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced7800, transno 21474842561 00000004:00080000:0.0:1746126991.488302:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0e00, transno 21474842563 00000004:00080000:0.0:1746126991.488305:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1500, transno 21474842564 00000004:00080000:0.0:1746126991.488307:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2680, transno 21474842565 00000004:00080000:0.0:1746126991.488309:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0380, transno 21474842566 00000004:00080000:0.0:1746126991.488311:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2300, transno 21474842567 00000004:00080000:0.0:1746126991.488313:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1f80, transno 21474842568 00000004:00080000:0.0:1746126991.488315:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede3800, transno 21474842569 00000004:00080000:0.0:1746126991.488317:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2d80, transno 21474842570 00000004:00080000:0.0:1746126991.488320:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1c00, transno 21474842571 00000004:00080000:0.0:1746126991.488321:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d28b800, transno 21474842572 00000004:00080000:0.0:1746126991.488324:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d289c00, transno 21474842573 00000004:00080000:0.0:1746126991.488326:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238c000, transno 21474842574 00000004:00080000:0.0:1746126991.488328:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238d500, transno 21474842575 00000004:00080000:0.0:1746126991.488331:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093642300, transno 21474842576 00000004:00080000:0.0:1746126991.488333:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238c700, transno 21474842577 00000004:00080000:0.0:1746126991.488335:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d289880, transno 21474842578 00000004:00080000:0.0:1746126991.488337:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d289500, transno 21474842579 00000004:00080000:0.0:1746126991.488338:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238dc00, transno 21474842580 00000004:00080000:0.0:1746126991.488340:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede3b80, transno 21474842586 00000004:00080000:0.0:1746126991.488343:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede3480, transno 21474842587 00000004:00080000:0.0:1746126991.488345:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e1f80, transno 21474842588 00000004:00080000:0.0:1746126991.488347:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e2a00, transno 21474842589 00000004:00080000:0.0:1746126991.488349:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0a80, transno 21474842590 00000004:00080000:0.0:1746126991.488352:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e2680, transno 21474842591 00000004:00080000:0.0:1746126991.488354:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2a00, transno 21474842592 00000004:00080000:0.0:1746126991.488355:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e1500, transno 21474842593 00000004:00080000:0.0:1746126991.488357:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e0000, transno 21474842594 00000004:00080000:0.0:1746126991.488359:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099425180, transno 21474842595 00000004:00080000:0.0:1746126991.488361:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099424a80, transno 21474842596 00000004:00080000:0.0:1746126991.488363:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099426300, transno 21474842597 00000004:00080000:0.0:1746126991.488365:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099425880, transno 21474842598 00000004:00080000:0.0:1746126991.488366:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099425c00, transno 21474842599 00000004:00080000:0.0:1746126991.488368:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099426680, transno 21474842600 00000004:00080000:0.0:1746126991.488370:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099426a00, transno 21474842601 00000004:00080000:0.0:1746126991.488372:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099425500, transno 21474842602 00000004:00080000:0.0:1746126991.488375:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095ca9180, transno 21474842603 00000004:00080000:0.0:1746126991.488377:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22df80, transno 21474842604 00000004:00080000:0.0:1746126991.488378:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22ea00, transno 21474842605 00000004:00080000:0.0:1746126991.488380:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f480, transno 21474842606 00000004:00080000:0.0:1746126991.488382:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22e300, transno 21474842607 00000004:00080000:0.0:1746126991.488384:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22c700, transno 21474842608 00000004:00080000:0.0:1746126991.488386:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22ca80, transno 21474842609 00000004:00080000:0.0:1746126991.488388:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22dc00, transno 21474842610 00000004:00080000:0.0:1746126991.488391:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f800, transno 21474842611 00000004:00080000:0.0:1746126991.488393:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a1789180, transno 21474842612 00000004:00080000:0.0:1746126991.488395:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a76d80, transno 21474842622 00000004:00080000:0.0:1746126991.488397:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123476680, transno 21474842623 00000004:00080000:0.0:1746126991.488399:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74e00, transno 21474842624 00000004:00080000:0.0:1746126991.488402:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c02680, transno 21474842625 00000004:00080000:0.0:1746126991.488404:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c00e00, transno 21474842626 00000004:00080000:0.0:1746126991.488406:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c01880, transno 21474842627 00000004:00080000:0.0:1746126991.488408:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123477480, transno 21474842628 00000004:00080000:0.0:1746126991.488410:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c00700, transno 21474842629 00000004:00080000:0.0:1746126991.488412:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c03480, transno 21474842630 00000004:00080000:0.0:1746126991.488414:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c02d80, transno 21474842635 00000004:00080000:0.0:1746126991.488416:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c01f80, transno 21474842636 00000004:00080000:0.0:1746126991.488419:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba56a00, transno 21474842637 00000004:00080000:0.0:1746126991.488421:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba57b80, transno 21474842638 00000004:00080000:0.0:1746126991.488423:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c02a00, transno 21474842639 00000004:00080000:0.0:1746126991.488426:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c00000, transno 21474842640 00000004:00080000:0.0:1746126991.488428:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba57480, transno 21474842641 00000004:00080000:0.0:1746126991.488430:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba55880, transno 21474842642 00000004:00080000:0.0:1746126991.488432:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093643480, transno 21474842643 00000004:00080000:0.0:1746126991.488435:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099421880, transno 21474842644 00000004:00080000:0.0:1746126991.488436:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099420000, transno 21474842645 00000004:00080000:0.0:1746126991.488438:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099422300, transno 21474842646 00000004:00080000:0.0:1746126991.488440:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099423100, transno 21474842647 00000004:00080000:0.0:1746126991.488442:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099420e00, transno 21474842648 00000004:00080000:0.0:1746126991.488444:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099422680, transno 21474842649 00000004:00080000:0.0:1746126991.488446:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099421500, transno 21474842650 00000004:00080000:0.0:1746126991.488448:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced4000, transno 21474842651 00000004:00080000:0.0:1746126991.488450:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced4380, transno 21474842652 00000100:00100000:0.0:1746126991.488456:0:3784:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801220f2d80 x1830945994090368/t21474842666(21474842666) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127007 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746126991.488465:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f2d80/2, rc 0, transno 21474842666 00000100:00100000:0.0:1746126991.488468:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994090368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126991.488626:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f1500/2, rc 0, transno 21474842670 00000100:00100000:0.0:1746126991.488629:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994090880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126991.488638:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ece7100/2, rc 0, transno 17179875433 00000100:00100000:0.0:1746126991.488640:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ece7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994089856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126991.488888:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f0700/2, rc 0, transno 21474842669 00000100:00100000:0.0:1746126991.488892:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994091392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126991.488898:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ece4e00/2, rc 0, transno 17179875431 00000100:00100000:0.0:1746126991.488901:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ece4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994089984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126991.488906:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f1880/2, rc 0, transno 21474842667 00000100:00100000:0.0:1746126991.488908:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994090496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126991.488913:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f14700/2, rc 0, transno 17179875432 00000100:00100000:0.0:1746126991.488915:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994091008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126991.488920:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f0000/2, rc 0, transno 21474842668 00000100:00100000:0.0:1746126991.488922:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994091520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126991.489321:0:8231:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 99 done 00000100:00100000:0.0:1746126991.489515:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994091776 00000100:00100000:0.0:1746126991.489519:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994091776 00000100:00100000:0.0:1746126991.489712:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20570 00000100:00100000:0.0:1746126991.489718:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994091776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126991.489891:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994091776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (434us total) trans 21474842673 rc 0/0 00000100:00100000:0.0:1746126991.489896:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20570 00000100:00100000:0.0:1746126991.490473:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.494204:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.497452:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.497493:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.497516:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.497558:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.497571:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.497596:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126991.497642:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20573 00000100:00100000:0.0:1746126991.497648:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991223936:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126991.497655:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126991.497665:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef7257 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51847 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126991.497682:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c88d, atime: 0x6813c88e, ctime: 0x6813c88d, blocks: 0x14e0 00010000:00010000:0.0:1746126991.497696:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126991.497697:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126991.497704:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef7257 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51847 expref: 12 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.497715:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef7257 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51847 expref: 12 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.497722:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11000, rc 0) 00000100:00100000:0.0:1746126991.497754:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991223936:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126991.497762:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20573 00000100:00100000:0.0:1746126991.497776:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20575 00000100:00100000:0.0:1746126991.497780:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991223808:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126991.497786:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126991.497792:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc10800/0x34dc807b6ef726c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51840 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126991.497802:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c88d, atime: 0x6813c88d, ctime: 0x6813c88d, blocks: 0x800 00010000:00010000:0.0:1746126991.497808:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126991.497809:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126991.497813:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc10800/0x34dc807b6ef726c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51840 expref: 11 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.497822:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc10800/0x34dc807b6ef726c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51840 expref: 11 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126991.497828:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10800, rc 0) 00000100:00100000:0.0:1746126991.497844:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991223808:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126991.497849:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20575 00000100:00100000:0.0:1746126992.502110:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.502212:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.502239:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.502252:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.502265:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.502304:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.502339:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991224576 00000100:00100000:0.0:1746126992.502346:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991224576 00000100:00100000:0.0:1746126992.502400:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991224192 00000100:00100000:0.0:1746126992.502403:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991224192 00000100:00100000:0.0:1746126992.502420:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991224704 00000100:00100000:0.0:1746126992.502422:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991224704 00000100:00100000:0.0:1746126992.502446:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20578 00000100:00100000:0.0:1746126992.502453:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991224576:12345-192.168.203.42@tcp:23:mirror_io.0 00000100:00100000:0.0:1746126992.502541:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991224576:12345-192.168.203.42@tcp:23:mirror_io.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.502551:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20578 00000100:00100000:0.0:1746126992.502567:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20581 00000100:00100000:0.0:1746126992.502573:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991224448:12345-192.168.203.42@tcp:23:mirror_io.0 00000100:00100000:0.0:1746126992.502608:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991224448:12345-192.168.203.42@tcp:23:mirror_io.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.502614:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20581 00000100:00100000:0.0:1746126992.506898:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.506977:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.507007:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.507037:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.507051:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991225344 00000100:00100000:0.0:1746126992.507053:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991225344 00000100:00100000:0.0:1746126992.507067:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991224960 00000100:00100000:0.0:1746126992.507068:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991224960 00000100:00100000:0.0:1746126992.507079:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20583 00000100:00100000:0.0:1746126992.507085:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991225088:12345-192.168.203.42@tcp:23:mirror_io.0 00000100:00100000:0.0:1746126992.507277:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991225088:12345-192.168.203.42@tcp:23:mirror_io.0 Request processed in 191us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.507283:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20583 00000100:00100000:0.0:1746126992.507357:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991225216 00000100:00100000:0.0:1746126992.507360:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991225216 00000100:00100000:0.0:1746126992.507598:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20588 00000100:00100000:0.0:1746126992.507603:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991225216:12345-192.168.203.42@tcp:23:mirror_io.0 00000100:00100000:0.0:1746126992.507640:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991225216:12345-192.168.203.42@tcp:23:mirror_io.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.507645:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20588 00000100:00100000:0.0:1746126992.511049:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.513077:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.517204:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.522813:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.523462:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.523500:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.523517:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.523537:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991226880 00000100:00100000:0.0:1746126992.523544:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991226880 00000100:00100000:0.0:1746126992.523840:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8103 00000100:00100000:0.0:1746126992.523849:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991227136:12345-192.168.203.42@tcp:3:mirror_io.0 00010000:00010000:0.0:1746126992.523876:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009caea800/0x34dc807b6ef728f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.523887:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.523888:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.523892:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009caea800/0x34dc807b6ef728f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.523907:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009caea800/0x34dc807b6ef728f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126992.531704:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.531743:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126992.553888:0:29584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef729d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.553903:0:29584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef729d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.553910:0:29584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef729d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.553916:0:29584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800967e4c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126992.553919:0:29584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef729d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.553926:0:29584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef729d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.553940:0:29584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef729d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.553946:0:29584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6ef729d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126992.554024:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2027:x1830945991227264:12345-192.168.203.42@tcp:3:mirror_io.0 Request processed in 29512us (29572us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126992.554033:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8105 00000100:00100000:0.0:1746126992.571593:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.577451:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.579397:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.597096:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.597192:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.597249:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17043 00000100:00100000:0.0:1746126992.597258:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+8:3753:x1830945991228800:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.597283:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.597301:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef72b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51855 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.599113:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599142:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599150:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599159:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599164:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599173:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599214:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef72ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599222:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef72ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599227:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef72ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:0.0:1746126992.599232:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746126992.599265:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599270:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599274:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599278:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599281:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009867fe00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126992.599283:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599287:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599293:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126992.599295:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126992.599298:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599302:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef72dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599317:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599321:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599326:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599330:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880121600600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126992.599331:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599335:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599341:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c81bf00) 00010000:00010000:0.0:1746126992.599342:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126992.599344:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599349:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880121600600/0x34dc807b6ef72e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.599377:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef72b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51855 expref: 11 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.599387:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef72ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51855 expref: 10 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.599392:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126992.599395:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126992.599396:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341b200, rc 0) 00000100:00100000:0.0:1746126992.599416:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:3753:x1830945991228800:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2160us (2330us total) trans 8589937928 rc 0/0 00000100:00100000:0.0:1746126992.599422:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17043 00000100:00100000:0.0:1746126992.603498:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.604346:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.604368:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.604408:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.605398:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20593 00000100:00100000:0.0:1746126992.605408:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991229952:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.605421:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.605505:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012341aa00/0x34dc807b6ef7306 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5187f expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605523:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.605525:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.605532:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012341aa00/0x34dc807b6ef7306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5187f expref: 32 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126992.605544:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012341aa00/0x34dc807b6ef7306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5187f expref: 32 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126992.605553:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341aa00, rc 0) 00000100:00100000:0.0:1746126992.605580:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991229952:12345-192.168.203.42@tcp:101:cat.0 Request processed in 175us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.605587:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20593 00000100:00100000:0.0:1746126992.605636:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.605652:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991230336 00000100:00100000:0.0:1746126992.605657:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991230336 00000100:00100000:0.0:1746126992.605683:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17045 00000100:00100000:0.0:1746126992.605688:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:3750:x1830945991230336:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126992.605700:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.605710:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef7314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5188d expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605786:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ae00/0x34dc807b6ef7322 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.605798:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6ef7249 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51824 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605805:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6ef72ce lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5185c expref: 28 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605811:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef72ea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51855 expref: 12 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605817:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ae00/0x34dc807b6ef7322 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126992.605839:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef72ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51855 expref: 12 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605848:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef72ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51855 expref: 12 pid: 7260 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746126992.605860:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994091904:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126992.605917:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6ef72ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5185c expref: 28 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605925:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6ef72ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5185c expref: 28 pid: 7259 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746126992.605931:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994092032:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126992.605956:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6ef7249 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51824 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.605962:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6ef7249 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51824 expref: 9 pid: 7259 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746126992.605969:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994092160:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126992.605984:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126992.606359:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.606969:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.607336:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.607349:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.607385:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.607412:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991230720 00000100:00100000:0.0:1746126992.607416:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991230720 00000100:00100000:0.0:1746126992.607439:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991230976 00000100:00100000:0.0:1746126992.607442:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991230976 00000100:00100000:0.0:1746126992.607458:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20598 00000100:00100000:0.0:1746126992.607464:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991230592:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.607669:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.607677:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099158c00/0x34dc807b6ef734c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5189b expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.607687:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.607688:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.607692:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099158c00/0x34dc807b6ef734c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5189b expref: 23 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126992.607701:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099158c00/0x34dc807b6ef734c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5189b expref: 23 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126992.607707:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158c00, rc 0) 00000100:00100000:0.0:1746126992.607720:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991230592:12345-192.168.203.42@tcp:101:cat.0 Request processed in 255us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.607726:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20598 00000100:00100000:0.0:1746126992.610671:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.611057:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.611295:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.611320:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.611344:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.618743:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.618792:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.618852:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.619821:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.619833:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991232768 00000100:00100000:0.0:1746126992.619836:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991232768 00002000:00100000:0.0:1746126992.619850:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cd64700 x1830945991232768/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:753/0 lens 488/0 e 0 to 0 dl 1746127003 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126992.619856:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64700 with x1830945991232768 ext(1048576->2097151) 00002000:00010000:0.0:1746126992.619859:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64700 00000100:00100000:0.0:1746126992.619871:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8111 00000100:00100000:0.0:1746126992.619875:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991232768:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126992.620476:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.620491:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991233024 00000100:00100000:0.0:1746126992.620494:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991233024 00002000:00100000:0.0:1746126992.620508:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009cd65c00 x1830945991233024/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:753/0 lens 488/0 e 0 to 0 dl 1746127003 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126992.620514:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65c00 with x1830945991233024 ext(0->1048575) 00002000:00010000:0.0:1746126992.620517:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65c00 00000100:00100000:0.0:1746126992.620527:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8112 00000100:00100000:0.0:1746126992.620531:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991233024:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126992.627555:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.633618:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.642306:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.642351:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.642378:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991234432 00000100:00100000:0.0:1746126992.642383:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991234432 00000100:00100000:0.0:1746126992.642413:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17049 00000100:00100000:0.0:1746126992.642419:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:3754:x1830945991234432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.642433:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.642444:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef737d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e518d3 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.642480:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914aa00/0x34dc807b6ef7376 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126992.642488:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef737d lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518d3 expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.642526:0:7260:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009914aa00/0x34dc807b6ef7376 lrc: 5/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746126992.642537:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef737d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518d3 expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.642546:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126992.642549:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126992.642551:0:7260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef737d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518d3 expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.642556:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc35a00, rc 0) 00000100:00100000:0.0:1746126992.642572:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:3754:x1830945991234432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 153us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.642577:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17049 00000100:00100000:0.0:1746126992.644690:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994092544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126992.644721:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126992.644741:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994093056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126992.645013:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994092544 00000100:00100000:0.0:1746126992.645018:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994092544 00000100:00100000:0.0:1746126992.645042:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994092672 00000100:00100000:0.0:1746126992.645044:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994092672 00000100:00100000:0.0:1746126992.645053:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20603 00000100:00100000:0.0:1746126992.645113:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3784:x1830945994092544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126992.645229:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126992.645232:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746126989 -> 1746126989 00002000:00010000:0.0:1746126992.645234:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126992.645236:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746126989 -> 1746126989 00002000:00010000:0.0:1746126992.645237:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126992.645259:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3784:x1830945994092544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (537us total) trans 17179875435 rc 0/0 00000100:00100000:0.0:1746126992.645265:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20603 00000100:00100000:0.0:1746126992.645277:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20604 00000100:00100000:0.0:1746126992.645281:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3785:x1830945994092672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126992.645318:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126992.645320:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126989 -> 1746126989 00002000:00010000:0.0:1746126992.645322:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746126989 -> 1746126989 00002000:00010000:0.0:1746126992.645323:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126989 -> 1746126989 00002000:00010000:0.0:1746126992.645325:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746126992.645342:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3785:x1830945994092672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (586us total) trans 17179875436 rc 0/0 00000100:00100000:0.0:1746126992.645347:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20604 00000100:00100000:0.0:1746126992.645384:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.645401:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991234560 00000100:00100000:0.0:1746126992.645403:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991234560 00000100:00100000:0.0:1746126992.645422:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17050 00000100:00100000:0.0:1746126992.645427:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:3753:x1830945991234560:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.645436:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.645444:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6ef7384 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e518da expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.645472:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6ef7384 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518da expref: 13 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.645480:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6ef7384 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518da expref: 13 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.645489:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126992.645492:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126992.645494:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159800, rc 0) 00000100:00100000:0.0:1746126992.645512:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:3753:x1830945991234560:12345-192.168.203.42@tcp:101:cat.0 Request processed in 85us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126992.645517:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17050 00000100:00100000:0.0:1746126992.645582:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994093184 00000100:00100000:0.0:1746126992.645585:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994093184 00000100:00100000:0.0:1746126992.645601:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20605 00000100:00100000:0.0:1746126992.645605:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3785:x1830945994093184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126992.645645:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746126992.645647:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126992.645649:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126992.645650:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126992.645652:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746126992.645672:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3785:x1830945994093184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (705us total) trans 17179875437 rc 0/0 00000100:00100000:0.0:1746126992.645680:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20605 00000100:00100000:0.0:1746126992.645688:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994093696 00000100:00100000:0.0:1746126992.645691:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994093696 00000100:00100000:0.0:1746126992.645702:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994094208 00000100:00100000:0.0:1746126992.645704:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994094208 00000100:00100000:0.0:1746126992.645713:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994092800 00000100:00100000:0.0:1746126992.645715:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994092800 00000100:00100000:0.0:1746126992.645725:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20606 00000100:00100000:0.0:1746126992.645729:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3785:x1830945994093696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126992.645783:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3785:x1830945994093696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (181us total) trans 17179875438 rc 0/0 00000100:00100000:0.0:1746126992.645788:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20606 00000100:00100000:0.0:1746126992.645796:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994093824 00000100:00100000:0.0:1746126992.645798:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994093824 00000100:00100000:0.0:1746126992.645807:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20607 00000100:00100000:0.0:1746126992.645811:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3785:x1830945994094208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126992.645872:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3785:x1830945994094208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (235us total) trans 21474842675 rc 0/0 00000100:00100000:0.0:1746126992.645876:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20607 00000100:00100000:0.0:1746126992.645885:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20609 00000100:00100000:0.0:1746126992.645888:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3782:x1830945994093312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126992.645926:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746126992.645929:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126992.645930:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126992.645932:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746126988 -> 1746126988 00002000:00010000:0.0:1746126992.645934:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746126992.645951:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3782:x1830945994093312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (222us total) trans 21474842676 rc 0/0 00000100:00100000:0.0:1746126992.645956:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20609 00000100:00100000:0.0:1746126992.645965:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20611 00000100:00100000:0.0:1746126992.645969:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3782:x1830945994094336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126992.646004:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126992.646006:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126992.646008:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126992.646010:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126992.646011:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:0.0:1746126992.646029:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3782:x1830945994094336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (261us total) trans 21474842678 rc 0/0 00000100:00100000:0.0:1746126992.646034:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20611 00000100:00100000:0.0:1746126992.646048:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126992.646062:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994093568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126992.646080:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126992.646090:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994094080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126992.646102:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126992.646118:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f16300/2, rc 0, transno 17179875435 00000100:00100000:0.0:1746126992.646153:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994092544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126992.646186:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994094720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126992.646203:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126992.646270:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a78380/2, rc 0, transno 17179875440 00000100:00100000:0.0:1746126992.646273:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994093056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126992.646281:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ced7800/2, rc 0, transno 21474842679 00000100:00100000:0.0:1746126992.646284:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994093568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126992.646292:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d28b800/2, rc 0, transno 21474842680 00000100:00100000:0.0:1746126992.646294:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994094720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126992.646367:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ced6a00/2, rc 0, transno 21474842681 00000100:00100000:0.0:1746126992.646371:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994094080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126992.646402:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994093440 00000100:00100000:0.0:1746126992.646405:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994093440 00000100:00100000:0.0:1746126992.646426:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994093952 00000100:00100000:0.0:1746126992.646428:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994093952 00000100:00100000:0.0:1746126992.646437:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20617 00000100:00100000:0.0:1746126992.646440:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3783:x1830945994093440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126992.646496:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3783:x1830945994093440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (106us total) trans 17179875442 rc 0/0 00000100:00100000:0.0:1746126992.646500:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20617 00000004:00080000:0.0:1746126992.646517:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3ce00/2, rc 0, transno 17179875442 00000100:00100000:0.0:1746126992.646520:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994093440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126992.646573:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ced4380/2, rc 0, transno 21474842682 00000100:00100000:0.0:1746126992.646576:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994093952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126992.646581:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c428000/2, rc 0, transno 21474842683 00000100:00100000:0.0:1746126992.646583:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994094464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126992.647174:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.653276:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.657278:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.657309:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.657345:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.657541:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8117 00000100:00100000:0.0:1746126992.657548:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991235584:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126992.658412:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.658462:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.664609:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.664693:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.666287:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.680188:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.686004:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.688430:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.688479:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.688518:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991237888 00000100:00100000:0.0:1746126992.688525:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991237888 00002000:00100000:0.0:1746126992.688569:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009ab0d180 x1830945991237888/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:753/0 lens 504/0 e 0 to 0 dl 1746127003 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126992.688580:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d180 with x1830945991237888 ext(2097152->4194303) 00002000:00010000:0.0:1746126992.688585:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0d180 00000100:00100000:0.0:1746126992.688602:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991237760 00000100:00100000:0.0:1746126992.688604:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991237760 00002000:00100000:0.0:1746126992.688616:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012d3fd880 x1830945991237760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:753/0 lens 488/0 e 0 to 0 dl 1746127003 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126992.688623:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fd880 with x1830945991237760 ext(2097152->4194303) 00002000:00010000:0.0:1746126992.688626:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fd880 00000100:00100000:0.0:1746126992.688649:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8124 00000100:00100000:0.0:1746126992.688656:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991237888:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126992.701837:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.710823:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.711828:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.714989:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.717690:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.723923:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.723996:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.733452:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.733498:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.745105:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.747476:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.747500:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.749996:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.751299:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.758026:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.762440:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.762499:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.762763:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.765549:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991241344 00000100:00100000:0.0:1746126992.765555:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991241344 00002000:00100000:0.0:1746126992.765594:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2355200->2359295) req@ffff880094b78e00 x1830945991241344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:753/0 lens 488/0 e 0 to 0 dl 1746127003 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126992.765603:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78e00 with x1830945991241344 ext(2355200->2359295) 00002000:00010000:0.0:1746126992.765608:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b78e00 00000100:00100000:0.0:1746126992.765635:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8132 00000100:00100000:0.0:1746126992.765645:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991241344:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126992.765775:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991241344:12345-192.168.203.42@tcp:3:cat.0 Request processed in 132us (347us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126992.765784:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8132 00002000:00100000:0.0:1746126992.765789:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2355200->2359295) req@ffff880094b78e00 x1830945991241344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:753/0 lens 488/4536 e 0 to 0 dl 1746127003 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126992.765795:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78e00 with x1830945991241344 ext(2355200->2359295) 00002000:00010000:0.0:1746126992.765798:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b78e00 00000100:00100000:0.0:1746126992.767599:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.873806:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.877006:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.882348:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.882401:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991242880 00000100:00100000:0.0:1746126992.882408:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991242880 00000100:00100000:0.0:1746126992.882451:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17052 00000100:00100000:0.0:1746126992.882458:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:3764:x1830945991242880:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126992.882477:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.882492:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47400/0x34dc807b6ef73df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51919 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.882555:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882566:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882574:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882584:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882593:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882598:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882671:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a46a00/0x34dc807b6ef73f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882678:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a46a00/0x34dc807b6ef73f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882684:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a46a00/0x34dc807b6ef73f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:0.0:1746126992.882691:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746126992.882740:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882745:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882750:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882755:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882760:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a47200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126992.882763:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882768:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882780:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126992.882783:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126992.882787:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882791:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47200/0x34dc807b6ef73e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882813:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882818:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882822:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882826:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a47a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126992.882828:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882832:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882839:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f700) 00010000:00010000:0.0:1746126992.882841:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126992.882843:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882847:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47a00/0x34dc807b6ef73ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126992.882875:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a47400/0x34dc807b6ef73df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51919 expref: 35 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.882885:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a46a00/0x34dc807b6ef73f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51919 expref: 34 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.882890:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126992.882892:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746126992.882894:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46a00, rc 0) 00000100:00100000:0.0:1746126992.882933:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:3764:x1830945991242880:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 475us (568us total) trans 8589937935 rc 0/0 00000100:00100000:0.0:1746126992.882939:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17052 00000100:00100000:0.0:1746126992.882967:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.886177:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.898890:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.901077:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.901517:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.910351:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.910371:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.911323:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.911336:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991244160 00000100:00100000:0.0:1746126992.911339:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991244160 00010000:00010000:0.0:1746126992.911352:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085b23200/0x34dc807b6ef72ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51871 expref: 40 pid: 16295 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746126992.911369:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9521 00000100:00100000:0.0:1746126992.911375:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991244032:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126992.911384:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126992.911398:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef725e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51839 expref: 14 pid: 11152 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746126992.911406:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef725e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51839 expref: 14 pid: 11152 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746126992.911761:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef725e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51839 expref: 14 pid: 11152 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746126992.911777:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.911779:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126992.911787:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.911795:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.911818:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126992.911851:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994097408:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126992.911975:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126992.913758:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.915648:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.916156:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.921566:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.928963:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.933611:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991245440 00000100:00100000:0.0:1746126992.933619:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991245440 00000100:00100000:0.0:1746126992.933886:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20630 00000100:00100000:0.0:1746126992.933894:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991245440:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.933908:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.933987:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a47200/0x34dc807b6ef743a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5193c expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126992.934031:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099420e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994097792:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126992.934111:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126992.946392:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.947160:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.948719:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.948904:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.951090:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.951210:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.951278:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.951315:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991246464 00000100:00100000:0.0:1746126992.951322:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991246464 00000100:00100000:0.0:1746126992.951362:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991246592 00000100:00100000:0.0:1746126992.951364:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991246592 00000100:00100000:0.0:1746126992.951373:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991246720 00000100:00100000:0.0:1746126992.951375:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991246720 00000100:00100000:0.0:1746126992.951388:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20631 00000100:00100000:0.0:1746126992.951395:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991246464:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.951410:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.951426:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a47e00/0x34dc807b6ef7464 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5194a expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126992.951479:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994097920:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126992.951543:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126992.961752:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.961809:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.978626:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991247360 00000100:00100000:0.0:1746126992.978635:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991247360 00000100:00100000:0.0:1746126992.978681:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20634 00000100:00100000:0.0:1746126992.978688:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:3770:x1830945991247360:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126992.978710:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126992.978728:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213f600/0x34dc807b6ef7479 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5195f expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.978758:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6ef73ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51904 expref: 32 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.978767:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126992.978769:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126992.978772:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012213f600/0x34dc807b6ef7479 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5195f expref: 19 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.978800:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6ef73ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51904 expref: 32 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126992.978815:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6ef73ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51904 expref: 32 pid: 12333 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126992.978833:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994098176:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126992.978929:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126992.980573:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.987465:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991247488:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 6725us (6885us total) trans 21474842684 rc 0/0 00000100:00100000:0.0:1746126992.987476:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1753 00002000:00100000:0.0:1746126992.987486:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1118208->2097151) req@ffff8800a2fdad80 x1830945991247488/t21474842684(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:753/0 lens 488/448 e 0 to 0 dl 1746127003 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126992.987494:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdad80 with x1830945991247488 ext(1118208->2097151) 00010000:00010000:0.0:1746126992.987501:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6ef73ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51904 expref: 35 pid: 12333 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126992.987515:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6ef73ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51904 expref: 35 pid: 12333 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126992.987521:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdad80 00000100:00100000:0.0:1746126992.990952:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.994440:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.995969:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126992.998998:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.002927:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.005082:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9525 00000100:00100000:0.0:1746126993.005097:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099614380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991248384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.005115:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.005148:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ae00/0x34dc807b6ef7322 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5188d expref: 17 pid: 7260 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.005162:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ae00/0x34dc807b6ef7322 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5188d expref: 17 pid: 7260 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.005195:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ae00/0x34dc807b6ef7322 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5188d expref: 17 pid: 7260 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.005229:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126993.005234:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef7495 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126993.005242:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef7495 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126993.005249:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef7495 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126993.005268:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126993.005323:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099614380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991248384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 232us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.005329:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9525 00000100:00100000:0.0:1746126993.005506:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.006910:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.008385:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.008415:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.008425:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.008447:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126993.009203:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126993.012433:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991248640:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 4506us (5517us total) trans 21474842685 rc 0/0 00000100:00100000:0.0:1746126993.012443:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1754 00002000:00100000:0.0:1746126993.012451:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2359295) req@ffff8800a2fca300 x1830945991248640/t21474842685(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:754/0 lens 488/448 e 0 to 0 dl 1746127004 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.012460:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fca300 with x1830945991248640 ext(2097152->2359295) 00010000:00010000:0.0:1746126993.012467:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6ef73b5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2359295) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5190b expref: 36 pid: 12333 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.012480:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6ef73b5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2359295) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5190b expref: 36 pid: 12333 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126993.012486:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fca300 00000100:00100000:0.0:1746126993.017762:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126993.018768:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126993.022825:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.026195:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.028533:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.028838:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.028881:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126993.030463:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126993.031299:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.031344:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.032363:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20641 00000100:00100000:0.0:1746126993.032375:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991250688:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126993.032392:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.032407:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e88ee00/0x34dc807b6ef74e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e519a5 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.032426:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.032428:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.032436:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e88ee00/0x34dc807b6ef74e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519a5 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.032450:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e88ee00/0x34dc807b6ef74e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519a5 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.032459:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e88ee00, rc 0) 00000100:00100000:0.0:1746126993.032585:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991250688:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 212us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.032592:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20641 00000100:00100000:0.0:1746126993.046589:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.046687:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991251456 00000100:00100000:0.0:1746126993.046691:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991251456 00000100:00100000:0.0:1746126993.046715:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991251712 00000100:00100000:0.0:1746126993.046717:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991251712 00000100:00100000:0.0:1746126993.047040:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20644 00000100:00100000:0.0:1746126993.047047:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991251712:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126993.047065:0:9611:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012158da00/0x34dc807b6ef750c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.047078:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c35cc00/0x34dc807b6ef7399 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518ef expref: 38 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.047090:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef74b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51989 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.047097:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c35d400/0x34dc807b6ef7472 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51958 expref: 23 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.047102:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.047104:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.047106:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012158da00/0x34dc807b6ef750c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.047152:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c35d400/0x34dc807b6ef7472 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51958 expref: 23 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.047160:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c35d400/0x34dc807b6ef7472 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51958 expref: 23 pid: 9613 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746126993.047169:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994099584:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126993.047201:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef74b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51989 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.047210:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef74b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51989 expref: 15 pid: 11152 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746126993.047218:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994099840:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126993.047691:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c35cc00/0x34dc807b6ef7399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518ef expref: 38 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.047700:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c35cc00/0x34dc807b6ef7399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e518ef expref: 38 pid: 12333 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.047709:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994100096:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126993.047730:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126993.047763:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.047793:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.048370:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.048611:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20646 00000100:00100000:0.0:1746126993.048619:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991251328:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126993.048639:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.048651:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.048656:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126993.048658:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126993.048660:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.048683:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.048696:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 23 pid: 12333 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.048704:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994100864:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126993.048721:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126993.056183:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056228:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056299:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056314:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056366:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994100864:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126993.056386:0:1507:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126993.056424:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056633:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056651:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056668:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991252864 00000100:00100000:0.0:1746126993.056670:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991252864 00002000:00100000:0.0:1746126993.056695:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1486848->1511423) req@ffff880094826a00 x1830945991252864/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 488/0 e 0 to 0 dl 1746127004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.056701:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094826a00 with x1830945991252864 ext(1486848->1511423) 00010000:00010000:0.0:1746126993.056706:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 25 pid: 12333 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.056717:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 25 pid: 12333 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126993.056721:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094826a00 00000100:00100000:0.0:1746126993.056731:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1755 00000100:00100000:0.0:1746126993.056734:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991252864:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126993.056804:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056822:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056832:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.056873:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.057224:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994100480:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126993.057234:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994100608:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126993.057242:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc800/0x34dc807b6ef7250 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5182b expref: 13 pid: 9612 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746126993.057254:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d288700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994100736:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126993.057269:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057357:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057364:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057381:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057387:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057393:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057399:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c35dc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126993.057402:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057407:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057413:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.057416:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef751a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126993.057446:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991251072:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 9010us (9684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.057452:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20645 00000100:00100000:0.0:1746126993.058756:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.058772:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.058784:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.058798:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991253376 00000100:00100000:0.0:1746126993.058803:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991253376 00000100:00100000:0.0:1746126993.058827:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991253504 00000100:00100000:0.0:1746126993.058829:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991253504 00000100:00100000:0.0:1746126993.058840:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991253632 00000100:00100000:0.0:1746126993.058841:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991253632 00000100:00100000:0.0:1746126993.059445:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20649 00000100:00100000:0.0:1746126993.059453:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991253504:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.059461:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.059473:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213e600/0x34dc807b6ef7536 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e519ba expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126993.059486:0:16295:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c88d, atime: 0x6813c88b, ctime: 0x6813c88d, blocks: 0x800 00010000:00010000:0.0:1746126993.059496:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.059497:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.059502:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213e600/0x34dc807b6ef7536 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519ba expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.059512:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213e600/0x34dc807b6ef7536 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519ba expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.059519:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e600, rc 0) 00000100:00100000:0.0:1746126993.059542:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991253504:12345-192.168.203.42@tcp:101:cat.0 Request processed in 91us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.059548:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20649 00000100:00100000:0.0:1746126993.059560:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20652 00000100:00100000:0.0:1746126993.059566:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991254016:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.059572:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.059577:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213ee00/0x34dc807b6ef754b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e519d6 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.059587:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.059594:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213ee00/0x34dc807b6ef754b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519d6 expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.059601:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213ee00/0x34dc807b6ef754b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519d6 expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.059609:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213ee00, rc 0) 00000100:00100000:0.0:1746126993.059624:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991254016:12345-192.168.203.42@tcp:101:cat.0 Request processed in 58us (280us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126993.059629:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20652 00000100:00100000:0.0:1746126993.060908:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.060938:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.060973:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126993.063463:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126993.063598:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991254656 00000100:00100000:0.0:1746126993.063601:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991254656 00010000:00010000:0.0:1746126993.063616:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 25 pid: 12333 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.063678:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9542 00000100:00100000:0.0:1746126993.063684:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991254656:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.063695:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.063705:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 25 pid: 12333 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.063715:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 25 pid: 12333 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.063783:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef7425 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1511423) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51927 expref: 25 pid: 12333 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.063794:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.063796:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.063799:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063806:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063822:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126993.063835:0:1507:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063842:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063852:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063862:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063868:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063872:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213f800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126993.063875:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063880:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063887:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.063892:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7521 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126993.064337:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991251328:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 15709us (16533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.064349:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20646 00000100:00100000:0.0:1746126993.064420:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991254656:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 735us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.064427:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9542 00000100:00100000:0.0:1746126993.064452:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991254784 00000100:00100000:0.0:1746126993.064459:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991254784 00000100:00100000:0.0:1746126993.064487:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20654 00000100:00100000:0.0:1746126993.064492:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:3770:x1830945991254784:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.064506:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.064521:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213fc00/0x34dc807b6ef757c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e519e4 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126993.064539:0:1507:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c88f, atime: 0x6813c88f, ctime: 0x6813c88f, blocks: 0x14e0 00010000:00010000:0.0:1746126993.064554:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.064556:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.064562:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012213fc00/0x34dc807b6ef757c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519e4 expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.064574:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213fc00/0x34dc807b6ef757c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519e4 expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.064582:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fc00, rc 0) 00000100:00100000:0.0:1746126993.064609:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:3770:x1830945991254784:12345-192.168.203.42@tcp:101:cat.0 Request processed in 116us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.064614:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20654 00000100:00100000:0.0:1746126993.065829:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.066023:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.066701:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.069854:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.070374:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991256320 00000100:00100000:0.0:1746126993.070378:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991256320 00000100:00100000:0.0:1746126993.070397:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20656 00000100:00100000:0.0:1746126993.070400:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991256320:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.070406:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.070414:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213fa00/0x34dc807b6ef75a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e519f9 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.070423:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.070424:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.070428:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213fa00/0x34dc807b6ef75a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519f9 expref: 38 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.070435:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213fa00/0x34dc807b6ef75a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e519f9 expref: 38 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.070439:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fa00, rc 0) 00000100:00100000:0.0:1746126993.070453:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991256320:12345-192.168.203.42@tcp:101:cat.0 Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.070457:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20656 00000100:00100000:0.0:1746126993.070585:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991255552:12345-192.168.203.42@tcp:3:cat.0 Request processed in 3738us (3886us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746126993.070590:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8144 00002000:00100000:0.0:1746126993.070595:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a7c51180 x1830945991255552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 488/440 e 0 to 0 dl 1746127004 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.070601:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51180 with x1830945991255552 ext(4194304->4829183) 00002000:00010000:0.0:1746126993.070604:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c51180 00000100:00100000:0.0:1746126993.070686:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991256832 00000100:00100000:0.0:1746126993.070689:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991256832 00000100:00100000:0.0:1746126993.070703:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20658 00000100:00100000:0.0:1746126993.070719:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991256832:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.070726:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.070795:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef75b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51a07 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.070807:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.070809:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.070813:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef75b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51a07 expref: 37 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.070823:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef75b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51a07 expref: 37 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.070830:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e000, rc 0) 00000100:00100000:0.0:1746126993.070848:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991256832:12345-192.168.203.42@tcp:101:cat.0 Request processed in 128us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.070853:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20658 00000100:00100000:0.0:1746126993.070923:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991256960 00000100:00100000:0.0:1746126993.070926:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991256960 00010000:00010000:0.0:1746126993.071006:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef73d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51912 expref: 37 pid: 10958 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.071021:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9547 00000100:00100000:0.0:1746126993.071026:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991256960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.071031:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.071035:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef73d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51912 expref: 37 pid: 10958 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.071042:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef73d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51912 expref: 37 pid: 10958 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.071053:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef73d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51912 expref: 37 pid: 10958 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.071061:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126993.071064:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4400/0x34dc807b6ef7583 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126993.071070:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4400/0x34dc807b6ef7583 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126993.071074:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4400/0x34dc807b6ef7583 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126993.071089:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126993.071105:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991256960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.071110:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9547 00000100:00100000:0.0:1746126993.073961:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.074126:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.075652:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994103168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.075686:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994103808 00000100:00100000:0.0:1746126993.075689:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994103808 00000100:00100000:0.0:1746126993.075707:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20671 00000100:00100000:0.0:1746126993.075712:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3783:x1830945994103808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126993.075777:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746126993.075779:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126993.075781:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126993.075783:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126993.075785:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746126993.075809:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3783:x1830945994103808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (138us total) trans 17179875446 rc 0/0 00000100:00100000:0.0:1746126993.075815:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20671 00000100:00100000:0.0:1746126993.075832:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.075844:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994103680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.075860:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.075891:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994103424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.075907:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.075916:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994103936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.075930:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.075942:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746126993.075946:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994104064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.075962:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.075983:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20676 00000100:00100000:0.0:1746126993.075988:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3784:x1830945994104064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.076050:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3784:x1830945994104064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (88us total) trans 17179875451 rc 0/0 00000100:00100000:0.0:1746126993.076055:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20676 00000100:00100000:0.0:1746126993.076066:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20677 00000100:00100000:0.0:1746126993.076070:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3785:x1830945994103552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126993.076109:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126993.076112:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126993.076114:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:0.0:1746126993.076115:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126993.076146:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746126993.076186:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3785:x1830945994103552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (188us total) trans 17179875452 rc 0/0 00000100:00100000:0.0:1746126993.076191:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20677 00000004:00080000:0.0:1746126993.076211:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099423100/2, rc 0, transno 17179875451 00000100:00100000:0.0:1746126993.076215:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994104064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126993.076221:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c5bca80/2, rc 0, transno 17179875449 00000100:00100000:0.0:1746126993.076230:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994103424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126993.076236:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0dc00/2, rc 0, transno 17179875450 00000100:00100000:0.0:1746126993.076239:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994103936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.077149:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.077225:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.079080:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.079240:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.081037:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.081078:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.082641:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.082717:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.087328:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.087366:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.087395:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.087420:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991259136 00000100:00100000:0.0:1746126993.087426:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991259136 00002000:00100000:0.0:1746126993.087459:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880094b79880 x1830945991259136/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:754/0 lens 488/0 e 0 to 0 dl 1746127004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.087467:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b79880 with x1830945991259136 ext(0->1048575) 00002000:00010000:0.0:1746126993.087472:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b79880 00000100:00100000:0.0:1746126993.087486:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991259648 00000100:00100000:0.0:1746126993.087489:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991259648 00002000:00100000:0.0:1746126993.087499:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880094b7b480 x1830945991259648/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:754/0 lens 488/0 e 0 to 0 dl 1746127004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.087506:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b7b480 with x1830945991259648 ext(1048576->2097151) 00002000:00010000:0.0:1746126993.087508:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094b7b480 00000100:00100000:0.0:1746126993.087529:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8147 00000100:00100000:0.0:1746126993.087534:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991259264:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126993.088108:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.088942:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.100044:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.102696:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.102758:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.105456:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a178b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994105088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126993.105494:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.105517:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994105600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126993.105541:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.105554:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126993.105559:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994105216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126993.105571:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.105581:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994105728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126993.105592:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.105659:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994106112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.105674:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.105682:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994106624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.105693:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.105700:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126993.105704:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994106240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.105714:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126993.105720:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994106752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126993.105733:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126993.105749:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a178b800/2, rc 0, transno 21474842695 00000100:00100000:0.0:1746126993.105755:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a178b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994105088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126993.106894:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c00000/2, rc 0, transno 21474842703 00000100:00100000:0.0:1746126993.106897:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994106880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126993.106903:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a1789180/2, rc 0, transno 21474842701 00000100:00100000:0.0:1746126993.106905:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994104832:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126993.106910:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880123477480/2, rc 0, transno 21474842702 00000100:00100000:0.0:1746126993.106913:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994105344:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126993.106919:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b4000/2, rc 0, transno 17179875458 00000100:00100000:0.0:1746126993.106921:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994105856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126993.106927:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22dc00/2, rc 0, transno 17179875459 00000100:00100000:0.0:1746126993.106929:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994106368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126993.106934:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b5c00/2, rc 0, transno 17179875454 00000100:00100000:0.0:1746126993.106936:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994105984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126993.106941:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22ca80/2, rc 0, transno 17179875455 00000100:00100000:0.0:1746126993.106943:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994106496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126993.106952:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a1788700/2, rc 0, transno 21474842696 00000100:00100000:0.0:1746126993.106954:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994104960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126993.106959:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880123474000/2, rc 0, transno 21474842700 00000100:00100000:0.0:1746126993.106962:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994105472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126993.117746:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.121763:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.126454:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.126481:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.126500:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.126749:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.126940:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8152 00000100:00100000:0.0:1746126993.126947:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991261824:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126993.141079:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.145898:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.156470:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.156506:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.156674:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.166451:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991264128 00000100:00100000:0.0:1746126993.166457:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991264128 00002000:00100000:0.0:1746126993.166486:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (2084864->2088959) req@ffff88011dc63480 x1830945991264128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 488/0 e 0 to 0 dl 1746127004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.166494:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63480 with x1830945991264128 ext(2084864->2088959) 00002000:00010000:0.0:1746126993.166498:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63480 00000100:00100000:0.0:1746126993.166528:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8157 00000100:00100000:0.0:1746126993.166534:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991264128:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126993.166625:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991264128:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 91us (426us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126993.166630:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8157 00002000:00100000:0.0:1746126993.166635:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (2084864->2088959) req@ffff88011dc63480 x1830945991264128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 488/4536 e 0 to 0 dl 1746127004 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.166641:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63480 with x1830945991264128 ext(2084864->2088959) 00002000:00010000:0.0:1746126993.166643:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63480 00000100:00100000:0.0:1746126993.176640:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.180024:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.183573:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.184451:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.188057:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.189452:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.199811:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.204124:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.204227:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.204770:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20702 00000100:00100000:0.0:1746126993.204782:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991265664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.204806:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.204821:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967fdc00/0x34dc807b6ef7655 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51a77 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.204848:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967fdc00/0x34dc807b6ef7655 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51a77 expref: 39 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.204863:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967fdc00/0x34dc807b6ef7655 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51a77 expref: 39 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.204879:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fdc00, rc 0) 00000100:00100000:0.0:1746126993.204911:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991265664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 134us (685us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126993.204917:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20702 00000100:00100000:0.0:1746126993.208718:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.216338:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.216391:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.220942:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.220991:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.268125:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.301354:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.301412:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.309594:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.311453:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.311496:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.313904:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.315102:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.317069:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.318027:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.318084:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.319074:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.320199:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.320227:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.320722:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.321031:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.321964:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991268864:12345-192.168.203.42@tcp:4:cat.0 Request processed in 605us (931us total) trans 21474842705 rc 0/0 00000100:00100000:0.0:1746126993.321973:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1757 00002000:00100000:0.0:1746126993.321981:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (2084864->2097151) req@ffff88009cbb3100 x1830945991268864/t21474842705(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 12776/448 e 0 to 0 dl 1746127004 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.321989:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb3100 with x1830945991268864 ext(2084864->2097151) 00010000:00010000:0.0:1746126993.321997:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5800/0x34dc807b6ef7639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51a5b expref: 22 pid: 3542 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.322010:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5800/0x34dc807b6ef7639 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51a5b expref: 22 pid: 3542 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126993.322331:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cbb3100 00000100:00100000:0.0:1746126993.323839:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.326958:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.326997:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.330751:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.337223:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.345237:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.348495:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.348515:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.351046:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.351075:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.351089:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.351107:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991271296 00000100:00100000:0.0:1746126993.351111:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991271296 00000100:00100000:0.0:1746126993.351168:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991271552 00000100:00100000:0.0:1746126993.351171:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991271552 00000100:00100000:0.0:1746126993.351183:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991271808 00000100:00100000:0.0:1746126993.351185:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991271808 00000100:00100000:0.0:1746126993.351197:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20714 00000100:00100000:0.0:1746126993.351202:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991271296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.351214:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.351227:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a02c00/0x34dc807b6ef770b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51ae7 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.351241:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.351243:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.351248:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a02c00/0x34dc807b6ef770b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ae7 expref: 39 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.351261:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a02c00/0x34dc807b6ef770b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ae7 expref: 39 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.351268:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a02c00, rc 0) 00000100:00100000:0.0:1746126993.351285:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991271296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.351290:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20714 00000100:00100000:0.0:1746126993.351301:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20716 00000100:00100000:0.0:1746126993.351305:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991271808:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.351311:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.351317:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a02400/0x34dc807b6ef7719 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51af5 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126993.351340:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cbb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994110464:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126993.351363:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126993.351441:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.351453:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991271936 00000100:00100000:0.0:1746126993.351455:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991271936 00000100:00100000:0.0:1746126993.351472:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20717 00000100:00100000:0.0:1746126993.351476:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991271936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.351482:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.351489:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6ef7720 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51afc expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.351503:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6ef7720 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51afc expref: 40 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.351511:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6ef7720 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51afc expref: 40 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.351528:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098672600, rc 0) 00000100:00100000:0.0:1746126993.351544:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991271936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 67us (103us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126993.351549:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20717 00000100:00100000:0.0:1746126993.353086:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.355437:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.356277:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.368298:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.369608:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.370444:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.371957:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.378334:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.381267:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.382094:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.388920:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.399618:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.403410:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.403766:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.403836:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.412651:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.415766:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.424271:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.424304:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.424638:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.425029:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8176 00000100:00100000:0.0:1746126993.425037:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991275904:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126993.428182:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.434615:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.434653:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.434686:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.434947:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20725 00000100:00100000:0.0:1746126993.434954:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991276672:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.434963:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.434976:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96c00/0x34dc807b6ef7758 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51b34 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.434994:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96c00/0x34dc807b6ef7758 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b34 expref: 26 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.435002:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96c00/0x34dc807b6ef7758 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b34 expref: 26 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.435016:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e96c00, rc 0) 00000100:00100000:0.0:1746126993.435045:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991276672:12345-192.168.203.42@tcp:101:cat.0 Request processed in 92us (357us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126993.435200:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20725 00000100:00100000:0.0:1746126993.437302:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.439709:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.442842:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.453748:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.456457:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.459388:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.462308:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.462348:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.464058:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.466728:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.469261:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.530851:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.530893:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.530925:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.530982:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.531013:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991279104 00000100:00100000:0.0:1746126993.531017:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991279104 00000100:00100000:0.0:1746126993.531046:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991279232 00000100:00100000:0.0:1746126993.531048:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991279232 00000100:00100000:0.0:1746126993.560721:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.565954:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.566844:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.572046:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.572606:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.572643:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.572675:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991280640 00000100:00100000:0.0:1746126993.572678:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991280640 00000100:00100000:0.0:1746126993.572705:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 996 00000100:00100000:0.0:1746126993.572710:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991280640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.572718:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.572738:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6ef77c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b57 expref: 38 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.572756:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126993.572759:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126993.572779:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991280640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.572784:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 996 00000100:00100000:0.0:1746126993.580415:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.586237:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.588325:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.588361:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.588376:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991281792 00000100:00100000:0.0:1746126993.588379:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991281792 00000100:00100000:0.0:1746126993.588405:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 997 00000100:00100000:0.0:1746126993.588411:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991281792:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.588420:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.588438:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef77f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b6c expref: 18 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.588452:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126993.588455:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126993.588473:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991281792:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.588478:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 997 00000100:00100000:0.0:1746126993.590690:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.593228:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.593928:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991282432 00000100:00100000:0.0:1746126993.593934:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991282432 00010000:00010000:0.0:1746126993.593959:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef7789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 188416->364543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b49 expref: 44 pid: 1507 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.593996:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9571 00000100:00100000:0.0:1746126993.594002:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991282432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.594012:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.594028:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef7789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 188416->364543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b49 expref: 44 pid: 1507 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.594038:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef7789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 188416->364543) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b49 expref: 44 pid: 1507 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.594060:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012158de00/0x34dc807b6ef7789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 188416->364543) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b49 expref: 44 pid: 1507 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.594071:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.594072:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126993.594078:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7200/0x34dc807b6ef77dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b65 expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.594084:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7200/0x34dc807b6ef77dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b65 expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.594110:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7200/0x34dc807b6ef77dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b65 expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.594159:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7200/0x34dc807b6ef77dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b65 expref: 25 pid: 1507 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.594169:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096631880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994112256:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126993.594243:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126993.598682:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.598996:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.599162:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.599179:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991282944 00000100:00100000:0.0:1746126993.599182:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991282944 00002000:00100000:0.0:1746126993.599199:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880096630380 x1830945991282944/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 488/0 e 0 to 0 dl 1746127004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.599210:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630380 with x1830945991282944 ext(0->1048575) 00010000:00010000:0.0:1746126993.599214:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7200/0x34dc807b6ef77dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b65 expref: 26 pid: 1507 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.599224:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7200/0x34dc807b6ef77dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b65 expref: 26 pid: 1507 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126993.599229:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096630380 00000100:00100000:0.0:1746126993.599240:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1764 00000100:00100000:0.0:1746126993.599245:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991282944:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126993.603785:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.608200:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.608794:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.612272:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.614992:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.616176:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.616202:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.616219:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.616239:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.617937:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.617982:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.618955:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.622552:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.625061:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.625170:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.627444:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.627604:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.632632:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.635467:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.638207:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.641599:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.701985:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.705287:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.705325:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.705390:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.709492:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.712351:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.713995:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.714883:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.714929:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.721044:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.725106:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.735203:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.737531:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.739947:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.739994:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.746230:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.748570:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991289600 00000100:00100000:0.0:1746126993.748578:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991289600 00002000:00100000:0.0:1746126993.748617:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9c:0x0] (507904->516095) req@ffff88011dc63100 x1830945991289600/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 8680/0 e 0 to 0 dl 1746127004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.748627:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63100 with x1830945991289600 ext(507904->516095) 00010000:00010000:0.0:1746126993.748635:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7e00/0x34dc807b6ef782a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->516095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b7a expref: 23 pid: 1507 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.748649:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7e00/0x34dc807b6ef782a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->516095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b7a expref: 23 pid: 1507 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126993.748655:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011dc63100 00000100:00100000:0.0:1746126993.748687:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1765 00000100:00100000:0.0:1746126993.748694:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991289600:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126993.749696:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991289600:12345-192.168.203.42@tcp:4:cat.0 Request processed in 999us (1198us total) trans 21474842709 rc 0/0 00000100:00100000:0.0:1746126993.749704:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1765 00002000:00100000:0.0:1746126993.749710:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9c:0x0] (507904->516095) req@ffff88011dc63100 x1830945991289600/t21474842709(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 8680/448 e 0 to 0 dl 1746127004 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.749718:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63100 with x1830945991289600 ext(507904->516095) 00010000:00010000:0.0:1746126993.749724:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7e00/0x34dc807b6ef782a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->516095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b7a expref: 25 pid: 1507 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.749736:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7e00/0x34dc807b6ef782a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->516095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b7a expref: 25 pid: 1507 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126993.749742:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011dc63100 00000100:00100000:0.0:1746126993.751330:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.757329:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.757360:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.773199:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.780211:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.782821:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.785429:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.842463:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.854202:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.854240:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.854286:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.855819:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.858449:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.859561:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991291776 00000100:00100000:0.0:1746126993.859568:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991291776 00010000:00010000:0.0:1746126993.859597:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7942 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c29 expref: 27 pid: 1507 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746126993.859626:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9583 00000100:00100000:0.0:1746126993.859633:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991291776:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.859645:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.859660:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7942 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c29 expref: 27 pid: 1507 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746126993.859670:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c29 expref: 27 pid: 1507 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746126993.859688:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7942 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c29 expref: 27 pid: 1507 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746126993.859705:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126993.859725:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991291776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 93us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.859734:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9583 00000100:00100000:0.0:1746126993.861466:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.865055:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.865217:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994115072:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126993.865235:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6ef795e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c45 expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.865250:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8df800, rc 0) 00000100:00100000:0.0:1746126993.865319:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+27:3827:x1830945991292032:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2555us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.865326:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20753 00000100:00100000:0.0:1746126993.869595:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991292544 00000100:00100000:0.0:1746126993.869604:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991292544 00002000:00100000:0.0:1746126993.869651:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (540672->544767) req@ffff8800a2fd8000 x1830945991292544/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:754/0 lens 488/0 e 0 to 0 dl 1746127004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126993.869661:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd8000 with x1830945991292544 ext(540672->544767) 00010000:00010000:0.0:1746126993.869669:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6ef7957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->544767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c3e expref: 26 pid: 16295 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.869684:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6ef7957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->544767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c3e expref: 26 pid: 16295 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746126993.869691:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fd8000 00000100:00100000:0.0:1746126993.869712:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1767 00000100:00100000:0.0:1746126993.870369:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991292544:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126993.875763:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.876176:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.884978:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.889693:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.910693:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.910754:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.910844:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20755 00000100:00100000:0.0:1746126993.910851:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2029:x1830945991293696:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126993.910863:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126993.910881:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6ef7965 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51c53 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.910912:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6ef7965 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c53 expref: 46 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.910922:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6ef7965 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c53 expref: 46 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126993.910949:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c37400, rc 0) 00000100:00100000:0.0:1746126993.910983:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991293696:12345-192.168.203.42@tcp:101:cat.0 Request processed in 133us (228us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126993.910989:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20755 00000100:00100000:0.0:1746126993.914563:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.917337:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.918929:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.928476:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.932157:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.943572:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.948255:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.954382:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.954751:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.954777:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991295232 00000100:00100000:0.0:1746126993.954782:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991295232 00010000:00010000:0.0:1746126993.954815:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369400/0x34dc807b6ef7934 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c22 expref: 21 pid: 11634 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.954838:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991295360 00000100:00100000:0.0:1746126993.954840:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991295360 00010000:00010000:0.0:1746126993.954848:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369200/0x34dc807b6ef78e7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51bf1 expref: 45 pid: 11634 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.954872:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9587 00000100:00100000:0.0:1746126993.954878:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991295232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.954889:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.954893:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369400/0x34dc807b6ef7934 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c22 expref: 21 pid: 11634 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.954902:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369400/0x34dc807b6ef7934 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c22 expref: 21 pid: 11634 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.954922:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369400/0x34dc807b6ef7934 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c22 expref: 21 pid: 11634 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.955614:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126993.955619:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef7988 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126993.955626:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef7988 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126993.955630:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126993.955652:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991295232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 774us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.955658:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9587 00000100:00100000:0.0:1746126993.955691:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991295488 00000100:00100000:0.0:1746126993.955694:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991295488 00010000:00010000:0.0:1746126993.955702:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6ef78a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51bce expref: 9 pid: 11634 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746126993.955713:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9589 00000100:00100000:0.0:1746126993.955718:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991295488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126993.955723:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126993.955727:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6ef78a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51bce expref: 9 pid: 11634 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.955734:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6ef78a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51bce expref: 9 pid: 11634 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.955744:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6ef78a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51bce expref: 9 pid: 11634 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746126993.955753:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126993.955756:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef7988 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126993.955766:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef7988 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126993.955772:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef7988 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126993.955785:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126993.955802:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991295488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 84us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.955807:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9589 00000100:00100000:0.0:1746126993.956684:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.957702:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994115968:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126993.957726:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011ea87600/0x34dc807b6ef798f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c6f expref: 29 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126993.957740:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea87600, rc 0) 00000100:00100000:0.0:1746126993.957778:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+29:3827:x1830945991295104:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2218us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126993.957784:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20758 00000100:00100000:0.0:1746126993.959302:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.968292:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.974869:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.975686:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.981435:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.981518:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.988697:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.990296:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.990334:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126993.994353:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.002678:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.002730:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.006712:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.006759:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.006809:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.012543:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.012589:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.013546:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.014029:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8199 00000100:00100000:0.0:1746126994.014037:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2029:x1830945991298560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126994.026659:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.034075:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.034165:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126994.034412:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126994.040853:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.047243:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.064170:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991300352 00000100:00100000:0.0:1746126994.064174:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991300352 00000100:00100000:0.0:1746126994.064203:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20766 00000100:00100000:0.0:1746126994.064208:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+28:3827:x1830945991300352:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126994.064216:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.064225:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2c00/0x34dc807b6ef79ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51cae expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.064241:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef79ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3383295) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c84 expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.064248:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126994.064250:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126994.064253:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2c00/0x34dc807b6ef79ea lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cae expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.064268:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef79ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3383295) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c84 expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.064275:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef79ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3383295) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c84 expref: 42 pid: 12340 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746126994.064282:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994117632:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.064311:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.067540:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.067581:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.067851:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991300736 00000100:00100000:0.0:1746126994.067854:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991300736 00002000:00100000:0.0:1746126994.068147:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3383295) req@ffff880094824a80 x1830945991300736/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:0/0 lens 488/0 e 0 to 0 dl 1746127005 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126994.068157:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824a80 with x1830945991300736 ext(3145728->3383295) 00010000:00010000:0.0:1746126994.068163:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef79ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c84 expref: 43 pid: 12340 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.068172:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef79ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51c84 expref: 43 pid: 12340 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746126994.068184:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094824a80 00000100:00100000:0.0:1746126994.068209:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1772 00000100:00100000:0.0:1746126994.068215:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991300736:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126994.069178:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126994.069508:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea200/0x34dc807b6ef79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069515:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea200/0x34dc807b6ef79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:0.0:1746126994.069545:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126994.069549:0:11634:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126994.069560:0:11634:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea200/0x34dc807b6ef79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069567:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea200/0x34dc807b6ef79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069576:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069581:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069586:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069591:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069596:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126994.069599:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069605:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069613:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126994.069615:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126994.069617:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069622:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef79d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069657:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6ef79dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069662:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6ef79dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069667:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6ef79dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069670:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126994.069673:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6ef79dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069677:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6ef79dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069684:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662ef00) 00010000:00010000:0.0:1746126994.069686:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126994.069688:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6ef79dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069696:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6ef79dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.069724:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef79ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ca7 expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.069735:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea200/0x34dc807b6ef79e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ca7 expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.069741:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126994.069743:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126994.069745:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caea200, rc 0) 00000100:00100000:0.0:1746126994.069769:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:3836:x1830945991300224:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 5992us (6166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.069776:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17084 00000001:00080000:0.0:1746126994.075583:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875463 is committed 00000001:00080000:0.0:1746126994.075591:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875462 is committed 00000001:00080000:0.0:1746126994.075599:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875460 is committed 00000001:00080000:0.0:1746126994.075636:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875434 is committed 00000100:00080000:0.0:1746126994.076403:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126994.079329:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.082537:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.084008:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.084593:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.085196:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8205 00000100:00100000:0.0:1746126994.085203:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991302400:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126994.099833:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.099879:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.101681:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.108181:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.109222:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.109240:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991303808 00000100:00100000:0.0:1746126994.109243:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991303808 00010000:00010000:0.0:1746126994.109259:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef7a30 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cdf expref: 12 pid: 11634 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746126994.109276:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9600 00000100:00100000:0.0:1746126994.109281:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991303808:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126994.109288:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126994.109292:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef7a30 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cdf expref: 12 pid: 11634 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.109301:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef7a30 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cdf expref: 12 pid: 11634 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.109312:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126994.109315:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099158800/0x34dc807b6ef7a45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.109322:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158800/0x34dc807b6ef7a45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.109326:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099158800/0x34dc807b6ef7a45 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.109338:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126994.109353:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991303808:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.109359:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9600 00000100:00100000:0.0:1746126994.111166:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.111197:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.111223:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.111235:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991304064 00000100:00100000:0.0:1746126994.111238:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991304064 00000100:00100000:0.0:1746126994.111275:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20773 00000100:00100000:0.0:1746126994.111283:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991304064:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126994.111305:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6ef7a5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.111319:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89200/0x34dc807b6ef7727 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b03 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.111327:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011ea86800/0x34dc807b6ef7869 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ba4 expref: 9 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.111334:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a02400/0x34dc807b6ef7751 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b2d expref: 8 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.111339:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.111340:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.111342:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6ef7a5a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.111363:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a02400/0x34dc807b6ef7751 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b2d expref: 8 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.111375:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a02400/0x34dc807b6ef7751 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b2d expref: 8 pid: 9612 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.111384:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994118528:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126994.111450:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011ea86800/0x34dc807b6ef7869 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ba4 expref: 9 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.111457:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011ea86800/0x34dc807b6ef7869 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ba4 expref: 9 pid: 12333 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.111464:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994118656:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126994.111489:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89200/0x34dc807b6ef7727 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b03 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.111496:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89200/0x34dc807b6ef7727 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b03 expref: 28 pid: 9612 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746126994.111504:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a178aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994118912:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.111519:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.111542:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.111564:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.113813:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.122495:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.122515:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.122533:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991304832 00000100:00100000:0.0:1746126994.122538:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991304832 00010000:00010000:0.0:1746126994.122560:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011ea86800/0x34dc807b6ef7869 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ba4 expref: 12 pid: 12333 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.122580:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9601 00000100:00100000:0.0:1746126994.122585:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991304832:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126994.122596:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126994.122616:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011ea86800/0x34dc807b6ef7869 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ba4 expref: 12 pid: 12333 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746126994.122624:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011ea86800/0x34dc807b6ef7869 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ba4 expref: 12 pid: 12333 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746126994.122837:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011ea86800/0x34dc807b6ef7869 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ba4 expref: 12 pid: 12333 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746126994.122880:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126994.122896:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991304832:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 310us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.123080:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9601 00000100:00100000:0.0:1746126994.123157:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123176:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123186:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123197:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123205:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123214:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123224:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123232:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123240:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123250:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123259:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.123297:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.125296:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.125317:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126994.125711:0:12333:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125717:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125727:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125732:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125737:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125741:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7d29a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126994.125744:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125752:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125761:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.125766:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29a00/0x34dc807b6ef7a7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126994.125794:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991304448:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 13379us (14229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.125798:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20777 00000100:00100000:0.0:1746126994.127670:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.127743:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.128949:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.131242:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.235885:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.243228:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.245010:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.248849:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.249284:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8211 00000100:00100000:0.0:1746126994.249292:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991309568:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126994.249954:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991309568:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 657us (1107us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126994.249961:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8211 00002000:00100000:0.0:1746126994.249967:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (475136->479231) req@ffff880130a77480 x1830945991309568/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:0/0 lens 488/4536 e 0 to 0 dl 1746127005 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126994.249975:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77480 with x1830945991309568 ext(475136->479231) 00002000:00010000:0.0:1746126994.249978:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a77480 00000100:00100000:0.0:1746126994.254335:0:7265:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994121216 00000100:00100000:0.0:1746126994.254342:0:7265:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994121216 00000100:00100000:0.0:1746126994.254388:0:7265:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1746126994.254395:0:7265:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3782:x1830945994121216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746126994.254423:0:7265:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445584896 avail 1316122624 00000100:00100000:0.0:1746126994.254462:0:7265:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3782:x1830945994121216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.254468:0:7265:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1746126994.269351:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994121728:0@lo:400:kworker.0 00000100:00100000:0.0:1746126994.269592:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126994.269929:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994121728 00000100:00100000:0.0:1746126994.269932:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994121728 00000100:00080000:0.0:1746126994.269947:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126994.269968:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1746126994.269973:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994121728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126994.270001:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994121728:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.270006:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1746126994.270020:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994121856 00000100:00100000:0.0:1746126994.270022:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994121856 00000100:00100000:0.0:1746126994.270038:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994122496 00000100:00100000:0.0:1746126994.270040:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994122496 00000100:00100000:0.0:1746126994.270050:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1746126994.270056:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3784:x1830945994121856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126994.270077:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3784:x1830945994121856:12345-0@lo:400:kworker.0 Request processed in 23us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.270082:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00080000:0.0:1746126994.270090:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126994.270220:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746126994.270222:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746126994.270420:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994122112 00000100:00100000:0.0:1746126994.270424:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994122112 00000100:00100000:0.0:1746126994.270445:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994122240 00000100:00100000:0.0:1746126994.270446:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994122240 00000100:00100000:0.0:1746126994.270464:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1746126994.270468:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3782:x1830945994122112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126994.270493:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3782:x1830945994122112:12345-0@lo:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.270497:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1746126994.270505:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1746126994.270509:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3783:x1830945994122752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746126994.270527:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3783:x1830945994122752:12345-0@lo:400:kworker.0 Request processed in 18us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.270531:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00080000:0.0:1746126994.270541:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746126994.270542:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1746126994.270902:0:8233:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 51 in progress, 0 in flight, 5 done 00000004:00080000:0.0:1746126994.271106:0:8233:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 51 done 00000100:00100000:0.0:1746126994.338361:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991309824 00000100:00100000:0.0:1746126994.338370:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991309824 00000100:00100000:0.0:1746126994.342285:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.342318:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.342335:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.342359:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.342394:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.342412:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991310464 00000100:00100000:0.0:1746126994.342415:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991310464 00000100:00100000:0.0:1746126994.342447:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991310592 00000100:00100000:0.0:1746126994.342449:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991310592 00000100:00100000:0.0:1746126994.342462:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991310848 00000100:00100000:0.0:1746126994.342464:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991310848 00000100:00100000:0.0:1746126994.342484:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20786 00000100:00100000:0.0:1746126994.342491:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991310336:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126994.342502:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.342518:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6ef7aca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51d2c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.342540:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.342541:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.342550:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6ef7aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d2c expref: 29 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.342564:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6ef7aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d2c expref: 29 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.342574:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e2400, rc 0) 00000100:00100000:0.0:1746126994.342623:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991310336:12345-192.168.203.42@tcp:101:cat.0 Request processed in 131us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.342629:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20786 00000100:00100000:0.0:1746126994.342650:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20788 00000100:00100000:0.0:1746126994.342656:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991310720:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126994.342663:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.342671:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d9e2200/0x34dc807b6ef7adf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51d41 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.342682:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.342683:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.342687:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e2200/0x34dc807b6ef7adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d41 expref: 50 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.342696:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d9e2200/0x34dc807b6ef7adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d41 expref: 50 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.342703:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e2200, rc 0) 00000100:00100000:0.0:1746126994.342721:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991310720:12345-192.168.203.42@tcp:101:cat.0 Request processed in 65us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.342726:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20788 00000100:00100000:0.0:1746126994.344810:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.352043:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.352075:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.352549:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.352582:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.360332:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:2027:x1830945991311104:12345-192.168.203.42@tcp:4:cat.0 Request processed in 8025us (8291us total) trans 21474842714 rc 0/0 00000100:00100000:0.0:1746126994.360343:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1773 00002000:00100000:0.0:1746126994.360354:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (245760->479231) req@ffff880130a77b80 x1830945991311104/t21474842714(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:0/0 lens 488/448 e 0 to 0 dl 1746127005 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126994.360369:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77b80 with x1830945991311104 ext(245760->479231) 00010000:00010000:0.0:1746126994.360377:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096620600/0x34dc807b6ef7aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->479231) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d02 expref: 53 pid: 16295 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.360389:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096620600/0x34dc807b6ef7aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->479231) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d02 expref: 53 pid: 16295 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746126994.360396:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a77b80 00000100:00100000:0.0:1746126994.363656:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.365270:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746126994.365281:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994123776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746126994.365314:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126994.365732:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994123776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746126994.368310:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.368382:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.373626:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.375983:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.376013:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.378237:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.378251:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.378275:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.388280:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.390513:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.390568:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.390630:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.390651:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991314176 00000100:00100000:0.0:1746126994.390656:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991314176 00010000:00010000:0.0:1746126994.390686:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef7a84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cf4 expref: 10 pid: 9613 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746126994.390706:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991314432 00000100:00100000:0.0:1746126994.390707:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991314432 00010000:00010000:0.0:1746126994.390714:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096621a00/0x34dc807b6ef7ab5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d1e expref: 28 pid: 1507 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.390723:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991314304 00000100:00100000:0.0:1746126994.390725:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991314304 00010000:00010000:0.0:1746126994.390733:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e2200/0x34dc807b6ef7adf lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d41 expref: 51 pid: 12340 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.390744:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9625 00000100:00100000:0.0:1746126994.390750:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991314176:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126994.390760:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746126994.390776:0:7246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126992 -> 1746126993 00010000:00010000:0.0:1746126994.390782:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef7a84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cf4 expref: 10 pid: 9613 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.390791:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef7a84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1568767) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cf4 expref: 10 pid: 9613 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.390813:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef7a84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1568767) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51cf4 expref: 10 pid: 9613 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.390834:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.390836:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.390842:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b22c00/0x34dc807b6ef7afb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d5d expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.390849:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22c00/0x34dc807b6ef7afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d5d expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.390874:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880085b22c00/0x34dc807b6ef7afb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d5d expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126994.390883:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994124544:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126994.390922:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.393017:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.393717:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.394272:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.398680:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.399456:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.405272:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.409413:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.410200:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.412161:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.419188:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.419224:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.428563:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.428603:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.428648:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.440523:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.440566:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.461268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.464384:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.465366:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.469758:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.542657:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.545475:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.547203:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.547304:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.548540:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126994.549227:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007602ec00/0x34dc807b6ef7b48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549233:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007602ec00/0x34dc807b6ef7b48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:0.0:1746126994.549267:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126994.549270:0:11634:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126994.549281:0:11634:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007602ec00/0x34dc807b6ef7b48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549288:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007602ec00/0x34dc807b6ef7b48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549298:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549302:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549306:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549312:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549317:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a5600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126994.549319:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549325:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549332:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126994.549334:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126994.549337:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549341:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef7b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549364:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef7b41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549369:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef7b41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549374:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef7b41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549378:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a5e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126994.549380:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef7b41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549385:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef7b41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549395:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7e00) 00010000:00010000:0.0:1746126994.549396:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126994.549398:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef7b41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549403:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef7b41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.549428:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef7b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d95 expref: 14 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.549438:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007602ec00/0x34dc807b6ef7b48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d95 expref: 13 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.549443:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126994.549445:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126994.549447:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007602ec00, rc 0) 00000100:00100000:0.0:1746126994.549478:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:3860:x1830945991318656:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6026us (6826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.549483:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17091 00000100:00100000:0.0:1746126994.553533:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20801 00000100:00100000:0.0:1746126994.553547:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991319680:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126994.553563:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.553578:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094505600/0x34dc807b6ef7b56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51da3 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.553597:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.553599:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.553608:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094505600/0x34dc807b6ef7b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51da3 expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.553622:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094505600/0x34dc807b6ef7b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51da3 expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.553633:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505600, rc 0) 00000100:00100000:0.0:1746126994.553684:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991319680:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 141us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.553894:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20801 00000100:00100000:0.0:1746126994.553913:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991319808 00000100:00100000:0.0:1746126994.553918:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991319808 00000100:00100000:0.0:1746126994.553944:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20805 00000100:00100000:0.0:1746126994.553948:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991319808:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126994.553955:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.553962:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6ef7b72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51daa expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.553973:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.553975:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.553979:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6ef7b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51daa expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.553988:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6ef7b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51daa expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.553994:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505c00, rc 0) 00000100:00100000:0.0:1746126994.554828:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991319808:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 875us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.554840:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20805 00000100:00100000:0.0:1746126994.557887:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.572435:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991320704 00000100:00100000:0.0:1746126994.572443:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991320704 00000100:00100000:0.0:1746126994.572502:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17093 00000100:00100000:0.0:1746126994.572509:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:3860:x1830945991320704:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126994.572527:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.572552:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094504000/0x34dc807b6ef7b8e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51dcd expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.572653:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6ef7b95 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.572666:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef7b80 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51dc6 expref: 15 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.572673:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6ef7b95 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126994.572700:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef7b80 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51dc6 expref: 15 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.572709:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef7b80 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51dc6 expref: 15 pid: 11634 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746126994.572719:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994125696:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.572792:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.575702:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.579087:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.585343:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.585370:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.585393:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.585412:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991321216 00000100:00100000:0.0:1746126994.585419:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991321216 00000100:00100000:0.0:1746126994.585452:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991321344 00000100:00100000:0.0:1746126994.585454:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991321344 00000100:00100000:0.0:1746126994.585514:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20806 00000100:00100000:0.0:1746126994.585521:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991321216:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126994.585971:0:11152:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef7bbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.585981:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4fce00/0x34dc807b6ef7aed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d4f expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.585987:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef7b4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d9c expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.585992:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef7b2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d8e expref: 52 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.585996:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.585997:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.585999:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef7bbf lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.586030:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef7b2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d8e expref: 52 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.586041:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef7b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d8e expref: 52 pid: 9613 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.586049:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994126592:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126994.586077:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef7b4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d9c expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.586083:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef7b4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d9c expref: 12 pid: 3148 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.586091:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994126720:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126994.586121:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c4fce00/0x34dc807b6ef7aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d4f expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.586145:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c4fce00/0x34dc807b6ef7aed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d4f expref: 29 pid: 1507 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746126994.586152:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994126848:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.586178:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.586654:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991321856 00000100:00100000:0.0:1746126994.586658:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991321856 00000100:00100000:0.0:1746126994.586685:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20811 00000100:00100000:0.0:1746126994.586691:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991321856:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126994.586705:0:3542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef7bd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.586714:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6ef7abc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d25 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.586719:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6ef7b64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51dbf expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.586725:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6ef7ae6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d48 expref: 27 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.586729:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.586730:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.586732:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef7bd4 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.586745:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6ef7ae6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d48 expref: 27 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.586751:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6ef7ae6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d48 expref: 27 pid: 3148 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.586758:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994127616:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126994.586786:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6ef7b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51dbf expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.586792:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6ef7b64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51dbf expref: 12 pid: 9612 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.586804:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994127744:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126994.588146:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6ef7abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d25 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.588157:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6ef7abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d25 expref: 9 pid: 16295 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.588166:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994127872:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.588197:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.592202:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994125824:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.592214:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994126208:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.594297:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994126592:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.594328:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994126720:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126994.594354:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994126848:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126994.594594:0:11152:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef7bbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126994.595151:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.603615:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991322112 00000100:00100000:0.0:1746126994.603619:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991322112 00010000:00010000:0.0:1746126994.603635:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6ef7aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d2c expref: 28 pid: 12340 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746126994.603671:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9642 00000100:00100000:0.0:1746126994.603677:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991322112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126994.603685:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126994.603693:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6ef7aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d2c expref: 28 pid: 12340 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746126994.603701:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6ef7aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d2c expref: 28 pid: 12340 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746126994.603713:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6ef7aca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d2c expref: 28 pid: 12340 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746126994.603727:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126994.603746:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991322112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.603752:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9642 00000100:00100000:0.0:1746126994.604916:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991323136 00000100:00100000:0.0:1746126994.604919:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991323136 00010000:00010000:0.0:1746126994.604931:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22c00/0x34dc807b6ef7afb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51d5d expref: 27 pid: 1507 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.606913:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606920:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606931:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606937:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606947:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606951:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126994.606954:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606959:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606967:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.606971:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6ef7bcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126994.606995:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991321728:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 20700us (20729us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.607000:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20810 00000100:00100000:0.0:1746126994.607995:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991324288 00000100:00100000:0.0:1746126994.607999:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991324288 00000100:00100000:0.0:1746126994.608018:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991324800 00000100:00100000:0.0:1746126994.608020:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991324800 00000100:00100000:0.0:1746126994.608037:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20813 00000100:00100000:0.0:1746126994.608042:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991324544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126994.608049:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.608056:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7800/0x34dc807b6ef7be2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51de9 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126994.608065:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c891, atime: 0x6813c88f, ctime: 0x6813c890, blocks: 0x808 00010000:00010000:0.0:1746126994.608073:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.608074:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.608079:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7800/0x34dc807b6ef7be2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51de9 expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.608088:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7800/0x34dc807b6ef7be2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51de9 expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.608094:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7800, rc 0) 00000100:00100000:0.0:1746126994.608105:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991324544:12345-192.168.203.42@tcp:101:cat.0 Request processed in 63us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.608120:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20813 00000100:00100000:0.0:1746126994.608146:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20814 00000100:00100000:0.0:1746126994.608151:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991324800:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126994.608156:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.608163:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef7be9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51df7 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126994.608173:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c891, atime: 0x6813c890, ctime: 0x6813c891, blocks: 0x14e0 00010000:00010000:0.0:1746126994.608179:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.608181:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.608184:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef7be9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51df7 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.608191:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef7be9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51df7 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.608197:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd6800, rc 0) 00000100:00100000:0.0:1746126994.608207:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991324800:12345-192.168.203.42@tcp:101:cat.0 Request processed in 56us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.608211:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20814 00000100:00100000:0.0:1746126994.610580:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.611545:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.612981:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.617071:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.618961:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.622675:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.622696:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991326720 00000100:00100000:0.0:1746126994.622699:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991326720 00002000:00100000:0.0:1746126994.622722:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880099196a00 x1830945991326720/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:0/0 lens 488/0 e 0 to 0 dl 1746127005 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126994.622731:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099196a00 with x1830945991326720 ext(1048576->2097151) 00002000:00010000:0.0:1746126994.622736:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099196a00 00000100:00100000:0.0:1746126994.622760:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8230 00000100:00100000:0.0:1746126994.622767:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991326720:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126994.623605:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.624018:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.626683:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.633743:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991326720:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10975us (11068us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126994.633751:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8230 00002000:00100000:0.0:1746126994.633757:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880099196a00 x1830945991326720/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:0/0 lens 488/440 e 0 to 0 dl 1746127005 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126994.633764:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099196a00 with x1830945991326720 ext(1048576->2097151) 00002000:00010000:0.0:1746126994.633767:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099196a00 00000100:00100000:0.0:1746126994.639263:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.642601:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.644230:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.645241:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.646743:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.651924:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.651969:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.655505:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.668803:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.675614:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.683436:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.684780:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.688963:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.689856:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.700091:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.700177:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.700200:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.700219:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991330304 00000100:00100000:0.0:1746126994.700226:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991330304 00000100:00100000:0.0:1746126994.700258:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991330432 00000100:00100000:0.0:1746126994.700260:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991330432 00000100:00100000:0.0:1746126994.700276:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20823 00000100:00100000:0.0:1746126994.700282:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2026:x1830945991330304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126994.700297:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.700311:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c35c400/0x34dc807b6ef7c52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51e36 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.700330:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.700331:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.700339:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c35c400/0x34dc807b6ef7c52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e36 expref: 53 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.701021:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c35c400/0x34dc807b6ef7c52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e36 expref: 53 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126994.701059:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35c400, rc 0) 00000100:00100000:0.0:1746126994.701098:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:2026:x1830945991330304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 815us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126994.701105:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20823 00000100:00100000:0.0:1746126994.701177:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.701233:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.701694:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.701708:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991330944 00000100:00100000:0.0:1746126994.701711:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991330944 00000100:00100000:0.0:1746126994.701729:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20828 00000100:00100000:0.0:1746126994.701734:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991330944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126994.701741:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126994.701749:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef7c75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51e59 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126994.701779:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994129664:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126994.701817:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.712032:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.712438:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.723012:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.723044:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.723066:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.723226:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991331456:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10418us (11203us total) trans 0 rc 1589248/1589248 00000100:00100000:0.0:1746126994.723236:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8238 00002000:00100000:0.0:1746126994.723246:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3686399) req@ffff8800a5b9aa00 x1830945991331456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:0/0 lens 488/440 e 0 to 0 dl 1746127005 ref 1 fl Complete:/200/0 rc 1589248/1589248 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126994.723254:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9aa00 with x1830945991331456 ext(2097152->3686399) 00002000:00010000:0.0:1746126994.723259:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b9aa00 00000100:00100000:0.0:1746126994.723278:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991332224 00000100:00100000:0.0:1746126994.723283:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991332224 00002000:00100000:0.0:1746126994.723307:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a5b99c00 x1830945991332224/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:0/0 lens 488/0 e 0 to 0 dl 1746127005 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126994.723321:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99c00 with x1830945991332224 ext(0->1048575) 00002000:00010000:0.0:1746126994.723324:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b99c00 00000100:00100000:0.0:1746126994.723346:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8240 00000100:00100000:0.0:1746126994.723785:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991331968:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126994.747331:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.748214:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.754301:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.756367:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.759944:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.759980:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.760021:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.760390:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.763939:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.764542:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.768274:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.772473:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.775680:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.775709:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.775756:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.775774:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991334784 00000100:00100000:0.0:1746126994.775777:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991334784 00010000:00010000:0.0:1746126994.775790:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef7c44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e28 expref: 34 pid: 12340 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746126994.776006:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9662 00000100:00100000:0.0:1746126994.776013:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991334784:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126994.776021:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126994.776030:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef7c44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e28 expref: 34 pid: 12340 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.776045:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef7c44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e28 expref: 34 pid: 12340 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.776063:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef7c44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e28 expref: 34 pid: 12340 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746126994.776076:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.776078:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126994.776083:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012213e200/0x34dc807b6ef7ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e8a expref: 55 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.776091:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012213e200/0x34dc807b6ef7ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e8a expref: 55 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126994.776148:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012213e200/0x34dc807b6ef7ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e8a expref: 55 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126994.776159:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994130688:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126994.776193:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126994.778320:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.778468:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.781115:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.782042:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.782334:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.794573:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.798403:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.818034:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.826813:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.826861:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.857785:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.992277:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126994.997463:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000001:00080000:0.0:1746126995.029697:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842719 is committed 00000001:00080000:0.0:1746126995.029715:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842718 is committed 00000001:00080000:0.0:1746126995.029794:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842703 is committed 00000001:00080000:0.0:1746126995.029842:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842674 is committed 00000100:00100000:0.0:1746126995.030924:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991337984 00000100:00100000:0.0:1746126995.030928:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991337984 00000100:00100000:0.0:1746126995.030953:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20840 00000100:00100000:0.0:1746126995.030958:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:3880:x1830945991337984:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126995.030968:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.030985:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4878c00/0x34dc807b6ef7cc9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51ead expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.031008:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012213e600/0x34dc807b6ef7c98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e7c expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.031016:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6ef7c9f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e83 expref: 19 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.031022:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.031024:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.031027:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4878c00/0x34dc807b6ef7cc9 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2867199] (req 2097152->2867199) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ead expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.031055:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6ef7c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e83 expref: 19 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.031066:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6ef7c9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e83 expref: 19 pid: 1507 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.031077:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994131712:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126995.031174:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012213e600/0x34dc807b6ef7c98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e7c expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.031181:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012213e600/0x34dc807b6ef7c98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e7c expref: 11 pid: 16295 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.031188:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994131840:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.031203:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.039270:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.039801:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.049819:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.053970:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.060438:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.060822:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.060863:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991339008 00000100:00100000:0.0:1746126995.060870:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991339008 00002000:00100000:0.0:1746126995.060908:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2867199) req@ffff880094e6d880 x1830945991339008/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.060917:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d880 with x1830945991339008 ext(2097152->2867199) 00010000:00010000:0.0:1746126995.060923:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4878c00/0x34dc807b6ef7cc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ead expref: 8 pid: 16295 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.060935:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4878c00/0x34dc807b6ef7cc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ead expref: 8 pid: 16295 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746126995.060941:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e6d880 00000100:00100000:0.0:1746126995.061529:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1786 00000100:00100000:0.0:1746126995.061536:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991339008:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126995.074479:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.076532:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.083423:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.084958:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.091754:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.091797:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.095511:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.095639:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.095668:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.095681:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.095782:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994132736:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126995.095799:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.095834:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2029:x1830945991340160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3617us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.095844:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9669 00000100:00100000:0.0:1746126995.095870:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20846 00000100:00100000:0.0:1746126995.095876:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991340544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.095887:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.095897:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6ef7cf3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51ed0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.095908:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.095910:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.095914:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6ef7cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ed0 expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.095925:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6ef7cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ed0 expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.095932:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88c00, rc 0) 00000100:00100000:0.0:1746126995.097410:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.104544:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.104640:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.108195:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.111605:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.118614:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.119384:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991341696:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6044us (7783us total) trans 21474842722 rc 0/0 00000100:00100000:0.0:1746126995.119391:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1790 00002000:00100000:0.0:1746126995.119399:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1937408->2097151) req@ffff88008c5bce00 x1830945991341696/t21474842722(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/448 e 0 to 0 dl 1746127006 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.119407:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bce00 with x1830945991341696 ext(1937408->2097151) 00010000:00010000:0.0:1746126995.119413:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012213fa00/0x34dc807b6ef7cbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e9f expref: 12 pid: 1507 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.119423:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012213fa00/0x34dc807b6ef7cbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e9f expref: 12 pid: 1507 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746126995.119428:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c5bce00 00000100:00100000:0.0:1746126995.123480:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.128990:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.129052:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.129082:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.129162:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991342208 00000100:00100000:0.0:1746126995.129170:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991342208 00002000:00100000:0.0:1746126995.129206:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88008c5be680 x1830945991342208/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.129216:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5be680 with x1830945991342208 ext(2097152->4194303) 00002000:00010000:0.0:1746126995.129221:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c5be680 00000100:00100000:0.0:1746126995.129236:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991342464 00000100:00100000:0.0:1746126995.129238:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991342464 00002000:00100000:0.0:1746126995.129249:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880130a79f80 x1830945991342464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.129256:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79f80 with x1830945991342464 ext(3145728->4194303) 00002000:00010000:0.0:1746126995.129258:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79f80 00000100:00100000:0.0:1746126995.129273:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991342720 00000100:00100000:0.0:1746126995.129276:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991342720 00002000:00100000:0.0:1746126995.129288:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a7a680 x1830945991342720/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.129294:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7a680 with x1830945991342720 ext(1048576->2097151) 00002000:00010000:0.0:1746126995.129297:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7a680 00000100:00100000:0.0:1746126995.129307:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8257 00000100:00100000:0.0:1746126995.129312:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991342464:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126995.158059:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.162858:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.163848:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.170840:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.171203:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.197580:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.213023:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.216355:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991344768 00000100:00100000:0.0:1746126995.216361:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991344768 00000100:00100000:0.0:1746126995.217708:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.217853:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.217893:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9673 00000100:00100000:0.0:1746126995.217899:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991345024:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.217909:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.217914:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b800/0x34dc807b6ef7c0c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e05 expref: 25 pid: 11634 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.217922:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b800/0x34dc807b6ef7c0c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e05 expref: 25 pid: 11634 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.217948:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b800/0x34dc807b6ef7c0c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e05 expref: 25 pid: 11634 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.218045:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126995.218049:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.218071:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991345024:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 172us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.218076:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9673 00000100:00100000:0.0:1746126995.219997:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.220019:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.220032:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.220048:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.220056:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.220071:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.220088:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991345664 00000100:00100000:0.0:1746126995.220091:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991345664 00000100:00100000:0.0:1746126995.220126:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991345920 00000100:00100000:0.0:1746126995.220141:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991345920 00000100:00100000:0.0:1746126995.220149:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991345536 00000100:00100000:0.0:1746126995.220150:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991345536 00000100:00100000:0.0:1746126995.220156:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991345792 00000100:00100000:0.0:1746126995.220157:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991345792 00000100:00100000:0.0:1746126995.220563:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20852 00000100:00100000:0.0:1746126995.220570:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991345408:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126995.220579:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.220588:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7d39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f08 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.220603:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.220604:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.220609:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7d39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f08 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.220618:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7d39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f08 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.220624:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213f800, rc 0) 00000100:00100000:0.0:1746126995.220641:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991345408:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 72us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.220646:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20852 00000100:00100000:0.0:1746126995.220658:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20856 00000100:00100000:0.0:1746126995.220663:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991345792:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126995.220669:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.220675:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef7d55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f1d expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.220685:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.220686:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.220690:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef7d55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f1d expref: 11 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.220697:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef7d55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f1d expref: 11 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.220709:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e000, rc 0) 00000100:00100000:0.0:1746126995.222627:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.224353:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.226593:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.228176:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.229789:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991347072 00000100:00100000:0.0:1746126995.229792:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991347072 00000100:00100000:0.0:1746126995.229820:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20859 00000100:00100000:0.0:1746126995.229825:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991347072:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746126995.229840:0:12333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6ef7d9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.229849:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef7c36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e1a expref: 11 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.229856:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d147400/0x34dc807b6ef7d47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f0f expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.229862:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967be400/0x34dc807b6ef7c60 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e44 expref: 31 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.229866:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.229868:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.229869:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6ef7d9b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.229887:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967be400/0x34dc807b6ef7c60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e44 expref: 31 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.229896:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967be400/0x34dc807b6ef7c60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e44 expref: 31 pid: 16295 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.229906:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994134144:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126995.229972:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d147400/0x34dc807b6ef7d47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f0f expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.229979:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d147400/0x34dc807b6ef7d47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f0f expref: 11 pid: 11152 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.229983:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7d39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f08 expref: 11 pid: 3542 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.229986:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994134528:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.229995:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994134656:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126995.230007:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef7c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e1a expref: 11 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.230013:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef7c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e1a expref: 11 pid: 3542 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.230020:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994134912:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126995.230022:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83a00/0x34dc807b6ef7bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51de2 expref: 11 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.230029:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83a00/0x34dc807b6ef7bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51de2 expref: 11 pid: 12333 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.230033:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126995.230035:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994135040:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.230048:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a50c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126995.230081:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.230093:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.230153:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.232889:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994134144:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.232899:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994134400:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.232919:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994134528:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.232969:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994134656:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.233229:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.233250:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.233265:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991347584 00000100:00100000:0.0:1746126995.233269:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991347584 00000100:00100000:1.0:1746126995.233270:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994135040:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126995.233293:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d147400/0x34dc807b6ef7d47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f0f expref: 13 pid: 11152 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.233313:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991347840 00000100:00100000:0.0:1746126995.233316:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991347840 00010000:00010000:0.0:1746126995.233325:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a02000/0x34dc807b6ef7d4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f01 expref: 14 pid: 12340 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.233338:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9676 00000100:00100000:0.0:1746126995.233344:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991347584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.233354:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.233370:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d147400/0x34dc807b6ef7d47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f0f expref: 13 pid: 11152 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.233371:0:1964:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.233378:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d147400/0x34dc807b6ef7d47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f0f expref: 13 pid: 11152 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.233394:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d147400/0x34dc807b6ef7d47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f0f expref: 13 pid: 11152 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.233403:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9677 00010000:00010000:0.0:1746126995.233407:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.233409:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991347840:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.233422:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126995.233432:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991347584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 88us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126995.233434:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a02000/0x34dc807b6ef7d4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f01 expref: 14 pid: 12340 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.233440:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9676 00010000:00010000:1.0:1746126995.233443:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a02000/0x34dc807b6ef7d4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f01 expref: 14 pid: 12340 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.233455:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a02000/0x34dc807b6ef7d4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f01 expref: 14 pid: 12340 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.233462:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126995.233468:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.233470:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991348352 00000100:00100000:0.0:1746126995.233472:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991348352 00010000:00010000:0.0:1746126995.233479:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef7c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e1a expref: 12 pid: 3542 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.233484:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991347840:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.233489:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9678 00000100:00100000:0.0:1746126995.233492:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991348352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.233503:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.233508:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef7c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e1a expref: 12 pid: 3542 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.233515:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef7c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e1a expref: 12 pid: 3542 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.233524:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.233537:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991348352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 44us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.234526:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9677 00000100:00100000:0.0:1746126995.234566:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9678 00000100:00100000:1.0:1746126995.234571:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.234578:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991347712 00000100:00100000:0.0:1746126995.234581:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991347712 00010000:00010000:0.0:1746126995.234591:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f800/0x34dc807b6ef7d39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f08 expref: 12 pid: 3542 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.234615:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.234715:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991348224 00000100:00100000:0.0:1746126995.234718:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991348224 00010000:00010000:0.0:1746126995.234968:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967be400/0x34dc807b6ef7c60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e44 expref: 32 pid: 16295 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.234984:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9680 00000100:00100000:0.0:1746126995.234989:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945991348224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.234995:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.235001:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967be400/0x34dc807b6ef7c60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e44 expref: 32 pid: 16295 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.235008:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967be400/0x34dc807b6ef7c60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e44 expref: 32 pid: 16295 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.235018:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967be400/0x34dc807b6ef7c60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e44 expref: 32 pid: 16295 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.235026:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.235027:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.235031:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6ef7d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.235038:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6ef7d9b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.235054:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.235707:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991348224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 717us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.235713:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9680 00000100:00100000:0.0:1746126995.237076:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.237115:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.237148:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.237162:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.237173:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.237185:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991347968 00000100:00100000:0.0:1746126995.237188:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991347968 00010000:00010000:0.0:1746126995.237205:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef7c59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51e3d expref: 31 pid: 12340 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.237219:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991348992 00010000:00010000:1.0:1746126995.237498:0:1964:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237506:0:1964:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237519:0:1964:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237524:0:1964:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237529:0:1964:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237539:0:1964:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a02e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126995.237541:0:1964:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237547:0:1964:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237555:0:1964:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237560:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6ef7d94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126995.237565:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991348992 00010000:00010000:0.0:1746126995.237576:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6000/0x34dc807b6ef7d40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f24 expref: 10 pid: 9612 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237595:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991346944:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 7773us (7878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.237600:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9685 00000100:00100000:1.0:1746126995.237601:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20858 00000100:00100000:0.0:1746126995.237605:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991348992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.237610:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.237618:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6000/0x34dc807b6ef7d40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f24 expref: 9 pid: 9612 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.237625:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6000/0x34dc807b6ef7d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f24 expref: 9 pid: 9612 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.237635:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6000/0x34dc807b6ef7d40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f24 expref: 9 pid: 9612 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237636:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126995.237642:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.237649:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991348864 00000100:00100000:1.0:1746126995.237651:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991348864 00000100:00100000:0.0:1746126995.237655:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991348992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 50us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.237660:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9685 00010000:00010000:1.0:1746126995.237661:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef7bdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ddb expref: 12 pid: 9613 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.237669:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9686 00000100:00100000:0.0:1746126995.237673:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991348864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.237678:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.237684:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef7bdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ddb expref: 12 pid: 9613 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.237691:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef7bdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ddb expref: 12 pid: 9613 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237699:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126995.237700:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef7bdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ddb expref: 12 pid: 9613 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.237706:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126995.237707:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991349120 00010000:00010000:0.0:1746126995.237707:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126995.237710:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991349120 00010000:00010000:0.0:1746126995.237710:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7e00/0x34dc807b6ef7d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.237714:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7e00/0x34dc807b6ef7d8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237718:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a03e00/0x34dc807b6ef7d32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f16 expref: 13 pid: 12340 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.237727:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.237736:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9687 00000100:00100000:0.0:1746126995.237739:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991348864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 66us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.237741:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991349120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126995.237744:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9686 00010000:00010000:1.0:1746126995.237746:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.237754:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a03e00/0x34dc807b6ef7d32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f16 expref: 13 pid: 12340 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.237760:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a03e00/0x34dc807b6ef7d32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f16 expref: 13 pid: 12340 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.237770:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a03e00/0x34dc807b6ef7d32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f16 expref: 13 pid: 12340 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.237776:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126995.237778:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.237785:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991348608 00000100:00100000:0.0:1746126995.237787:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991348608 00000100:00100000:1.0:1746126995.237792:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991349120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126995.237796:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7d08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51eec expref: 11 pid: 16295 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237798:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9687 00000100:00100000:0.0:1746126995.237807:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9688 00000100:00100000:0.0:1746126995.237810:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991348608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.237815:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.237821:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7d08 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51eec expref: 11 pid: 16295 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.237827:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7d08 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51eec expref: 11 pid: 16295 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237831:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126995.237836:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7d08 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51eec expref: 11 pid: 16295 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237840:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991349376 00000100:00100000:1.0:1746126995.237842:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991349376 00010000:00010000:0.0:1746126995.237843:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.237844:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.237846:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef7da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.237849:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be43000/0x34dc807b6ef7cd7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ebb expref: 11 pid: 16295 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.237851:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef7da9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.237859:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9689 00010000:00010000:0.0:1746126995.237862:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.237863:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991349376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.237870:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126995.237875:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991348608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (98us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126995.237877:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be43000/0x34dc807b6ef7cd7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ebb expref: 11 pid: 16295 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.237883:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be43000/0x34dc807b6ef7cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ebb expref: 11 pid: 16295 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.237883:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9688 00010000:00010000:1.0:1746126995.237893:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be43000/0x34dc807b6ef7cd7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ebb expref: 10 pid: 16295 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.237901:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.237906:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.237913:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991349376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 49us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.237914:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991348736 00000100:00100000:0.0:1746126995.237917:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991348736 00000100:00100000:1.0:1746126995.237918:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9689 00010000:00010000:0.0:1746126995.237925:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef7d55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f1d expref: 12 pid: 3542 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.237944:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9690 00000100:00100000:0.0:1746126995.237948:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991348736:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.237953:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.237958:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef7d55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f1d expref: 12 pid: 3542 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.237965:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef7d55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f1d expref: 12 pid: 3542 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237968:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126995.237975:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012213e000/0x34dc807b6ef7d55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f1d expref: 12 pid: 3542 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.237978:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991349504 00000100:00100000:1.0:1746126995.237980:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991349504 00010000:00010000:0.0:1746126995.237982:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126995.237989:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6ef7cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ed0 expref: 21 pid: 12340 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.237995:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991348736:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 46us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.237999:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9691 00000100:00100000:0.0:1746126995.238002:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9690 00000100:00100000:1.0:1746126995.238003:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2029:x1830945991349504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.238008:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.238014:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6ef7cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ed0 expref: 21 pid: 12340 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.238024:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6ef7cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ed0 expref: 21 pid: 12340 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.238034:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6ef7cf3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ed0 expref: 21 pid: 12340 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.238040:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.238041:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.238044:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.238050:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.238062:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.238073:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2029:x1830945991349504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.238077:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9691 00000100:00100000:1.0:1746126995.238622:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126995.238729:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238740:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238750:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238755:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238761:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238765:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013084ee00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126995.238767:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238771:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238779:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.238784:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013084ee00/0x34dc807b6ef7da2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126995.238812:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991347328:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 8634us (8730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.238818:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20860 00000100:00100000:0.0:1746126995.239570:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.241369:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.245009:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.245046:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.245227:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.245318:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9696 00000100:00100000:1.0:1746126995.245325:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991350400:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.245333:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.245338:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef77a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b50 expref: 25 pid: 7260 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.245381:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef77a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b50 expref: 25 pid: 7260 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.245407:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef77a5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51b50 expref: 24 pid: 7260 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.245418:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126995.245420:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a44000/0x34dc807b6ef7db7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126995.245426:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.245444:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991350400:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 120us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.245449:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9696 00000100:00100000:0.0:1746126995.245514:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.245538:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991350528 00000100:00100000:0.0:1746126995.245541:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991350528 00010000:00010000:0.0:1746126995.245553:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96400/0x34dc807b6ef76fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ad2 expref: 47 pid: 10958 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.245574:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9697 00000100:00100000:0.0:1746126995.245579:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991350528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.245585:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.245588:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96400/0x34dc807b6ef76fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ad2 expref: 47 pid: 10958 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.245629:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96400/0x34dc807b6ef76fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ad2 expref: 47 pid: 10958 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.245686:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96400/0x34dc807b6ef76fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ad2 expref: 47 pid: 10958 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.245696:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126995.245699:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a44000/0x34dc807b6ef7db7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126995.245709:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a44000/0x34dc807b6ef7db7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126995.245714:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a44000/0x34dc807b6ef7db7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126995.245737:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.245752:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991350528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 173us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.245757:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9697 00000100:00100000:1.0:1746126995.249326:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994136960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.249397:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994137088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126995.249425:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126995.249450:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994137472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126995.249463:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126995.249500:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994136960 00000100:00100000:1.0:1746126995.249505:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994136960 00000100:00100000:1.0:1746126995.249586:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994137472 00000100:00100000:1.0:1746126995.249589:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994137472 00000100:00100000:1.0:1746126995.249603:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20863 00000100:00100000:1.0:1746126995.249608:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3783:x1830945994136960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126995.249772:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3783:x1830945994136960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (347us total) trans 17179875468 rc 0/0 00000100:00100000:1.0:1746126995.249779:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20863 00000100:00100000:1.0:1746126995.249799:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20865 00000100:00100000:1.0:1746126995.249803:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3785:x1830945994137216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126995.249852:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3785:x1830945994137216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (92us total) trans 17179875469 rc 0/0 00000100:00100000:1.0:1746126995.249857:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20865 00000100:00100000:1.0:1746126995.249868:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994137856 00000100:00100000:1.0:1746126995.249870:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994137856 00000100:00100000:1.0:1746126995.249880:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20867 00000100:00100000:1.0:1746126995.249883:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3782:x1830945994137344:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1746126995.249916:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746126995.250259:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099196300/2, rc 0, transno 17179875468 00000100:00100000:1.0:1746126995.250263:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994136960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.250423:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.250440:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994137600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.250458:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.250484:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20870 00000100:00100000:0.0:1746126995.250490:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3784:x1830945994137600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126995.250542:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746126995.250545:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126995.250547:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126995.250549:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126995.250551:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746126995.250571:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3784:x1830945994137600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (111us total) trans 17179875475 rc 0/0 00000100:00100000:0.0:1746126995.250576:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20870 00000100:00100000:0.0:1746126995.250660:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126995.250663:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994138496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.250680:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746126995.250693:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126995.250696:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00000100:00100000:0.0:1746126995.250697:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138624:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126995.250698:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:1.0:1746126995.250699:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746126995.250701:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746126995.250710:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126995.250720:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994137344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 836us (886us total) trans 17179875472 rc 0/0 00000100:00100000:1.0:1746126995.250724:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20867 00000004:00080000:0.0:1746126995.250725:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099195180/2, rc 0, transno 17179875474 00000100:00100000:0.0:1746126995.250729:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994137088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126995.250735:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099194e00/2, rc 0, transno 17179875475 00000100:00100000:0.0:1746126995.250738:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994137600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.250743:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746126995.250747:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.250759:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.250767:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.250778:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.250788:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994138624 00000100:00100000:0.0:1746126995.250791:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994138624 00000100:00100000:0.0:1746126995.250801:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994138240 00000100:00100000:0.0:1746126995.250802:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994138240 00000100:00100000:0.0:1746126995.250808:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994138752 00000100:00100000:0.0:1746126995.250809:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994138752 00000100:00100000:1.0:1746126995.250816:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20872 00000100:00100000:1.0:1746126995.250821:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3784:x1830945994138112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126995.250872:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3784:x1830945994138112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (190us total) trans 21474842724 rc 0/0 00000100:00100000:0.0:1746126995.251228:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20873 00000100:00100000:0.0:1746126995.251234:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3784:x1830945994138624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.251294:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3784:x1830945994138624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (583us total) trans 21474842725 rc 0/0 00000100:00100000:0.0:1746126995.251299:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20873 00000100:00100000:0.0:1746126995.251308:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20874 00000100:00100000:0.0:1746126995.251312:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3784:x1830945994138240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.251354:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3784:x1830945994138240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (593us total) trans 21474842726 rc 0/0 00000100:00100000:0.0:1746126995.251361:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20874 00000100:00100000:0.0:1746126995.251368:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20875 00000100:00100000:0.0:1746126995.251371:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3784:x1830945994138752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126995.251409:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126995.251411:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126995.251413:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126995.251414:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126995.251416:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:0.0:1746126995.251431:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3784:x1830945994138752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (652us total) trans 21474842727 rc 0/0 00000100:00100000:0.0:1746126995.251435:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20875 00000100:00100000:0.0:1746126995.251454:0:3784:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842703 gen 2 00000004:00080000:0.0:1746126995.251457:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f0a80, transno 21474842665 00000004:00080000:0.0:1746126995.251462:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f2d80, transno 21474842666 00000004:00080000:0.0:1746126995.251464:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f1880, transno 21474842667 00000004:00080000:0.0:1746126995.251466:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f0000, transno 21474842668 00000004:00080000:0.0:1746126995.251468:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f0700, transno 21474842669 00000004:00080000:0.0:1746126995.251469:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f1500, transno 21474842670 00000004:00080000:0.0:1746126995.251471:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f1f80, transno 21474842671 00000004:00080000:0.0:1746126995.251473:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f0380, transno 21474842672 00000004:00080000:0.0:1746126995.251474:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099615880, transno 21474842673 00000004:00080000:0.0:1746126995.251477:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced5180, transno 21474842675 00000004:00080000:0.0:1746126995.251478:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced4e00, transno 21474842676 00000004:00080000:0.0:1746126995.251481:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced4000, transno 21474842677 00000004:00080000:0.0:1746126995.251482:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c428380, transno 21474842678 00000004:00080000:0.0:1746126995.251484:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced7800, transno 21474842679 00000004:00080000:0.0:1746126995.251486:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d28b800, transno 21474842680 00000004:00080000:0.0:1746126995.251488:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced6a00, transno 21474842681 00000004:00080000:0.0:1746126995.251490:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ced4380, transno 21474842682 00000004:00080000:0.0:1746126995.251492:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c428000, transno 21474842683 00000004:00080000:0.0:1746126995.251494:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096631c00, transno 21474842686 00000004:00080000:0.0:1746126995.251497:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238c700, transno 21474842687 00000004:00080000:0.0:1746126995.251498:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f3480, transno 21474842688 00000004:00080000:0.0:1746126995.251501:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238dc00, transno 21474842689 00000004:00080000:0.0:1746126995.251502:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f2a00, transno 21474842690 00000004:00080000:0.0:1746126995.251504:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238c000, transno 21474842691 00000004:00080000:0.0:1746126995.251506:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238d180, transno 21474842692 00000004:00080000:0.0:1746126995.251508:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012238d500, transno 21474842693 00000004:00080000:0.0:1746126995.251510:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a75880, transno 21474842694 00000004:00080000:0.0:1746126995.251571:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a178b800, transno 21474842695 00000004:00080000:0.0:1746126995.251574:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a1788700, transno 21474842696 00000004:00080000:0.0:1746126995.251576:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b9bb80, transno 21474842697 00000004:00080000:0.0:1746126995.251578:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123476680, transno 21474842698 00000004:00080000:0.0:1746126995.251580:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b98000, transno 21474842699 00000004:00080000:0.0:1746126995.251582:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123474000, transno 21474842700 00000004:00080000:0.0:1746126995.251583:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a1789180, transno 21474842701 00000004:00080000:0.0:1746126995.251585:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123477480, transno 21474842702 00000004:00080000:0.0:1746126995.251587:0:3784:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c00000, transno 21474842703 00000100:00100000:0.0:1746126995.251591:0:3784:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880094f15500 x1830945994138240/t21474842726(21474842726) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127011 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746126995.251598:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f15500/2, rc 0, transno 21474842726 00000100:00100000:0.0:1746126995.251601:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126995.251612:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22ce00/2, rc 0, transno 21474842727 00000100:00100000:0.0:1746126995.251615:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126995.251621:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f15180/2, rc 0, transno 21474842724 00000100:00100000:0.0:1746126995.251624:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126995.251630:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22f800/2, rc 0, transno 21474842725 00000100:00100000:0.0:1746126995.251632:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994138624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126995.251968:0:8231:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 36 done 00000100:00100000:1.0:1746126995.252041:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20872 00000100:00100000:1.0:1746126995.252062:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994138880 00000100:00100000:1.0:1746126995.252066:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994138880 00000100:00100000:1.0:1746126995.252082:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20877 00000100:00100000:1.0:1746126995.252088:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3782:x1830945994138880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126995.252160:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00000100:00080000:0.0:1746126995.252161:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746126995.252163:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126995.252165:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126995.252166:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126995.252168:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:1.0:1746126995.252189:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994138880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (213us total) trans 21474842729 rc 0/0 00000100:00100000:1.0:1746126995.252195:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20877 00000100:00100000:1.0:1746126995.252212:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.252228:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994138496 00000100:00100000:0.0:1746126995.252231:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994138496 00000004:00080000:1.0:1746126995.252234:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099197100/2, rc 0, transno 17179875470 00000100:00100000:1.0:1746126995.252238:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994137472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.252252:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20879 00000100:00100000:0.0:1746126995.252257:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994138496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.252321:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3783:x1830945994138496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (107us total) trans 21474842731 rc 0/0 00000100:00100000:0.0:1746126995.252326:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20879 00000004:00080000:1.0:1746126995.252345:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22dc00/2, rc 0, transno 21474842731 00000100:00100000:1.0:1746126995.252349:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994138496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.254979:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.260624:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.260741:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991350784 00000100:00100000:0.0:1746126995.260853:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991350784 00000100:00100000:0.0:1746126995.260906:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 999 00000100:00100000:0.0:1746126995.260914:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:3895:x1830945991350784:12345-192.168.203.42@tcp:103:mirror_io.0 00010000:00010000:0.0:1746126995.260925:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.260945:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6a00/0x34dc807b6ef7d78 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f32 expref: 8 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.261283:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126995.261287:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.261571:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:3895:x1830945991350784:12345-192.168.203.42@tcp:103:mirror_io.0 Request processed in 657us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.261578:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 999 00000100:00100000:0.0:1746126995.264160:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.264674:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991351040 00000100:00100000:1.0:1746126995.264687:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991351040 00000100:00100000:1.0:1746126995.264738:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6468 00000100:00100000:1.0:1746126995.264745:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:3895:x1830945991351040:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:1.0:1746126995.264969:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:3895:x1830945991351040:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 224us (841us total) trans 8589937997 rc 0/0 00000100:00100000:1.0:1746126995.264979:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6468 00000100:00100000:0.0:1746126995.268357:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.287720:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.287765:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.292935:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.294748:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.294776:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.294992:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.295007:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.295026:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.296120:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20882 00000100:00100000:1.0:1746126995.296126:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20883 00000100:00100000:0.0:1746126995.296141:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991352320:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746126995.296147:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991352448:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.296149:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.296153:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.296157:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7e19 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f6a expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.296160:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef7e20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f71 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126995.296169:0:16295:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c891, atime: 0x6813c890, ctime: 0x6813c891, blocks: 0x14e0 00002000:00010000:0.0:1746126995.296169:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c891, atime: 0x6813c891, ctime: 0x6813c891, blocks: 0x800 00010000:00010000:1.0:1746126995.296177:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.296177:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.296178:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.296178:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.296183:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef7e20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f71 expref: 13 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.296183:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7e19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f6a expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.296192:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef7e20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f71 expref: 13 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.296192:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7e19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f6a expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.296198:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe800, rc 0) 00010000:00010000:0.0:1746126995.296198:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d200, rc 0) 00000100:00100000:0.0:1746126995.296214:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991352320:12345-192.168.203.42@tcp:101:cat.0 Request processed in 88us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.296219:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991352448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 74us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.296219:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20882 00000100:00100000:1.0:1746126995.296224:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20883 00000100:00100000:0.0:1746126995.296228:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20885 00000100:00100000:0.0:1746126995.296234:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991352064:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.296238:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.296245:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef7e2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f5c expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126995.296253:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c890, atime: 0x6813c88b, ctime: 0x6813c890, blocks: 0x800 00010000:00010000:0.0:1746126995.296259:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.296260:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.296264:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef7e2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f5c expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.296271:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef7e2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f5c expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.296278:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6ca00, rc 0) 00000100:00100000:0.0:1746126995.296301:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991352064:12345-192.168.203.42@tcp:101:cat.0 Request processed in 67us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.296306:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20885 00000100:00100000:0.0:1746126995.300584:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.303351:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.303427:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991352960 00000100:00100000:1.0:1746126995.303431:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991352960 00010000:00010000:1.0:1746126995.303456:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6ef7dbe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f40 expref: 9 pid: 7260 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.303489:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9698 00000100:00100000:1.0:1746126995.303495:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991352960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.303505:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.303509:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6ef7dbe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f40 expref: 9 pid: 7260 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.303517:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6ef7dbe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f40 expref: 9 pid: 7260 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.303948:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126995.304063:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6ef7dbe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f40 expref: 9 pid: 7260 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.304079:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126995.304082:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126995.304089:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126995.304092:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.304167:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2028:x1830945991352960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 671us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.304172:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9698 00000100:00100000:1.0:1746126995.304184:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991353088 00000100:00100000:1.0:1746126995.304186:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991353088 00010000:00010000:1.0:1746126995.304194:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef7def lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f47 expref: 29 pid: 11634 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.304215:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9699 00000100:00100000:1.0:1746126995.304219:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991353088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.304225:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.304229:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef7def lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f47 expref: 29 pid: 11634 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.304236:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef7def lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f47 expref: 29 pid: 11634 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.304245:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef7def lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f47 expref: 29 pid: 11634 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.304251:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126995.304254:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126995.304259:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126995.304264:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126995.304751:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.304773:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991353088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 551us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.304779:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9699 00000100:00100000:0.0:1746126995.307992:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994139392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.308037:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.308059:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994139904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.308091:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994139392 00000100:00100000:0.0:1746126995.308096:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994139392 00000100:00100000:0.0:1746126995.308151:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994139648 00000100:00100000:0.0:1746126995.308154:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994139648 00000100:00100000:0.0:1746126995.308166:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20886 00000100:00100000:0.0:1746126995.308172:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3784:x1830945994139392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126995.308256:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126995.308258:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746126992 -> 1746126992 00002000:00010000:0.0:1746126995.308259:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746126987 -> 1746126987 00002000:00010000:0.0:1746126995.308260:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746126992 -> 1746126992 00002000:00010000:0.0:1746126995.308261:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126995.308281:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3784:x1830945994139392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (245us total) trans 17179875476 rc 0/0 00000100:00100000:0.0:1746126995.308285:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20886 00000100:00100000:0.0:1746126995.308291:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994140288 00000100:00100000:0.0:1746126995.308293:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994140288 00000100:00100000:0.0:1746126995.308303:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20888 00000100:00100000:0.0:1746126995.308305:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3782:x1830945994140160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.308344:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3782:x1830945994140160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (181us total) trans 17179875478 rc 0/0 00000100:00100000:0.0:1746126995.308347:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20888 00000100:00100000:0.0:1746126995.308356:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126995.308376:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd65c00/2, rc 0, transno 17179875476 00000100:00100000:0.0:1746126995.308379:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994139392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.308382:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746126995.308385:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.308395:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.308406:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994140032 00000100:00100000:0.0:1746126995.308408:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994140032 00000100:00100000:0.0:1746126995.308416:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20892 00000100:00100000:0.0:1746126995.308419:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994140032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126995.308447:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746126995.308449:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126995.308450:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126995.308451:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126995.308452:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746126995.308463:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994140032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (68us total) trans 17179875482 rc 0/0 00000100:00100000:0.0:1746126995.308467:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20892 00000004:00080000:0.0:1746126995.308480:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0ed80/2, rc 0, transno 17179875482 00000100:00100000:0.0:1746126995.308482:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126995.308486:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0dc00/2, rc 0, transno 17179875481 00000100:00100000:0.0:1746126995.308487:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994139904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.308492:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.308502:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.308518:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.308526:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.308531:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746126995.308534:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994140800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.308534:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.308545:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126995.308551:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994141056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126995.309008:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994140416 00000100:00100000:0.0:1746126995.309008:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994140928 00000100:00100000:0.0:1746126995.309009:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994140928 00000100:00100000:1.0:1746126995.309011:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994140416 00000100:00100000:0.0:1746126995.309019:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994140672 00000100:00100000:0.0:1746126995.309020:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994140672 00000100:00100000:0.0:1746126995.309026:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994141184 00000100:00100000:0.0:1746126995.309027:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994141184 00000100:00100000:1.0:1746126995.309031:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20893 00000100:00100000:1.0:1746126995.309035:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3784:x1830945994140928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.309040:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20895 00000100:00100000:0.0:1746126995.309042:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3784:x1830945994140544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126995.309079:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126995.309081:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746126993 -> 1746126993 00002000:00010000:0.0:1746126995.309082:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746126993 -> 1746126993 00002000:00010000:0.0:1746126995.309083:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746126993 -> 1746126993 00002000:00010000:0.0:1746126995.309084:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126995.309097:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994140544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (551us total) trans 21474842732 rc 0/0 00000100:00100000:0.0:1746126995.309100:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20895 00000100:00100000:1.0:1746126995.309122:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994140928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (594us total) trans 21474842733 rc 0/0 00000100:00100000:0.0:1746126995.309125:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126995.309142:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20893 00000100:00100000:1.0:1746126995.309151:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994141056 00000100:00100000:1.0:1746126995.309154:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994141056 00000004:00080000:0.0:1746126995.309157:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8eea680/2, rc 0, transno 21474842733 00000100:00100000:1.0:1746126995.309163:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20898 00000100:00100000:0.0:1746126995.309164:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126995.309166:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3784:x1830945994141056:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126995.309170:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8eea300/2, rc 0, transno 21474842732 00000100:00100000:0.0:1746126995.309173:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126995.309221:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994141056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (95us total) trans 21474842737 rc 0/0 00000004:00080000:0.0:1746126995.309222:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8ee9f80/2, rc 0, transno 21474842737 00000100:00100000:0.0:1746126995.309225:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994141056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126995.309226:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20898 00000100:00100000:1.0:1746126995.309233:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994139520 00000100:00100000:1.0:1746126995.309235:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994139520 00000100:00100000:1.0:1746126995.309246:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20899 00000004:00080000:0.0:1746126995.309246:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8eeb100/2, rc 0, transno 21474842734 00000100:00100000:1.0:1746126995.309249:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994139520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126995.309249:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994140416:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126995.309282:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126995.309284:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126993 -> 1746126993 00002000:00010000:1.0:1746126995.309286:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746126991 -> 1746126991 00002000:00010000:1.0:1746126995.309288:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126993 -> 1746126993 00002000:00010000:1.0:1746126995.309289:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746126995.309308:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994139520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (84us total) trans 17179875483 rc 0/0 00000100:00100000:0.0:1746126995.309309:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994141440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126995.309313:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20899 00000100:00100000:1.0:1746126995.309320:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994140800 00000100:00100000:1.0:1746126995.309322:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994140800 00000100:00100000:0.0:1746126995.309327:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126995.309335:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994141440 00000100:00100000:1.0:1746126995.309336:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994141440 00000100:00100000:1.0:1746126995.309345:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20900 00000100:00100000:1.0:1746126995.309349:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3783:x1830945994140800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126995.309382:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746126995.309384:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126995.309386:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126995.309387:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126995.309389:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:1.0:1746126995.309409:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3783:x1830945994140800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (97us total) trans 21474842738 rc 0/0 00000100:00100000:1.0:1746126995.309415:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20900 00000004:00080000:0.0:1746126995.309563:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2fdaa00/2, rc 0, transno 21474842740 00000100:00100000:0.0:1746126995.309567:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994141440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126995.310335:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.310392:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.310442:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.310481:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.310738:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8266 00000100:00100000:0.0:1746126995.310743:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991353984:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126995.310814:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8267 00000100:00100000:1.0:1746126995.310824:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991354112:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126995.328237:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991353984:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 17485us (17788us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126995.328247:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8266 00002000:00100000:1.0:1746126995.328257:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009ab0d500 x1830945991353984/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.328265:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d500 with x1830945991353984 ext(1048576->2097151) 00002000:00010000:1.0:1746126995.328270:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0d500 00000100:00100000:0.0:1746126995.329057:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991354112:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 18233us (18575us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126995.329065:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8267 00002000:00100000:0.0:1746126995.329071:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009ab0c380 x1830945991354112/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.329079:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0c380 with x1830945991354112 ext(1048576->2097151) 00002000:00010000:0.0:1746126995.329083:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0c380 00000100:00100000:1.0:1746126995.329422:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.334245:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.341320:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.342925:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.342977:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.343004:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.343032:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.343072:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.343170:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991354752 00000100:00100000:0.0:1746126995.343179:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991354752 00000100:00100000:0.0:1746126995.343218:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991354880 00000100:00100000:0.0:1746126995.343222:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991354880 00000100:00100000:0.0:1746126995.343238:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991355008 00000100:00100000:0.0:1746126995.343242:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991355008 00000100:00100000:0.0:1746126995.343255:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991355136 00000100:00100000:0.0:1746126995.343258:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991355136 00000100:00100000:0.0:1746126995.343271:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991355264 00000100:00100000:0.0:1746126995.343274:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991355264 00000100:00100000:0.0:1746126995.343286:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991355392 00000100:00100000:0.0:1746126995.343288:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991355392 00000100:00100000:0.0:1746126995.343303:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20903 00000100:00100000:0.0:1746126995.343312:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2026:x1830945991354752:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.343330:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.343346:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a89a00/0x34dc807b6ef7e66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f8d expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.343366:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343368:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343376:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a89a00/0x34dc807b6ef7e66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f8d expref: 23 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343391:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a89a00/0x34dc807b6ef7e66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f8d expref: 23 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343402:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a89a00, rc 0) 00000100:00100000:0.0:1746126995.343451:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991354752:12345-192.168.203.42@tcp:101:cat.0 Request processed in 138us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.343457:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20903 00000100:00100000:0.0:1746126995.343474:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20904 00000100:00100000:0.0:1746126995.343481:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991354880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.343489:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.343499:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88a00/0x34dc807b6ef7e6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f94 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.343509:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343510:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343514:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88a00/0x34dc807b6ef7e6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f94 expref: 32 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343525:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88a00/0x34dc807b6ef7e6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f94 expref: 32 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343532:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88a00, rc 0) 00000100:00100000:0.0:1746126995.343554:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991354880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 73us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.343559:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20904 00000100:00100000:0.0:1746126995.343573:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20905 00000100:00100000:0.0:1746126995.343579:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991355008:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.343586:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.343593:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88800/0x34dc807b6ef7e74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51f9b expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.343604:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343605:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343609:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88800/0x34dc807b6ef7e74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f9b expref: 32 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343618:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88800/0x34dc807b6ef7e74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f9b expref: 32 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343630:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88800, rc 0) 00000100:00100000:0.0:1746126995.343651:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991355008:12345-192.168.203.42@tcp:101:cat.0 Request processed in 72us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.343656:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20905 00000100:00100000:0.0:1746126995.343669:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20906 00000100:00100000:0.0:1746126995.343675:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2027:x1830945991355136:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.343682:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.343689:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88400/0x34dc807b6ef7e7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51fa2 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.343700:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343701:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343705:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88400/0x34dc807b6ef7e7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa2 expref: 23 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343714:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88400/0x34dc807b6ef7e7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa2 expref: 23 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343722:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88400, rc 0) 00000100:00100000:0.0:1746126995.343744:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991355136:12345-192.168.203.42@tcp:101:cat.0 Request processed in 69us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.343749:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20906 00000100:00100000:0.0:1746126995.343761:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20907 00000100:00100000:0.0:1746126995.343768:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2026:x1830945991355264:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.343777:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.343784:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88e00/0x34dc807b6ef7e82 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51fa9 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.343794:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343796:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343800:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88e00/0x34dc807b6ef7e82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa9 expref: 23 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343809:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88e00/0x34dc807b6ef7e82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa9 expref: 23 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343817:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88e00, rc 0) 00000100:00100000:0.0:1746126995.343838:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f528c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991355264:12345-192.168.203.42@tcp:101:cat.0 Request processed in 71us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.343843:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20907 00000100:00100000:0.0:1746126995.343946:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20908 00000100:00100000:0.0:1746126995.343952:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991355392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.343960:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.343967:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88200/0x34dc807b6ef7e89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51fb0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.343978:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343979:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.343984:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88200/0x34dc807b6ef7e89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb0 expref: 32 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.343993:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88200/0x34dc807b6ef7e89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb0 expref: 32 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.344001:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88200, rc 0) 00000100:00100000:0.0:1746126995.344022:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991355392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 69us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.344027:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20908 00000100:00100000:0.0:1746126995.345455:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.349719:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.351790:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.353850:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.353902:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.353929:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.353946:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991356416 00000100:00100000:0.0:1746126995.353949:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991356416 00010000:00010000:0.0:1746126995.353967:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef7e20 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f71 expref: 15 pid: 16295 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.353983:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991356544 00000100:00100000:0.0:1746126995.353985:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991356544 00010000:00010000:0.0:1746126995.353992:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88e00/0x34dc807b6ef7e82 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa9 expref: 23 pid: 1507 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.354003:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9700 00000100:00100000:0.0:1746126995.354008:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991356416:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.354015:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.354029:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef7e20 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f71 expref: 15 pid: 16295 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.354043:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef7e20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f71 expref: 15 pid: 16295 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.354061:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126995.354084:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991356416:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.354089:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9700 00000100:00100000:0.0:1746126995.354112:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9701 00000100:00100000:0.0:1746126995.354117:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991356544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.354123:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.354145:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88e00/0x34dc807b6ef7e82 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa9 expref: 23 pid: 1507 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.354153:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88e00/0x34dc807b6ef7e82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa9 expref: 23 pid: 1507 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746126995.354164:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.354166:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.354171:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.354177:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.354198:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126995.354207:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994141824:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126995.354248:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.354333:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8270 00000100:00100000:0.0:1746126995.354338:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991356288:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126995.359145:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994141824:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126995.359163:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.359186:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945991356544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5069us (5256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.359193:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9701 00000100:00100000:1.0:1746126995.359231:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.359241:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991357568 00000100:00100000:1.0:1746126995.359244:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991357568 00002000:00100000:1.0:1746126995.359256:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880094f16680 x1830945991357568/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.359264:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f16680 with x1830945991357568 ext(1048576->2097151) 00002000:00010000:1.0:1746126995.359267:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f16680 00000100:00100000:1.0:1746126995.359274:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8274 00000100:00100000:1.0:1746126995.359278:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991357568:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126995.359595:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.378003:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.382004:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991357568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22722us (22769us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126995.382011:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8274 00002000:00100000:1.0:1746126995.382017:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880094f16680 x1830945991357568/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.382024:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f16680 with x1830945991357568 ext(1048576->2097151) 00002000:00010000:1.0:1746126995.382027:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f16680 00000100:00100000:0.0:1746126995.390387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.390456:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991358592 00000100:00100000:1.0:1746126995.390463:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991358592 00002000:00100000:1.0:1746126995.390501:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8801220f3800 x1830945991358592/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 504/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.390510:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f3800 with x1830945991358592 ext(2097152->4194303) 00002000:00010000:1.0:1746126995.390514:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801220f3800 00000100:00100000:1.0:1746126995.390545:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8277 00000100:00100000:1.0:1746126995.390551:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991358592:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126995.404649:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.404833:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.405326:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991358592:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14774us (14944us total) trans 0 rc 1859584/1859584 00000100:00100000:1.0:1746126995.405333:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8277 00002000:00100000:1.0:1746126995.405339:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8801220f3800 x1830945991358592/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 504/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 1859584/1859584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.405346:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f3800 with x1830945991358592 ext(2097152->4194303) 00010000:00010000:1.0:1746126995.405350:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 12 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.405359:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 12 pid: 1964 timeout: 990 lvb_type: 0 00002000:00010000:1.0:1746126995.405364:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f3800 00000100:00100000:0.0:1746126995.411636:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.411673:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991359104 00000100:00100000:0.0:1746126995.411679:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991359104 00002000:00100000:0.0:1746126995.411712:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3678208->3915775) req@ffff88012d22e680 x1830945991359104/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.411721:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22e680 with x1830945991359104 ext(3678208->3915775) 00010000:00010000:0.0:1746126995.411729:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 12 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.411742:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 12 pid: 1964 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746126995.411748:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d22e680 00000100:00100000:0.0:1746126995.411766:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1791 00000100:00100000:0.0:1746126995.411771:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991359104:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126995.427046:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.427239:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991359232 00000100:00100000:1.0:1746126995.427246:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991359232 00010000:00010000:1.0:1746126995.427275:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 14 pid: 1964 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.427303:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9702 00000100:00100000:1.0:1746126995.427309:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991359232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.427319:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746126995.427332:0:7246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746126993 -> 1746126994 00002000:00010000:1.0:1746126995.427334:0:7246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746126993 -> 1746126994 00010000:00010000:1.0:1746126995.427339:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 14 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.427353:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 14 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.427371:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef7e90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3915775) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fb7 expref: 14 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.427398:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.427400:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.427406:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef7e97 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fbe expref: 22 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.427413:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef7e97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fbe expref: 22 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.427437:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef7e97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fbe expref: 22 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.427445:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994142080:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126995.428179:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.433507:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.433667:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994142080:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126995.433689:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.433730:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991359232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6420us (6689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.433739:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9702 00000100:00100000:0.0:1746126995.441055:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.441396:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.442468:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.442497:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991359872 00000100:00100000:0.0:1746126995.442500:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991359872 00002000:00100000:0.0:1746126995.442513:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009cd65880 x1830945991359872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.442520:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65880 with x1830945991359872 ext(2097152->4194303) 00002000:00010000:0.0:1746126995.442523:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65880 00000100:00100000:0.0:1746126995.442531:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8280 00000100:00100000:0.0:1746126995.442535:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991360128:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126995.446401:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.455303:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.455591:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991360384 00000100:00100000:1.0:1746126995.455598:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991360384 00010000:00010000:1.0:1746126995.455625:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7e0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f55 expref: 14 pid: 9611 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.455708:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9703 00000100:00100000:1.0:1746126995.455715:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991360384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.455726:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.455743:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7e0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f55 expref: 14 pid: 9611 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.455818:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7e0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f55 expref: 14 pid: 9611 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.455837:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e57600/0x34dc807b6ef7e0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f55 expref: 14 pid: 9611 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.455863:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.455890:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991360384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 175us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.455896:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9703 00000100:00100000:1.0:1746126995.456822:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.460447:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991360128:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17903us (19044us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746126995.460458:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8280 00002000:00100000:0.0:1746126995.460469:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a8ee8380 x1830945991360128/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.460478:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee8380 with x1830945991360128 ext(2097152->4194303) 00002000:00010000:0.0:1746126995.460484:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8ee8380 00000100:00100000:0.0:1746126995.462369:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.462516:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.463549:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991360896 00000100:00100000:1.0:1746126995.463553:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991360896 00002000:00100000:1.0:1746126995.463577:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9c:0x0] (897024->901119) req@ffff88009cd64e00 x1830945991360896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.463585:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64e00 with x1830945991360896 ext(897024->901119) 00002000:00010000:1.0:1746126995.463589:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64e00 00000100:00100000:1.0:1746126995.463605:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8282 00000100:00100000:1.0:1746126995.463610:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991360896:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126995.463984:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991359872:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20484us (21515us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746126995.463992:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8281 00002000:00100000:0.0:1746126995.463998:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009cd65880 x1830945991359872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.464004:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65880 with x1830945991359872 ext(2097152->4194303) 00002000:00010000:0.0:1746126995.464007:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65880 00000100:00100000:1.0:1746126995.464337:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991360896:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 726us (1821us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126995.464343:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8282 00002000:00100000:1.0:1746126995.464348:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9c:0x0] (897024->901119) req@ffff88009cd64e00 x1830945991360896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/4536 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.464355:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64e00 with x1830945991360896 ext(897024->901119) 00002000:00010000:1.0:1746126995.464357:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64e00 00000100:00100000:0.0:1746126995.468285:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.472225:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991361280 00000100:00100000:1.0:1746126995.472232:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991361280 00002000:00100000:1.0:1746126995.472270:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880095c07100 x1830945991361280/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.472279:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07100 with x1830945991361280 ext(4194304->4829183) 00002000:00010000:1.0:1746126995.472283:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c07100 00000100:00100000:1.0:1746126995.472298:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8283 00000100:00100000:1.0:1746126995.472303:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991361280:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126995.477238:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.477399:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991361280:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5095us (5694us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746126995.477407:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8283 00002000:00100000:1.0:1746126995.477414:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880095c07100 x1830945991361280/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.477421:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07100 with x1830945991361280 ext(4194304->4829183) 00002000:00010000:1.0:1746126995.477425:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c07100 00000100:00100000:0.0:1746126995.479247:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.479288:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.482174:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.482200:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.482535:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20917 00000100:00100000:1.0:1746126995.482541:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991361920:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126995.482547:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.482554:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096620200/0x34dc807b6ef7ec8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51fef expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.482574:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994143232:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126995.482593:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.484251:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.484312:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991362176 00000100:00100000:1.0:1746126995.484317:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991362176 00002000:00100000:1.0:1746126995.484344:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0fb80 x1830945991362176/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.484353:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0fb80 with x1830945991362176 ext(4194304->4829183) 00002000:00010000:1.0:1746126995.484357:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0fb80 00000100:00100000:1.0:1746126995.484965:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8284 00000100:00100000:1.0:1746126995.484973:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991362176:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:1.0:1746126995.487083:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746126992 -> 1746126994 00002000:00010000:1.0:1746126995.487089:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746126987 -> 1746126994 00002000:00010000:1.0:1746126995.487090:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746126992 -> 1746126994 00000100:00100000:1.0:1746126995.487116:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994143232:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126995.487162:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096620200/0x34dc807b6ef7ec8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fef expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.487173:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096620200/0x34dc807b6ef7ec8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fef expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.488327:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620200, rc 0) 00000100:00100000:1.0:1746126995.488371:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991361920:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5829us (6169us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126995.488377:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20917 00000100:00100000:0.0:1746126995.490926:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.491217:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991362176:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6244us (6968us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746126995.491223:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8284 00002000:00100000:1.0:1746126995.491229:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0fb80 x1830945991362176/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.491236:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0fb80 with x1830945991362176 ext(4194304->4829183) 00002000:00010000:1.0:1746126995.491239:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0fb80 00000100:00100000:0.0:1746126995.492277:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.492313:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.492371:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991362688 00000100:00100000:1.0:1746126995.492375:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991362688 00000100:00100000:1.0:1746126995.492400:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20919 00000100:00100000:1.0:1746126995.492405:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991362688:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126995.492412:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.492420:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096620000/0x34dc807b6ef7ed6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e51ffd expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.492455:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994143360:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126995.492567:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126995.494835:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994143360:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126995.494862:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096620000/0x34dc807b6ef7ed6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ffd expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.494875:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096620000/0x34dc807b6ef7ed6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51ffd expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.494901:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620000, rc 0) 00000100:00100000:1.0:1746126995.494933:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991362688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2526us (2619us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126995.494939:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20919 00000100:00100000:0.0:1746126995.495653:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.518018:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.538670:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.544092:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.549805:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.556899:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.566543:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.619656:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.628884:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.628919:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.653926:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.663248:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.670813:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.698666:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.707288:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.707325:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.708585:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.708875:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.709414:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991366272 00000100:00100000:1.0:1746126995.709418:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991366272 00000100:00100000:0.0:1746126995.709432:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.709434:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20926 00000100:00100000:1.0:1746126995.709439:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991366272:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126995.709444:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.709450:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6ef7f46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5203c expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126995.709459:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126995.709460:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.709461:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.709466:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6ef7f46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5203c expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126995.709471:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991366400 00000100:00100000:0.0:1746126995.709473:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991366400 00010000:00010000:1.0:1746126995.709475:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6ef7f46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5203c expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.709482:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9200, rc 0) 00000100:00100000:0.0:1746126995.709488:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991366528 00000100:00100000:0.0:1746126995.709489:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991366528 00000100:00100000:0.0:1746126995.709499:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20927 00000100:00100000:1.0:1746126995.709502:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991366272:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 63us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.709504:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991366400:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126995.709510:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126995.709511:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20926 00010000:00010000:0.0:1746126995.709516:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096620600/0x34dc807b6ef7f4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52043 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.709523:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20928 00010000:00010000:0.0:1746126995.709526:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.709527:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746126995.709528:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991366528:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126995.709532:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096620600/0x34dc807b6ef7f4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52043 expref: 12 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.709533:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.709539:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6ef7f54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5204a expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.709540:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096620600/0x34dc807b6ef7f4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52043 expref: 12 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.709546:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620600, rc 0) 00010000:00010000:1.0:1746126995.709547:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.709548:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.709552:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6ef7f54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5204a expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.709559:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6ef7f54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5204a expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126995.709563:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991366400:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 59us (131us total) trans 0 rc 0/0 00010000:00010000:1.0:1746126995.709565:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e8e00, rc 0) 00000100:00100000:0.0:1746126995.709569:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20927 00000100:00100000:1.0:1746126995.709580:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991366528:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.709585:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20928 00000100:00100000:0.0:1746126995.724921:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.725006:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991366784 00000100:00100000:1.0:1746126995.725015:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991366784 00000100:00100000:1.0:1746126995.726871:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17110 00000100:00100000:1.0:1746126995.726879:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:3918:x1830945991366784:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126995.726896:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.726912:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6ef7f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52051 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.727006:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126995.727019:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c48c800/0x34dc807b6ef7e58 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f86 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.727026:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef7ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52004 expref: 12 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.727033:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980a00/0x34dc807b6ef7f2a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52020 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.727040:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126995.727066:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980a00/0x34dc807b6ef7f2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52020 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.727075:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980a00/0x34dc807b6ef7f2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52020 expref: 8 pid: 11634 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.727085:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994144640:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126995.727198:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef7ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52004 expref: 12 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.727206:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef7ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52004 expref: 12 pid: 11634 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.727217:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994144768:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126995.727242:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c48c800/0x34dc807b6ef7e58 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f86 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.727249:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c48c800/0x34dc807b6ef7e58 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f86 expref: 30 pid: 11634 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.727255:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994144896:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.727268:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.728555:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.728586:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.728620:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.728648:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991367040 00000100:00100000:0.0:1746126995.728653:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991367040 00000100:00100000:0.0:1746126995.728678:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991366912 00000100:00100000:0.0:1746126995.728680:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991366912 00000100:00100000:0.0:1746126995.728691:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991367168 00000100:00100000:0.0:1746126995.728693:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991367168 00000100:00100000:0.0:1746126995.728717:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20929 00000100:00100000:0.0:1746126995.728723:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991367040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.728735:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.728745:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096620800/0x34dc807b6ef7f69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5205f expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126995.728776:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1788700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994145024:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126995.728823:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.728886:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20930 00000100:00100000:0.0:1746126995.728892:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991366912:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.728899:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.728907:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef7f70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52058 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126995.728929:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994145152:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126995.728952:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.728990:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20931 00000100:00100000:0.0:1746126995.728995:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991367168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126995.729000:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.729006:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef7f77 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52066 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.729015:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.729016:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.729022:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef7f77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52066 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.729032:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6ef7f77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52066 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.729039:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918aa00, rc 0) 00000100:00100000:0.0:1746126995.729057:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991367168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 62us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.729061:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20931 00000100:00100000:0.0:1746126995.733452:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.733587:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1788700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994145024:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126995.733620:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096620800/0x34dc807b6ef7f69 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5205f expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.733631:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096620800/0x34dc807b6ef7f69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5205f expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.733649:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620800, rc 0) 00000100:00100000:0.0:1746126995.733698:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991367040:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4973us (5144us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126995.733705:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20929 00000100:00100000:1.0:1746126995.733924:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994144640:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.733933:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994144768:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.733939:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994144896:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126995.733955:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746126995.735058:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.735092:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.735755:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126995.736972:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7000/0x34dc807b6ef7f85 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.736978:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7000/0x34dc807b6ef7f85 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:0.0:1746126995.736991:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746126995.737085:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6ef7f7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5206d expref: 34 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.737096:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7000/0x34dc807b6ef7f85 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5206d expref: 33 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.737113:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126995.737116:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746126995.737118:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc7000, rc 0) 00000100:00100000:0.0:1746126995.737153:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:3923:x1830945991367424:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2957us (3708us total) trans 8589938008 rc 0/0 00000100:00100000:0.0:1746126995.737159:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17111 00000100:00100000:1.0:1746126995.737294:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994145152:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126995.737476:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef7f70 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52058 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.737485:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef7f70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52058 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.737496:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b400, rc 0) 00000100:00100000:1.0:1746126995.737518:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991366912:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8627us (8931us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126995.737525:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20930 00010000:00010000:1.0:1746126995.738301:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126995.738307:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126995.738318:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126995.738377:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6ef7f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52051 expref: 9 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.738388:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52051 expref: 8 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.738394:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126995.738396:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126995.738398:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9e00, rc 0) 00000100:00100000:1.0:1746126995.740187:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:3918:x1830945991366784:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 13300us (15264us total) trans 8589938009 rc 0/0 00000100:00100000:1.0:1746126995.740197:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17110 00000100:00100000:1.0:1746126995.740601:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991367936 00000100:00100000:1.0:1746126995.740607:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991367936 00000100:00100000:1.0:1746126995.740638:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20932 00000100:00100000:1.0:1746126995.740644:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:3924:x1830945991367936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126995.740656:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.740669:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6ef7f9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52074 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.740693:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7e00/0x34dc807b6ef7ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 897024->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fcc expref: 22 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.740700:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126995.740702:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126995.740704:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6ef7f9a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52074 expref: 14 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.740726:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc7e00/0x34dc807b6ef7ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 897024->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fcc expref: 22 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.740735:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136bc7e00/0x34dc807b6ef7ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 897024->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fcc expref: 22 pid: 1964 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.740745:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994145280:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.742242:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.742310:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991368064 00000100:00100000:0.0:1746126995.742317:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991368064 00000100:00100000:0.0:1746126995.742351:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17112 00000100:00100000:0.0:1746126995.742358:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:3918:x1830945991368064:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126995.742374:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.742387:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6ef7fa1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5207b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.742461:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef7fa8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126995.742472:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52051 expref: 9 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.742478:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7000/0x34dc807b6ef7f85 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5206d expref: 31 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.742483:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef7fa8 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126995.742504:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7000/0x34dc807b6ef7f85 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5206d expref: 31 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.742511:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7000/0x34dc807b6ef7f85 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5206d expref: 31 pid: 11634 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.742519:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994145408:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.743118:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa4296c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746126995.743983:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52051 expref: 9 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.744072:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9e00/0x34dc807b6ef7f62 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52051 expref: 9 pid: 7260 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.744080:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994145536:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.744123:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126995.745202:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994145280:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126995.745223:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6ef7f9a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52074 expref: 14 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.745235:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9c00, rc 0) 00000100:00100000:1.0:1746126995.745415:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:3924:x1830945991367936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4770us (4832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.745422:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20932 00000100:00100000:0.0:1746126995.745905:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.745941:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.747475:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.750436:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.750470:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.750834:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20934 00000100:00100000:1.0:1746126995.750841:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991368704:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126995.750848:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.750856:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9400/0x34dc807b6ef7fb6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52089 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.750877:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994145792:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126995.750899:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa4296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.752237:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.752448:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994145792:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126995.752464:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9400/0x34dc807b6ef7fb6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52089 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.752474:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9400/0x34dc807b6ef7fb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52089 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.752481:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9400, rc 0) 00000100:00100000:1.0:1746126995.752498:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991368704:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1658us (2028us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126995.752519:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20934 00000100:00100000:0.0:1746126995.753407:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.755266:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.755331:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.755344:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991369344 00000100:00100000:0.0:1746126995.755346:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991369344 00000100:00100000:0.0:1746126995.755372:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17114 00000100:00100000:0.0:1746126995.755376:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:3918:x1830945991369344:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126995.755384:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.755391:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef7fcb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5209e expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.755448:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755457:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755468:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755477:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755481:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755486:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755491:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918ac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126995.755494:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755499:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755506:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126995.755509:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126995.755512:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755516:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef7fd2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.755544:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef7fcb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5209e expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.755550:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef7fcb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5209e expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.755559:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b000, rc 0) 00000100:00100000:0.0:1746126995.755574:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:3918:x1830945991369344:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 198us (243us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126995.755580:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17114 00000100:00100000:0.0:1746126995.756620:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.758269:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.761243:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.762083:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.762192:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991370240 00000100:00100000:1.0:1746126995.762196:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991370240 00010000:00010000:1.0:1746126995.762211:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88400/0x34dc807b6ef7e7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa2 expref: 25 pid: 1507 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746126995.762464:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.763390:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991370112 00000100:00100000:1.0:1746126995.763393:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991370112 00010000:00010000:1.0:1746126995.763408:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7e19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f6a expref: 16 pid: 12333 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746126995.763428:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9716 00000100:00100000:1.0:1746126995.763433:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991370240:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.763441:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.763453:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88400/0x34dc807b6ef7e7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa2 expref: 25 pid: 1507 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.763461:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88400/0x34dc807b6ef7e7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa2 expref: 25 pid: 1507 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.763477:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88400/0x34dc807b6ef7e7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fa2 expref: 25 pid: 1507 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.763486:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.763502:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991370240:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 69us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.763507:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9716 00000100:00100000:1.0:1746126995.763517:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9717 00000100:00100000:1.0:1746126995.763522:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991370112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.763528:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.763533:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7e19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f6a expref: 16 pid: 12333 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.763540:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7e19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f6a expref: 16 pid: 12333 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.763550:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d200/0x34dc807b6ef7e19 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f6a expref: 16 pid: 12333 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746126995.763558:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.763559:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.763564:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6ef7fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52097 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.763570:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6ef7fc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52097 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.763591:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6ef7fc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52097 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.763601:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994146432:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126995.763635:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa4296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126995.765472:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994146432:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126995.765485:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.765517:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991370112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1994us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.765524:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9717 00000100:00100000:0.0:1746126995.766568:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.771595:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.775425:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.775461:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.778320:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.789857:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.789923:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991371392 00000100:00100000:1.0:1746126995.789931:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991371392 00010000:00010000:1.0:1746126995.789960:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36400/0x34dc807b6ef7eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fda expref: 34 pid: 1964 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.789999:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9718 00000100:00100000:1.0:1746126995.790009:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991371392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.790023:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126995.790038:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c36400/0x34dc807b6ef7eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fda expref: 34 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.790051:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c36400/0x34dc807b6ef7eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fda expref: 34 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.790068:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c36400/0x34dc807b6ef7eb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fda expref: 34 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.790094:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.790096:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.790109:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136bc6200/0x34dc807b6ef7fd9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520a5 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.790117:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136bc6200/0x34dc807b6ef7fd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520a5 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.790172:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136bc6200/0x34dc807b6ef7fd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520a5 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.790185:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994146688:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126995.790730:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa4296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.794486:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.794645:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994146688:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126995.794662:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.794701:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991371392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4696us (4850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.794709:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9718 00000100:00100000:0.0:1746126995.809447:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.815192:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.832292:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.832601:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991372288 00000100:00100000:1.0:1746126995.832609:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991372288 00010000:00010000:1.0:1746126995.832639:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6ef7fc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1490944->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52097 expref: 26 pid: 1964 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.832999:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9719 00000100:00100000:1.0:1746126995.833006:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2028:x1830945991372288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126995.833018:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746126995.833034:0:11948:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746126993 -> 1746126994 00002000:00010000:1.0:1746126995.833037:0:11948:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746126993 -> 1746126994 00010000:00010000:1.0:1746126995.833041:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6ef7fc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1490944->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52097 expref: 26 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.833051:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6ef7fc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1490944->1839103) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52097 expref: 26 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.833071:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6ef7fc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1490944->1839103) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52097 expref: 26 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746126995.833378:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.833381:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.833388:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef8003 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520b3 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.833397:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef8003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520b3 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.833425:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef8003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520b3 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126995.833436:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994146944:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126995.833514:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa4296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.834379:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.842322:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.842356:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994146944:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126995.842359:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126995.842373:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126995.842418:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991372288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 9412us (10133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.842429:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9719 00000100:00100000:0.0:1746126995.845564:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.847967:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991373312 00000100:00100000:1.0:1746126995.847972:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991373312 00000100:00100000:1.0:1746126995.848005:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991373568 00000100:00100000:1.0:1746126995.848007:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991373568 00000100:00100000:1.0:1746126995.848024:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20940 00000100:00100000:1.0:1746126995.848028:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991373568:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126995.848033:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.848038:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e8800/0x34dc807b6ef803b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e520d6 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.848049:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.848050:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.848056:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8800/0x34dc807b6ef803b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520d6 expref: 28 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.848066:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991e8800/0x34dc807b6ef803b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520d6 expref: 28 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.848072:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e8800, rc 0) 00000100:00100000:1.0:1746126995.848543:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991373568:12345-192.168.203.42@tcp:101:cat.0 Request processed in 513us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.848549:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20940 00000100:00100000:1.0:1746126995.853335:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.861789:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.861836:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:1.0:1746126995.862649:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1204224->1208319) req@ffff88007ece4000 x1830945991373952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.862657:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4000 with x1830945991373952 ext(1204224->1208319) 00002000:00010000:1.0:1746126995.862662:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece4000 00000100:00100000:1.0:1746126995.862856:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8297 00000100:00100000:1.0:1746126995.862863:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991373952:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126995.862927:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991373952:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 64us (1145us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126995.862932:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8297 00002000:00100000:1.0:1746126995.862937:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1204224->1208319) req@ffff88007ece4000 x1830945991373952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/4536 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.862943:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4000 with x1830945991373952 ext(1204224->1208319) 00002000:00010000:1.0:1746126995.862945:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece4000 00000100:00100000:0.0:1746126995.868996:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.869037:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.869156:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8298 00000100:00100000:0.0:1746126995.869164:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991374464:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126995.870983:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991374976 00000100:00100000:0.0:1746126995.870989:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991374976 00002000:00100000:0.0:1746126995.871011:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1617920->1622015) req@ffff880095c05f80 x1830945991374976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.871018:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c05f80 with x1830945991374976 ext(1617920->1622015) 00002000:00010000:0.0:1746126995.871022:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c05f80 00000100:00100000:0.0:1746126995.871043:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8300 00000100:00100000:0.0:1746126995.871048:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991374976:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126995.871124:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991374976:12345-192.168.203.42@tcp:3:cat.0 Request processed in 76us (285us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126995.871144:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8300 00002000:00100000:0.0:1746126995.871149:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1617920->1622015) req@ffff880095c05f80 x1830945991374976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:1/0 lens 488/4536 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126995.871155:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c05f80 with x1830945991374976 ext(1617920->1622015) 00002000:00010000:0.0:1746126995.871157:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c05f80 00000100:00100000:0.0:1746126995.887678:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.888660:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.888684:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991375360 00000100:00100000:1.0:1746126995.888688:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991375360 00000100:00100000:1.0:1746126995.888724:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20942 00000100:00100000:1.0:1746126995.888730:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:3931:x1830945991375360:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126995.888739:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.888751:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bda00/0x34dc807b6ef8049 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e520dd expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.888770:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef802d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520c1 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.888776:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126995.888777:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126995.888780:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bda00/0x34dc807b6ef8049 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520dd expref: 34 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.888803:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef802d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1622015) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520c1 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.888812:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef802d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1622015) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520c1 expref: 13 pid: 1964 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746126995.888867:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994147328:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126995.888931:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126995.890426:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994147328:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126995.890444:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bda00/0x34dc807b6ef8049 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520dd expref: 34 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.890459:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bda00, rc 0) 00000100:00100000:1.0:1746126995.890484:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:3931:x1830945991375360:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1754us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.890490:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20942 00000100:00100000:0.0:1746126995.897319:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.902165:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994147456 00000100:00100000:0.0:1746126995.902174:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994147456 00000100:00100000:1.0:1746126995.902864:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1746126995.902872:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994147456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746126995.902892:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1130437952 pending 2203648 free 3907129344 avail 3664502784 00000100:00100000:1.0:1746126995.902941:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994147456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.902946:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1746126995.913759:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.915161:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991375616 00000100:00100000:1.0:1746126995.915169:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991375616 00010000:00010000:1.0:1746126995.915201:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef802d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520c1 expref: 16 pid: 1964 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746126995.917383:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9721 00000100:00100000:0.0:1746126995.917395:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991375616:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126995.917410:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126995.917429:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef802d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520c1 expref: 16 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.917440:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef802d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1622015) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520c1 expref: 16 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.917458:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6ef802d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1622015) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520c1 expref: 16 pid: 1964 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746126995.917476:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.917478:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.917484:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bda00/0x34dc807b6ef8049 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520dd expref: 33 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.917490:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bda00/0x34dc807b6ef8049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520dd expref: 33 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.917510:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bda00/0x34dc807b6ef8049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520dd expref: 33 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126995.917517:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994147712:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126995.918592:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.927368:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.927417:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.928091:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991376000 00000100:00100000:1.0:1746126995.928108:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991376000 00002000:00100000:1.0:1746126995.928171:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba55180 x1830945991376000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.928181:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba55180 with x1830945991376000 ext(1048576->2097151) 00002000:00010000:1.0:1746126995.928185:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba55180 00000100:00100000:1.0:1746126995.928210:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991376128 00000100:00100000:1.0:1746126995.928213:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991376128 00002000:00100000:1.0:1746126995.928224:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012ba56d80 x1830945991376128/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/0 e 0 to 0 dl 1746127006 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.928235:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba56d80 with x1830945991376128 ext(1048576->2097151) 00002000:00010000:1.0:1746126995.928238:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba56d80 00000100:00100000:1.0:1746126995.928395:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8302 00000100:00100000:1.0:1746126995.928400:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991376128:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126995.938715:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991376128:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10312us (11296us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126995.938722:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8302 00002000:00100000:1.0:1746126995.938728:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012ba56d80 x1830945991376128/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:1/0 lens 488/440 e 0 to 0 dl 1746127006 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126995.938735:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba56d80 with x1830945991376128 ext(1048576->2097151) 00002000:00010000:1.0:1746126995.938738:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba56d80 00000100:00100000:0.0:1746126995.982061:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.986250:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126995.986282:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.986949:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991376384 00000100:00100000:1.0:1746126995.986957:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991376384 00000100:00100000:0.0:1746126995.986966:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126995.986991:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991376512 00000100:00100000:1.0:1746126995.986994:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991376512 00000100:00100000:1.0:1746126995.987269:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991376640 00000100:00100000:1.0:1746126995.987272:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991376640 00000100:00100000:1.0:1746126995.987289:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20944 00000100:00100000:1.0:1746126995.987294:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991376512:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126995.987301:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126995.987313:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bc400/0x34dc807b6ef806c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e520f2 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126995.987330:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126995.987336:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746126995.987338:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20945 00010000:00010000:1.0:1746126995.987341:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bc400/0x34dc807b6ef806c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f2 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126995.987346:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991376640:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126995.987353:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.987360:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e520f9 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.987371:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.987373:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126995.987378:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.987388:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126995.987394:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096621000, rc 0) 00000100:00100000:0.0:1746126995.987412:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991376640:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 68us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126995.987417:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20945 00010000:00010000:1.0:1746126995.987589:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bc400/0x34dc807b6ef806c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f2 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126995.987598:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc400, rc 0) 00000100:00100000:1.0:1746126995.987616:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991376512:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 322us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126995.987622:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20944 00000100:00100000:0.0:1746126995.992981:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991377024 00000100:00100000:0.0:1746126995.995548:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991377024 00000100:00100000:0.0:1746126995.995686:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17118 00000100:00100000:0.0:1746126995.995694:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:3935:x1830945991377024:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126995.995709:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126995.995724:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096620c00/0x34dc807b6ef8081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52100 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.995798:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096620400/0x34dc807b6ef8088 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.995807:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef7fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5207b expref: 10 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.995814:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6000/0x34dc807b6ef7ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520ac expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.995819:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef801f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520ba expref: 35 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.995824:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096620400/0x34dc807b6ef8088 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126995.995847:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef801f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520ba expref: 35 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.995855:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef801f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520ba expref: 35 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126995.995864:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994147840:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126995.997007:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6000/0x34dc807b6ef7ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520ac expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.997017:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6000/0x34dc807b6ef7ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520ac expref: 14 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126995.997029:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994147968:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126995.997063:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef7fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5207b expref: 10 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126995.997070:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef7fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5207b expref: 10 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126995.997076:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994148096:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.997088:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126995.999452:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994147840:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.999461:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994147968:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126995.999467:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994148096:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126995.999499:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096620400/0x34dc807b6ef8088 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:0.0:1746126996.003751:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.008538:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126996.009440:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef809d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.009445:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef809d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:0.0:1746126996.009484:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126996.009487:0:7260:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126996.009500:0:7260:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef809d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.009523:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6ef8096 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52107 expref: 11 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.009549:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef809d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52107 expref: 10 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.009555:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126996.009557:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126996.009560:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44400, rc 0) 00000100:00100000:0.0:1746126996.009586:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:3935:x1830945991377664:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5093us (5840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.009592:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17119 00000100:00100000:0.0:1746126996.016111:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.019030:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.024706:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.030363:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.034203:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.034520:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991379072 00000100:00100000:1.0:1746126996.034528:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991379072 00000100:00100000:1.0:1746126996.034595:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20946 00000100:00100000:1.0:1746126996.034605:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991379072:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126996.034622:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.034638:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef80f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52123 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.034658:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.034660:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.034669:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef80f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52123 expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.034683:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef80f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52123 expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.034694:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd400, rc 0) 00000100:00100000:1.0:1746126996.034763:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991379072:12345-192.168.203.42@tcp:101:cat.0 Request processed in 159us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.034771:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20946 00000100:00100000:0.0:1746126996.046044:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.046183:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991379328 00000100:00100000:1.0:1746126996.046193:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991379328 00002000:00100000:1.0:1746126996.046237:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba55c00 x1830945991379328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.046247:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba55c00 with x1830945991379328 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.046252:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba55c00 00000100:00100000:1.0:1746126996.046299:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8303 00000100:00100000:1.0:1746126996.046308:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991379328:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126996.055534:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991379328:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9220us (9490us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126996.055544:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8303 00002000:00100000:1.0:1746126996.055553:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba55c00 x1830945991379328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.055561:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba55c00 with x1830945991379328 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.055565:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba55c00 00000100:00100000:0.0:1746126996.082035:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.084486:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.098007:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126996.098775:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126996.107034:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.107062:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.107083:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.107116:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.107172:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991380096 00000100:00100000:0.0:1746126996.107179:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991380096 00010000:00010000:0.0:1746126996.107208:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef7f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52035 expref: 10 pid: 1964 timeout: 991 lvb_type: 1 00000100:00100000:0.0:1746126996.107228:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9726 00000100:00100000:0.0:1746126996.107234:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991380096:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126996.107384:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9728 00000100:00100000:1.0:1746126996.107393:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991380352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126996.107502:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126996.107517:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef7f3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52035 expref: 10 pid: 1964 timeout: 991 lvb_type: 1 00010000:00010000:0.0:1746126996.107527:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef7f3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52035 expref: 10 pid: 1964 timeout: 991 lvb_type: 1 00010000:00010000:0.0:1746126996.107543:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef7f3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52035 expref: 10 pid: 1964 timeout: 991 lvb_type: 1 00010000:00010000:0.0:1746126996.107558:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126996.107590:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991380096:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 356us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.107596:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9726 00010000:00010000:1.0:1746126996.108026:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.108037:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6a00/0x34dc807b6ef7e12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f63 expref: 16 pid: 11152 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.108213:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6a00/0x34dc807b6ef7e12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f63 expref: 16 pid: 11152 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.108228:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6a00/0x34dc807b6ef7e12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f63 expref: 16 pid: 11152 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.108248:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.108249:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.108254:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.108261:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.108286:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.108296:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994148736:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126996.108338:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126996.110698:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.110725:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991380736 00000100:00100000:0.0:1746126996.110732:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991380736 00002000:00100000:0.0:1746126996.111363:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1269760->1273855) req@ffff88007ec7b800 x1830945991380736/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.111372:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7b800 with x1830945991380736 ext(1269760->1273855) 00002000:00010000:0.0:1746126996.111376:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec7b800 00000100:00100000:0.0:1746126996.111408:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8304 00000100:00100000:0.0:1746126996.111415:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991380736:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126996.111512:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991380736:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 98us (819us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126996.111518:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8304 00002000:00100000:0.0:1746126996.111523:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1269760->1273855) req@ffff88007ec7b800 x1830945991380736/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.111529:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7b800 with x1830945991380736 ext(1269760->1273855) 00002000:00010000:0.0:1746126996.111532:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec7b800 00000100:00100000:1.0:1746126996.111711:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994148736:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126996.111725:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.111746:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991380352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4355us (4662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.111753:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9728 00000100:00100000:0.0:1746126996.122544:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.125331:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.126901:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.128576:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.128614:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.128650:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.128664:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991381632 00000100:00100000:0.0:1746126996.128667:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991381632 00010000:00010000:0.0:1746126996.128684:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef809d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52107 expref: 11 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126996.128698:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991381760 00000100:00100000:0.0:1746126996.128706:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991381760 00010000:00010000:0.0:1746126996.128714:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef80ea lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5211c expref: 19 pid: 11634 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126996.128730:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991381888 00000100:00100000:0.0:1746126996.128732:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991381888 00010000:00010000:0.0:1746126996.128740:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44200/0x34dc807b6ef8114 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5212a expref: 41 pid: 11634 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126996.128751:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9729 00000100:00100000:0.0:1746126996.128756:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991381632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126996.128763:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126996.128767:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef809d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52107 expref: 11 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.128775:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef809d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52107 expref: 11 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.128791:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126996.128795:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef8137 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.128802:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef8137 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.128812:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126996.128829:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991381632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 73us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.128835:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9729 00000100:00100000:0.0:1746126996.128845:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9731 00000100:00100000:0.0:1746126996.128849:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991381888:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126996.128854:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126996.128858:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44200/0x34dc807b6ef8114 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5212a expref: 41 pid: 11634 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.128870:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44200/0x34dc807b6ef8114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5212a expref: 41 pid: 11634 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.128879:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126996.128881:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef8137 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.128887:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef8137 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.128892:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef8137 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.128907:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126996.128920:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991381888:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.128926:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9731 00000100:00100000:0.0:1746126996.148720:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.153174:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.153196:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991382144 00000100:00100000:1.0:1746126996.153204:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991382144 00010000:00010000:1.0:1746126996.153230:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bc400/0x34dc807b6ef806c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f2 expref: 9 pid: 9611 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.153255:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9732 00000100:00100000:1.0:1746126996.153261:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991382144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.153271:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.153284:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bc400/0x34dc807b6ef806c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f2 expref: 9 pid: 9611 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.153292:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bc400/0x34dc807b6ef806c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f2 expref: 9 pid: 9611 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.153308:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc400/0x34dc807b6ef806c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f2 expref: 9 pid: 9611 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.153331:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.153357:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991382144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 96us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.153362:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9732 00000100:00100000:0.0:1746126996.157210:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.157279:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.157347:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991382400 00000100:00100000:1.0:1746126996.157354:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991382400 00010000:00010000:1.0:1746126996.157377:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bda00/0x34dc807b6ef8049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520dd expref: 34 pid: 9611 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.157394:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991382272 00000100:00100000:1.0:1746126996.157395:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991382272 00010000:00010000:1.0:1746126996.157402:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef80f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52123 expref: 16 pid: 9611 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.157423:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9734 00000100:00100000:1.0:1746126996.157428:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991382272:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.157434:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.157446:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef80f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52123 expref: 16 pid: 9611 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.157456:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef80f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52123 expref: 16 pid: 9611 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.157648:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd400/0x34dc807b6ef80f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52123 expref: 16 pid: 9611 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.157659:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.157660:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.157665:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03000/0x34dc807b6ef8145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1544191) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52146 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.157672:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03000/0x34dc807b6ef8145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1544191) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52146 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.157696:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd03000/0x34dc807b6ef8145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1544191) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52146 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.157705:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994149632:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126996.158115:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126996.161779:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994149632:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126996.161799:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.161831:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991382272:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4401us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.161839:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9734 00000100:00100000:0.0:1746126996.162248:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.168777:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.190389:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.197272:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.200052:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.211953:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.212321:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8308 00000100:00100000:1.0:1746126996.212329:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991383808:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126996.218310:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991383808:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5974us (6356us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746126996.218319:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8308 00002000:00100000:1.0:1746126996.218329:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007ec79f80 x1830945991383808/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 504/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.218338:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79f80 with x1830945991383808 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.218342:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec79f80 00000100:00100000:0.0:1746126996.230410:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.233950:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.234428:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991384064 00000100:00100000:1.0:1746126996.234436:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991384064 00002000:00100000:1.0:1746126996.234471:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1269760->2011135) req@ffff88007ec79180 x1830945991384064/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.234481:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79180 with x1830945991384064 ext(1269760->2011135) 00010000:00010000:1.0:1746126996.234488:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 33 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.234501:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 33 pid: 11152 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.234512:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ec79180 00000100:00100000:1.0:1746126996.234544:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1797 00000100:00100000:1.0:1746126996.234551:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991384064:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746126996.243118:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991384064:12345-192.168.203.42@tcp:4:cat.0 Request processed in 8566us (9171us total) trans 17179875487 rc 0/0 00000100:00100000:1.0:1746126996.243126:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1797 00002000:00100000:1.0:1746126996.243159:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1269760->2011135) req@ffff88007ec79180 x1830945991384064/t17179875487(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/448 e 0 to 0 dl 1746127007 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.243167:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79180 with x1830945991384064 ext(1269760->2011135) 00010000:00010000:1.0:1746126996.243173:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.243183:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.243189:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ec79180 00000100:00100000:0.0:1746126996.245947:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.246045:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991384448 00000100:00100000:1.0:1746126996.246053:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991384448 00010000:00010000:1.0:1746126996.246081:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.246151:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9735 00000100:00100000:1.0:1746126996.246159:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991384448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.246217:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.246233:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.246243:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.246261:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8122 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2011135) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52131 expref: 35 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.246289:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.246291:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.246298:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009867fe00/0x34dc807b6ef8176 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5215b expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.246305:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009867fe00/0x34dc807b6ef8176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5215b expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.246334:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009867fe00/0x34dc807b6ef8176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5215b expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.246344:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994150272:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126996.246419:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126996.250072:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994150272:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126996.250090:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.250168:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991384448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4009us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.250178:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9735 00000100:00100000:0.0:1746126996.253726:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.253800:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.254406:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8309 00000100:00100000:0.0:1746126996.254411:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991384832:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.263960:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.264161:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991385088 00000100:00100000:1.0:1746126996.264169:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991385088 00010000:00010000:1.0:1746126996.264196:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03000/0x34dc807b6ef8145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52146 expref: 18 pid: 11152 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.264234:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9736 00000100:00100000:1.0:1746126996.264241:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991385088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.264252:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.264266:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd03000/0x34dc807b6ef8145 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52146 expref: 18 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.264276:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd03000/0x34dc807b6ef8145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1544191) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52146 expref: 18 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.264295:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03000/0x34dc807b6ef8145 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1544191) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52146 expref: 18 pid: 11152 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.264310:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.264312:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.264318:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f45e00/0x34dc807b6ef818b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52170 expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.264325:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f45e00/0x34dc807b6ef818b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52170 expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.264350:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f45e00/0x34dc807b6ef818b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52170 expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.264361:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994150528:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126996.264430:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126996.270997:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.271450:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994150528:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126996.271465:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126996.271482:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991385088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7242us (7529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.271489:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9736 00000100:00100000:0.0:1746126996.273062:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.289417:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.297490:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.342306:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.345008:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.347386:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.351007:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.353316:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.353355:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.353381:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991386880 00000100:00100000:1.0:1746126996.353385:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991386880 00000100:00100000:1.0:1746126996.353411:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991386752 00000100:00100000:1.0:1746126996.353413:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991386752 00000100:00100000:1.0:1746126996.353432:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20957 00000100:00100000:1.0:1746126996.353438:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991386880:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126996.353449:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.353459:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef81ca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5219a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.353475:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.353476:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.353483:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef81ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5219a expref: 10 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.353495:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef81ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5219a expref: 10 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.353504:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac400, rc 0) 00000100:00100000:1.0:1746126996.353529:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991386880:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 91us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.353538:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20957 00000100:00100000:1.0:1746126996.353550:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20958 00000100:00100000:1.0:1746126996.353554:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991386752:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126996.353559:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.353564:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdac000/0x34dc807b6ef81d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52193 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.353572:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.353574:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.353577:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdac000/0x34dc807b6ef81d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52193 expref: 10 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.353585:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac000/0x34dc807b6ef81d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52193 expref: 10 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.353591:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac000, rc 0) 00000100:00100000:1.0:1746126996.353604:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991386752:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.353609:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20958 00000100:00100000:0.0:1746126996.354392:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.356017:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.358889:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.363378:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.363415:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.364767:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.364832:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.367658:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.368165:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.368257:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991388416 00000100:00100000:1.0:1746126996.368261:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991388416 00002000:00100000:1.0:1746126996.368285:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2617344->2621439) req@ffff88009da74e00 x1830945991388416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.368293:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74e00 with x1830945991388416 ext(2617344->2621439) 00002000:00010000:1.0:1746126996.368297:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da74e00 00000100:00100000:1.0:1746126996.368310:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8312 00000100:00100000:1.0:1746126996.368316:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991388416:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126996.368421:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991388416:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 104us (255us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126996.368427:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8312 00002000:00100000:1.0:1746126996.368432:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2617344->2621439) req@ffff88009da74e00 x1830945991388416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.368438:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74e00 with x1830945991388416 ext(2617344->2621439) 00002000:00010000:1.0:1746126996.368441:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da74e00 00000100:00100000:0.0:1746126996.370464:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.370540:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.370600:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991388800 00000100:00100000:1.0:1746126996.370605:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991388800 00002000:00100000:1.0:1746126996.370630:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2646016->2650111) req@ffff88009c5e0380 x1830945991388800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.370637:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0380 with x1830945991388800 ext(2646016->2650111) 00002000:00010000:1.0:1746126996.370739:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e0380 00000100:00100000:1.0:1746126996.370758:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8313 00000100:00100000:1.0:1746126996.370764:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991388800:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126996.370855:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991388800:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 91us (314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126996.370861:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8313 00002000:00100000:1.0:1746126996.370866:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2646016->2650111) req@ffff88009c5e0380 x1830945991388800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.370872:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0380 with x1830945991388800 ext(2646016->2650111) 00002000:00010000:1.0:1746126996.370956:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e0380 00000100:00100000:0.0:1746126996.372773:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.373914:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.390767:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.394076:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.408070:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.408829:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991389952 00000100:00100000:1.0:1746126996.408837:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991389952 00002000:00100000:1.0:1746126996.408873:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c5e2d80 x1830945991389952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.408882:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2d80 with x1830945991389952 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.408887:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e2d80 00000100:00100000:1.0:1746126996.408915:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8314 00000100:00100000:1.0:1746126996.408922:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991389952:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.413445:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.417891:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991389952:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8963us (9820us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126996.417901:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8314 00002000:00100000:1.0:1746126996.417911:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c5e2d80 x1830945991389952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.417919:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2d80 with x1830945991389952 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.417925:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e2d80 00000100:00100000:0.0:1746126996.421671:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.421787:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991390208 00000100:00100000:1.0:1746126996.421794:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991390208 00002000:00100000:1.0:1746126996.421825:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2617344->2650111) req@ffff88009c5e3100 x1830945991390208/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.421834:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3100 with x1830945991390208 ext(2617344->2650111) 00010000:00010000:1.0:1746126996.421841:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef81e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521a8 expref: 36 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.421852:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef81e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521a8 expref: 36 pid: 9611 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.421862:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e3100 00000100:00100000:1.0:1746126996.421939:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1799 00000100:00100000:1.0:1746126996.421946:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991390208:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746126996.424965:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991390208:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3013us (3289us total) trans 17179875489 rc 0/0 00000100:00100000:1.0:1746126996.424974:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1799 00002000:00100000:1.0:1746126996.424984:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2617344->2650111) req@ffff88009c5e3100 x1830945991390208/t17179875489(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/448 e 0 to 0 dl 1746127007 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.424993:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3100 with x1830945991390208 ext(2617344->2650111) 00010000:00010000:1.0:1746126996.425001:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef81e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521a8 expref: 38 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.425012:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef81e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521a8 expref: 38 pid: 9611 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.425019:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e3100 00000100:00100000:0.0:1746126996.432521:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.432618:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.436596:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.436999:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991390720 00000100:00100000:1.0:1746126996.437005:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991390720 00002000:00100000:1.0:1746126996.437034:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2953216->2957311) req@ffff88009c5e1f80 x1830945991390720/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.437043:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1f80 with x1830945991390720 ext(2953216->2957311) 00010000:00010000:1.0:1746126996.437050:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 19 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.437065:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 19 pid: 9611 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.437070:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1f80 00000100:00100000:1.0:1746126996.437107:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1800 00000100:00100000:1.0:1746126996.437113:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991390720:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126996.437297:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991390720:12345-192.168.203.42@tcp:3:cat.0 Request processed in 184us (709us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126996.437304:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1800 00002000:00100000:1.0:1746126996.437309:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2953216->2957311) req@ffff88009c5e1f80 x1830945991390720/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746127007 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.437315:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1f80 with x1830945991390720 ext(2953216->2957311) 00010000:00010000:1.0:1746126996.437320:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 19 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.437337:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 19 pid: 9611 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.437342:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1f80 00000100:00100000:0.0:1746126996.441805:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.442358:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.442437:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991391104 00000100:00100000:1.0:1746126996.442441:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991391104 00002000:00100000:1.0:1746126996.442462:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2953216->3145727) req@ffff88009c5e1500 x1830945991391104/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.442470:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1500 with x1830945991391104 ext(2953216->3145727) 00010000:00010000:1.0:1746126996.442476:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 19 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.442483:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 19 pid: 9611 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.442488:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1500 00000100:00100000:1.0:1746126996.442505:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1801 00000100:00100000:1.0:1746126996.442509:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991391104:12345-192.168.203.42@tcp:4:cat.0 00000100:00080000:1.0:1746126996.447243:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126996.448455:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.448667:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991391104:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6157us (6309us total) trans 17179875490 rc 0/0 00000100:00100000:0.0:1746126996.448673:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1801 00002000:00100000:0.0:1746126996.448680:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2953216->3145727) req@ffff88009c5e1500 x1830945991391104/t17179875490(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/448 e 0 to 0 dl 1746127007 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.448688:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1500 with x1830945991391104 ext(2953216->3145727) 00010000:00010000:0.0:1746126996.448694:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 21 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.448702:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6ef8248 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521cb expref: 21 pid: 9611 timeout: 991 lvb_type: 0 00002000:00010000:0.0:1746126996.448708:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1500 00000100:00100000:0.0:1746126996.450482:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.451547:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.451636:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991391616 00000100:00100000:1.0:1746126996.451640:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991391616 00010000:00010000:1.0:1746126996.451718:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef7e97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fbe expref: 27 pid: 1964 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.451744:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9747 00000100:00100000:1.0:1746126996.451750:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991391616:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.451757:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.451768:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef7e97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fbe expref: 27 pid: 1964 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.451776:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef7e97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fbe expref: 27 pid: 1964 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.451888:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef7e97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51fbe expref: 27 pid: 1964 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.451949:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.451951:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.451955:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3400/0x34dc807b6ef8256 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d9 expref: 13 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.451962:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3400/0x34dc807b6ef8256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d9 expref: 13 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.451982:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3400/0x34dc807b6ef8256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d9 expref: 13 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.451990:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a178b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994152576:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126996.452033:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126996.455067:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a178b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994152576:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126996.455079:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.455109:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991391616:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3359us (3563us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.455115:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9747 00000100:00100000:0.0:1746126996.457374:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.457483:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.457541:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8315 00000100:00100000:0.0:1746126996.457547:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991391872:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.457651:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991391872:12345-192.168.203.42@tcp:3:cat.0 Request processed in 104us (285us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126996.457657:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8315 00002000:00100000:0.0:1746126996.457661:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3321856->3325951) req@ffff88009c5e2a00 x1830945991391872/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.457667:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2a00 with x1830945991391872 ext(3321856->3325951) 00002000:00010000:0.0:1746126996.457669:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e2a00 00000100:00100000:0.0:1746126996.461511:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.466732:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.468081:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.468148:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991392896 00000100:00100000:1.0:1746126996.468152:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991392896 00002000:00100000:1.0:1746126996.468171:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009c5e3480 x1830945991392896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.468178:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3480 with x1830945991392896 ext(3145728->4194303) 00002000:00010000:1.0:1746126996.468181:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e3480 00000100:00100000:1.0:1746126996.468207:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8318 00000100:00100000:1.0:1746126996.468213:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991392896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.482011:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.485791:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.490025:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.490075:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.490110:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991393408 00000100:00100000:1.0:1746126996.490740:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991393408 00000100:00100000:1.0:1746126996.490775:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991393536 00000100:00100000:1.0:1746126996.490777:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991393536 00000100:00100000:0.0:1746126996.490788:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20964 00000100:00100000:1.0:1746126996.490836:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20965 00000100:00100000:1.0:1746126996.490842:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991393536:12345-192.168.203.42@tcp:101:mirror_io.0 00000100:00100000:0.0:1746126996.490842:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991393408:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126996.490855:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.490856:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126996.490868:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6000/0x34dc807b6ef8279 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e521e7 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.490869:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e521ee expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.490887:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.490888:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.490896:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.490908:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126996.490912:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994152704:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126996.490922:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdad200, rc 0) 00000100:00100000:1.0:1746126996.490954:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991393536:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 113us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.490960:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20965 00000100:00100000:0.0:1746126996.490971:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126996.495703:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.500321:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.500383:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.500550:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991393920 00000100:00100000:1.0:1746126996.500558:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991393920 00010000:00010000:1.0:1746126996.500591:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef8272 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521e0 expref: 17 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.500628:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991394048 00000100:00100000:1.0:1746126996.500631:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991394048 00010000:00010000:1.0:1746126996.500640:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6ef8233 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521bd expref: 24 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.500656:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9748 00000100:00100000:1.0:1746126996.500663:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2029:x1830945991393920:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.500678:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.500684:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef8272 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521e0 expref: 17 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.500693:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef8272 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521e0 expref: 17 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126996.500698:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9749 00000100:00100000:0.0:1746126996.500704:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991394048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126996.500710:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.500711:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef8272 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521e0 expref: 17 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.500713:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6ef8233 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521bd expref: 24 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.500720:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6ef8233 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521bd expref: 24 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.500729:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6ef8233 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521bd expref: 24 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.501334:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126996.501339:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099191c00/0x34dc807b6ef828e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126996.501347:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191c00/0x34dc807b6ef828e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126996.501352:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099191c00/0x34dc807b6ef828e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.501363:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126996.501366:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126996.501374:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.501400:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991393920:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 737us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.501400:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991394048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 696us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.501406:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9749 00000100:00100000:1.0:1746126996.501412:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9748 00000100:00100000:0.0:1746126996.504252:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.506958:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.506986:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.507006:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.507472:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.507663:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.509381:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991394816 00000100:00100000:1.0:1746126996.509388:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991394816 00000100:00100000:1.0:1746126996.509410:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20970 00000100:00100000:1.0:1746126996.509415:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991394816:12345-192.168.203.42@tcp:1:mirror_io.0 00000100:00100000:0.0:1746126996.509424:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126996.509433:0:16295:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509444:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef8003 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520b3 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509451:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.509458:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e8800/0x34dc807b6ef803b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520d6 expref: 25 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.509463:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.509464:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.509466:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509483:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991e8800/0x34dc807b6ef803b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520d6 expref: 25 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.509495:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991e8800/0x34dc807b6ef803b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520d6 expref: 25 pid: 9611 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.509504:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994154368:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.509565:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.509573:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.509580:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1788a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994154496:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.509603:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef8003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520b3 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509611:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef8003 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520b3 expref: 13 pid: 1964 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.509618:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994154624:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.509632:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126996.509653:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991395072 00000100:00100000:1.0:1746126996.509656:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991395072 00000100:00100000:1.0:1746126996.509671:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20971 00000100:00100000:1.0:1746126996.509676:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991395072:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:1.0:1746126996.509695:0:3148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509705:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3a00/0x34dc807b6ef824f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d2 expref: 19 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509712:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.509717:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.509718:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.509720:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509733:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.509740:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 12 pid: 16295 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.509747:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a178b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994154752:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.509769:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3a00/0x34dc807b6ef824f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d2 expref: 19 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.509776:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3a00/0x34dc807b6ef824f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d2 expref: 19 pid: 9611 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.509789:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994154880:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.509814:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126996.515388:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.515889:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.516759:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517163:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517602:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517664:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517676:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517688:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517701:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517713:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517723:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.517749:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.517815:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a178b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994154752:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.517823:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994154880:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.517843:0:3148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.517861:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994154368:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.517868:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1788a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994154496:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.517874:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994154624:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.517886:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.518252:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9755 00000100:00100000:1.0:1746126996.518257:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2028:x1830945991396224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.518263:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.518269:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f44400/0x34dc807b6ef8192 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52177 expref: 21 pid: 3542 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518276:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f44400/0x34dc807b6ef8192 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52177 expref: 21 pid: 3542 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518290:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f44400/0x34dc807b6ef8192 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52177 expref: 21 pid: 3542 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518300:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.518314:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991396224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 57us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.518319:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9755 00000100:00100000:1.0:1746126996.518328:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9756 00000100:00100000:1.0:1746126996.518332:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991395328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.518337:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.518344:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef81ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5219a expref: 12 pid: 3542 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518351:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef81ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5219a expref: 12 pid: 3542 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518360:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef81ca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5219a expref: 12 pid: 3542 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518368:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.518580:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991395328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 246us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.518585:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9756 00000100:00100000:1.0:1746126996.518595:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9758 00000100:00100000:1.0:1746126996.518599:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991396352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.518605:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.518613:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518620:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518634:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef807a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e520f9 expref: 12 pid: 11152 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.518643:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.518938:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991396352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 338us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.518943:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9758 00010000:00010000:1.0:1746126996.518956:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.518962:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.518975:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.518981:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.518987:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126996.518988:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126996.518993:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdacc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126996.518996:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519001:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519010:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519015:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef82cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126996.519018:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.519045:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991394816:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 9631us (11383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.519052:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20970 00000100:00100000:1.0:1746126996.519064:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991396480 00000100:00100000:1.0:1746126996.519068:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991396480 00000100:00100000:0.0:1746126996.519068:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126996.519078:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 11 pid: 16295 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.519092:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991396992 00000100:00100000:1.0:1746126996.519107:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991396992 00010000:00010000:1.0:1746126996.519115:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3a00/0x34dc807b6ef824f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d2 expref: 18 pid: 9611 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.519123:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991396608 00000100:00100000:1.0:1746126996.519125:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991396608 00010000:00010000:1.0:1746126996.519148:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f45e00/0x34dc807b6ef818b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52170 expref: 36 pid: 3542 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.519157:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9761 00000100:00100000:1.0:1746126996.519160:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991396480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.519166:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.519173:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 11 pid: 16295 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.519179:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 11 pid: 16295 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.519189:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6ef8280 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521ee expref: 11 pid: 16295 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746126996.519197:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.519326:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991396480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 164us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.519331:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9761 00000100:00100000:1.0:1746126996.519341:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9763 00000100:00100000:1.0:1746126996.519346:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991396608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.519351:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.519358:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f45e00/0x34dc807b6ef818b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52170 expref: 36 pid: 3542 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.519368:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f45e00/0x34dc807b6ef818b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52170 expref: 36 pid: 3542 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.519379:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f45e00/0x34dc807b6ef818b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52170 expref: 36 pid: 3542 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.519386:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.519387:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.519389:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519395:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519408:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.519524:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991396608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 178us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.519529:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9763 00010000:00010000:1.0:1746126996.519542:0:3148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519548:0:3148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519559:0:3148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519568:0:3148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519573:0:3148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519577:0:3148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801361ed400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126996.519579:0:3148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519583:0:3148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519590:0:3148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519595:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801361ed400/0x34dc807b6ef82d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.519621:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991395072:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 9945us (10199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.519626:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20971 00010000:00010000:1.0:1746126996.519712:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519719:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519730:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519735:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519740:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519744:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f561600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126996.519746:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519751:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519759:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.519764:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f561600/0x34dc807b6ef82bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126996.519792:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991394560:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 11577us (12320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.519796:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20968 00000100:00100000:0.0:1746126996.523676:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.523740:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991397120 00000100:00100000:1.0:1746126996.523747:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991397120 00010000:00010000:1.0:1746126996.523768:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3400/0x34dc807b6ef8256 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d9 expref: 14 pid: 9611 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.523792:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9764 00000100:00100000:1.0:1746126996.523799:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991397120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126996.523808:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126996.523823:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3400/0x34dc807b6ef8256 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d9 expref: 14 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.523833:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3400/0x34dc807b6ef8256 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d9 expref: 14 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.523850:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3400/0x34dc807b6ef8256 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521d9 expref: 14 pid: 9611 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.523861:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.523863:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.523867:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef82b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.523874:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef82b8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.523904:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126996.523987:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991397120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 189us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.523993:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9764 00000100:00100000:0.0:1746126996.525924:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.525999:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991397376 00000100:00100000:1.0:1746126996.526005:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991397376 00000100:00100000:1.0:1746126996.526356:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17135 00000100:00100000:1.0:1746126996.526363:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:3971:x1830945991397376:12345-192.168.203.42@tcp:36:mirror_io.0 00010000:00010000:1.0:1746126996.526406:0:11634:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746126996.526426:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3200/0x34dc807b6ef8202 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521af expref: 17 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526442:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6ef81df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e521a1 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526450:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126996.526454:0:11634:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126996.526473:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef82db lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126996.526481:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ec200/0x34dc807b6ef80b9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5210e expref: 41 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526487:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef8161 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5214d expref: 22 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526493:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f7f expref: 22 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526499:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef7fbd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52090 expref: 41 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526504:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef82db lrc: 7/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126996.526527:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef7fbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52090 expref: 41 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526536:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef7fbd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52090 expref: 41 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.526547:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155008:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.526616:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f7f expref: 22 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526623:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f7f expref: 22 pid: 11634 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.526630:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1788a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155136:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.526656:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef8161 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5214d expref: 22 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526663:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef8161 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5214d expref: 22 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.526669:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155264:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.526685:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ec200/0x34dc807b6ef80b9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5210e expref: 41 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.526692:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ec200/0x34dc807b6ef80b9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5210e expref: 41 pid: 11634 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.526702:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.526713:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126996.528573:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155008:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.528588:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1788a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155136:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126996.528592:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.528595:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155264:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.528601:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994155392:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.528631:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef82db lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:0.0:1746126996.529274:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.529306:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.529377:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.529562:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991397760 00000100:00100000:0.0:1746126996.529565:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991397760 00010000:00010000:0.0:1746126996.529589:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef7fbd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52090 expref: 43 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126996.529669:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991397504 00000100:00100000:0.0:1746126996.529672:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991397504 00010000:00010000:0.0:1746126996.529683:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6200/0x34dc807b6ef7e3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e51f7f expref: 23 pid: 11634 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126996.529694:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991397888 00000100:00100000:0.0:1746126996.529696:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991397888 00010000:00010000:0.0:1746126996.529702:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef8161 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5214d expref: 24 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746126996.529712:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9765 00000100:00100000:0.0:1746126996.529718:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991397760:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126996.529728:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126996.529733:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef7fbd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52090 expref: 43 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.529824:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef7fbd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52090 expref: 43 pid: 7260 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746126996.529884:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126996.529913:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef7fbd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52090 expref: 43 pid: 7260 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746126996.529922:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000100:00100000:1.0:1746126996.529923:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991398144 00010000:00010000:0.0:1746126996.529925:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef82db lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:1.0:1746126996.529926:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991398144 00010000:00010000:0.0:1746126996.529929:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126996.529942:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991397760:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 224us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.529947:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17136 00000100:00100000:0.0:1746126996.529947:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9765 00000100:00100000:1.0:1746126996.529952:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:3975:x1830945991398144:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126996.529968:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.529977:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6ef82e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52203 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.530054:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6ef82e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126996.530063:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6ef82e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126996.530069:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6ef82e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126996.530083:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef82f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126996.530088:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef82f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126996.530104:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef82f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746126996.534737:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994155648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126996.534788:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.534811:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.534827:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.534839:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.534852:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.534867:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746126996.534871:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994155776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126996.534884:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.534894:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a178b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.534907:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.534916:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.534929:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.534951:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994155648 00000100:00100000:0.0:1746126996.534957:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994155648 00000100:00100000:0.0:1746126996.534980:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994156160 00000100:00100000:0.0:1746126996.534981:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994156160 00000100:00100000:0.0:1746126996.534989:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994156672 00000100:00100000:0.0:1746126996.534991:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994156672 00000100:00100000:0.0:1746126996.534997:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994155776 00000100:00100000:0.0:1746126996.534998:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994155776 00000100:00100000:0.0:1746126996.535006:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994156288 00000100:00100000:0.0:1746126996.535008:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994156288 00000100:00100000:0.0:1746126996.535014:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994156800 00000100:00100000:0.0:1746126996.535016:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994156800 00000100:00100000:0.0:1746126996.535025:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20972 00000100:00100000:0.0:1746126996.535030:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3784:x1830945994155648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126996.535166:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3784:x1830945994155648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (378us total) trans 21474842745 rc 0/0 00000100:00100000:0.0:1746126996.535172:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20972 00000100:00100000:0.0:1746126996.535183:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20973 00000100:00100000:0.0:1746126996.535187:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3784:x1830945994156160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.535245:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3784:x1830945994156160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (417us total) trans 17179875491 rc 0/0 00000100:00100000:0.0:1746126996.535250:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20973 00000100:00100000:0.0:1746126996.535258:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20974 00000100:00100000:0.0:1746126996.535262:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3784:x1830945994156672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.535303:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3784:x1830945994156672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (450us total) trans 17179875492 rc 0/0 00000100:00100000:0.0:1746126996.535307:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20974 00000100:00100000:0.0:1746126996.535315:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20975 00000100:00100000:0.0:1746126996.535319:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3784:x1830945994155776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126996.535357:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3784:x1830945994155776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (472us total) trans 21474842746 rc 0/0 00000100:00100000:0.0:1746126996.535362:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20975 00000100:00100000:0.0:1746126996.535369:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20976 00000100:00100000:0.0:1746126996.535372:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3784:x1830945994156288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126996.535408:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126996.535411:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126996.535413:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:0.0:1746126996.535415:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126996.535416:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746126996.535431:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3784:x1830945994156288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (522us total) trans 17179875493 rc 0/0 00000100:00100000:0.0:1746126996.535435:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20976 00000100:00100000:0.0:1746126996.535443:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20977 00000100:00100000:0.0:1746126996.535446:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3784:x1830945994156800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.537809:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994156800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2361us (2878us total) trans 17179875498 rc 0/0 00000100:00100000:0.0:1746126996.537815:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20977 00000004:00080000:0.0:1746126996.537844:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009da75f80/2, rc 0, transno 21474842746 00000100:00100000:0.0:1746126996.537847:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994155776:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126996.537855:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a178b100/2, rc 0, transno 17179875493 00000100:00100000:0.0:1746126996.537857:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a178b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126996.537862:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2fca680/2, rc 0, transno 17179875498 00000100:00100000:0.0:1746126996.537864:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126996.537870:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009da76680/2, rc 0, transno 21474842745 00000100:00100000:0.0:1746126996.537872:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994155648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126996.537879:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a1789880/2, rc 0, transno 17179875491 00000100:00100000:0.0:1746126996.537881:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746126996.537886:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a2fc9500/2, rc 0, transno 17179875492 00000100:00100000:0.0:1746126996.537888:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994156672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.540204:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.543746:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.544199:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.546382:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.546402:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.546873:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.546899:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.546914:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.546926:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991399296 00000100:00100000:0.0:1746126996.546928:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991399296 00000100:00100000:0.0:1746126996.546945:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20990 00000100:00100000:0.0:1746126996.546949:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991399040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126996.546962:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126996.546975:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52226 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126996.546992:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c892, atime: 0x6813c892, ctime: 0x6813c892, blocks: 0x800 00010000:00010000:0.0:1746126996.547005:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.547007:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.547013:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 37 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.547024:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 37 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.547033:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2ac00, rc 0) 00000100:00100000:0.0:1746126996.547067:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991399040:12345-192.168.203.42@tcp:101:cat.0 Request processed in 117us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.547073:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20990 00000100:00100000:0.0:1746126996.547085:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20992 00000100:00100000:0.0:1746126996.547089:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991399424:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746126996.547090:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20993 00010000:00010000:0.0:1746126996.547104:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126996.547106:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991399296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126996.547110:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef833d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5223b expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.547113:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746126996.547118:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c893, atime: 0x6813c893, ctime: 0x6813c893, blocks: 0x14e0 00010000:00010000:1.0:1746126996.547121:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009867fa00/0x34dc807b6ef8344 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52234 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.547122:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.547124:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.547126:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef833d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5223b expref: 28 pid: 12340 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746126996.547149:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c892, atime: 0x6813c891, ctime: 0x6813c892, blocks: 0x800 00010000:00010000:0.0:1746126996.547152:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef833d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5223b expref: 28 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.547157:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.547157:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673000, rc 0) 00010000:00010000:1.0:1746126996.547158:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.547162:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009867fa00/0x34dc807b6ef8344 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52234 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.547171:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009867fa00/0x34dc807b6ef8344 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52234 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.547177:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867fa00, rc 0) 00000100:00100000:0.0:1746126996.547495:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991399424:12345-192.168.203.42@tcp:101:cat.0 Request processed in 405us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.547500:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20992 00000100:00100000:1.0:1746126996.547502:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991399296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 396us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.547629:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.547645:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991399552 00000100:00100000:0.0:1746126996.547648:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991399552 00000100:00100000:1.0:1746126996.548156:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20993 00000100:00100000:0.0:1746126996.548231:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20994 00000100:00100000:0.0:1746126996.548237:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991399552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126996.548245:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126996.548254:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef834b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52242 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126996.548270:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c893, atime: 0x6813c892, ctime: 0x6813c893, blocks: 0x1008 00010000:00010000:0.0:1746126996.548279:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.548280:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.548285:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef834b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52242 expref: 38 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.548293:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef834b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52242 expref: 38 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.548300:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673800, rc 0) 00000100:00100000:0.0:1746126996.548317:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991399552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 81us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.548327:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20994 00000100:00100000:0.0:1746126996.549796:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.549921:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.549950:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.549962:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.549972:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.549995:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.550148:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991399808 00000100:00100000:1.0:1746126996.550151:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991399808 00000100:00100000:1.0:1746126996.550164:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991400320 00000100:00100000:1.0:1746126996.550166:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991400320 00000100:00100000:1.0:1746126996.550174:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20996 00000100:00100000:1.0:1746126996.550178:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991399936:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746126996.550186:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.550195:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6ef8352 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52257 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.550209:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.550210:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.550215:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6ef8352 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52257 expref: 10 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.550225:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6ef8352 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52257 expref: 10 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.550233:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02e00, rc 0) 00000100:00100000:0.0:1746126996.550343:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20998 00000100:00100000:0.0:1746126996.550349:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991399808:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746126996.550355:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126996.550361:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef8367 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52250 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.550373:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.550375:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.550378:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef8367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52250 expref: 11 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.550385:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef8367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52250 expref: 11 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.550391:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098672000, rc 0) 00000100:00100000:0.0:1746126996.550403:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991399808:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 55us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.550408:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20998 00000100:00100000:1.0:1746126996.550522:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991399936:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 339us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.550527:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20996 00000100:00100000:0.0:1746126996.559927:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.559965:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.559990:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.560017:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.560064:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991400576 00000100:00100000:0.0:1746126996.560070:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991400576 00002000:00100000:0.0:1746126996.560120:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012d22e300 x1830945991400576/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.560149:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22e300 with x1830945991400576 ext(0->1048575) 00002000:00010000:0.0:1746126996.560154:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22e300 00000100:00100000:0.0:1746126996.560171:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991400832 00000100:00100000:0.0:1746126996.560173:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991400832 00002000:00100000:0.0:1746126996.560188:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012d22ea00 x1830945991400832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.560200:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22ea00 with x1830945991400832 ext(1048576->2097151) 00002000:00010000:0.0:1746126996.560203:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22ea00 00000100:00100000:0.0:1746126996.560212:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991401088 00000100:00100000:0.0:1746126996.560214:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991401088 00002000:00100000:0.0:1746126996.560223:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009cd64a80 x1830945991401088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.560229:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64a80 with x1830945991401088 ext(1048576->2097151) 00002000:00010000:0.0:1746126996.560232:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd64a80 00000100:00100000:0.0:1746126996.560239:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991401344 00000100:00100000:0.0:1746126996.560241:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991401344 00002000:00100000:0.0:1746126996.560249:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cd65f80 x1830945991401344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.560254:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65f80 with x1830945991401344 ext(1048576->2097151) 00002000:00010000:0.0:1746126996.560257:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65f80 00000100:00100000:0.0:1746126996.560266:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8320 00000100:00100000:0.0:1746126996.560272:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991400576:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.560825:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8321 00000100:00100000:0.0:1746126996.560831:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991400832:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.582875:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991400832:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22042us (22908us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126996.582883:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8321 00002000:00100000:0.0:1746126996.582889:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012d22ea00 x1830945991400832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.582902:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22ea00 with x1830945991400832 ext(1048576->2097151) 00002000:00010000:0.0:1746126996.582907:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22ea00 00000100:00100000:0.0:1746126996.597004:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.597486:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.599420:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.599464:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.600708:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.624301:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.624320:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991402752 00000100:00100000:0.0:1746126996.624323:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991402752 00002000:00100000:0.0:1746126996.624345:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007edd7800 x1830945991402752/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.624354:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7800 with x1830945991402752 ext(4194304->4829183) 00002000:00010000:0.0:1746126996.625088:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd7800 00000100:00100000:0.0:1746126996.625121:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8326 00000100:00100000:0.0:1746126996.625140:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991402752:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.625548:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.628479:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.630694:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.630873:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991402752:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5744us (6571us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746126996.630881:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8326 00002000:00100000:0.0:1746126996.630890:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007edd7800 x1830945991402752/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.630898:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7800 with x1830945991402752 ext(4194304->4829183) 00002000:00010000:0.0:1746126996.630903:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd7800 00000100:00100000:1.0:1746126996.631001:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.631047:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.631202:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991404032 00000100:00100000:0.0:1746126996.631205:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991404032 00000100:00100000:0.0:1746126996.631233:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17145 00000100:00100000:0.0:1746126996.631238:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:3982:x1830945991404032:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126996.631250:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126996.631259:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6ef83fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52296 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.631314:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.631321:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.631326:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746126996.633951:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.634036:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994158080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126996.634051:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991404160 00000100:00100000:0.0:1746126996.634053:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126996.634056:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991404160 00000100:00100000:0.0:1746126996.634062:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994158592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126996.634107:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17146 00000100:00100000:1.0:1746126996.634115:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:3975:x1830945991404160:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126996.634126:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.634155:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef8408 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5229d expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.634191:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef8408 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5229d expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.634199:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef8408 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5229d expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.634208:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126996.634210:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746126996.634212:0:7259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef83f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5228f expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.634218:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6e00, rc 0) 00000100:00100000:1.0:1746126996.634512:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:3975:x1830945991404160:12345-192.168.203.42@tcp:101:cat.0 Request processed in 397us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.634518:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17146 00000100:00100000:1.0:1746126996.634539:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158208 00000100:00100000:1.0:1746126996.634541:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158208 00000100:00100000:1.0:1746126996.634560:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158080 00000100:00100000:1.0:1746126996.634561:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158080 00000100:00100000:1.0:1746126996.634571:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158720 00000100:00100000:1.0:1746126996.634573:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158720 00000100:00100000:1.0:1746126996.634582:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21001 00000100:00100000:1.0:1746126996.634586:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3785:x1830945994158208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.634618:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.634632:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994159104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.634645:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.634658:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994159616:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126996.634665:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126996.634668:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746126994 -> 1746126994 00002000:00010000:1.0:1746126996.634670:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746126994 -> 1746126994 00002000:00010000:1.0:1746126996.634671:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746126994 -> 1746126994 00002000:00010000:1.0:1746126996.634673:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126996.634676:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158592 00000100:00100000:0.0:1746126996.634679:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158592 00000100:00100000:0.0:1746126996.634693:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158336 00000100:00100000:1.0:1746126996.634695:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3785:x1830945994158208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (660us total) trans 17179875499 rc 0/0 00000100:00100000:0.0:1746126996.634695:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158336 00000100:00100000:0.0:1746126996.634700:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994159104 00000100:00100000:1.0:1746126996.634702:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21001 00000100:00100000:0.0:1746126996.634702:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994159104 00000100:00100000:0.0:1746126996.634708:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158464 00000100:00100000:0.0:1746126996.634709:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158464 00000100:00100000:1.0:1746126996.634710:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158976 00000100:00100000:1.0:1746126996.634713:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158976 00000100:00100000:0.0:1746126996.634715:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994159488 00000100:00100000:0.0:1746126996.634717:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994159488 00000100:00100000:1.0:1746126996.634722:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21002 00000100:00100000:1.0:1746126996.634726:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3784:x1830945994158080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126996.634728:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21003 00000100:00100000:0.0:1746126996.634732:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994158720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126996.634777:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21006 00000100:00100000:1.0:1746126996.634782:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3784:x1830945994159104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126996.634782:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746126996.634784:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126996.634786:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126996.634787:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126996.634789:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:0.0:1746126996.634808:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3785:x1830945994158720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (738us total) trans 21474842754 rc 0/0 00000100:00100000:0.0:1746126996.634814:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21003 00002000:00010000:1.0:1746126996.634816:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126996.634818:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746126996.634819:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:1.0:1746126996.634821:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746126996.634822:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746126996.634823:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21007 00000100:00100000:0.0:1746126996.634826:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3783:x1830945994158464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126996.634842:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3784:x1830945994159104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (196us total) trans 17179875500 rc 0/0 00000100:00100000:1.0:1746126996.634847:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21006 00000100:00100000:1.0:1746126996.634856:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21008 00002000:00010000:0.0:1746126996.634859:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746126996.634860:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3783:x1830945994158976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126996.634861:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126994 -> 1746126994 00002000:00010000:0.0:1746126996.634862:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746126991 -> 1746126991 00002000:00010000:0.0:1746126996.634864:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126994 -> 1746126994 00002000:00010000:0.0:1746126996.634866:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746126996.634883:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3783:x1830945994158464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (216us total) trans 17179875501 rc 0/0 00000100:00100000:0.0:1746126996.634888:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21007 00000100:00100000:0.0:1746126996.634897:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21010 00000100:00100000:0.0:1746126996.634900:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3783:x1830945994160000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126996.634910:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3783:x1830945994158976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (214us total) trans 21474842757 rc 0/0 00000100:00100000:1.0:1746126996.634915:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21008 00002000:00010000:1.0:1746126996.634941:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126996.634943:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746126994 -> 1746126994 00002000:00010000:1.0:1746126996.634945:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746126994 -> 1746126994 00000100:00100000:0.0:1746126996.634945:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3783:x1830945994160000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (217us total) trans 17179875502 rc 0/0 00002000:00010000:1.0:1746126996.634947:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746126994 -> 1746126994 00002000:00010000:1.0:1746126996.634949:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746126996.634950:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21010 00000100:00100000:0.0:1746126996.634958:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994158848 00000100:00100000:0.0:1746126996.634960:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994158848 00000100:00100000:1.0:1746126996.634966:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3784:x1830945994158080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (912us total) trans 21474842755 rc 0/0 00000100:00100000:0.0:1746126996.634967:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994159360 00000100:00100000:0.0:1746126996.634969:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994159360 00000100:00100000:1.0:1746126996.634971:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21002 00000100:00100000:0.0:1746126996.634975:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21011 00000100:00100000:0.0:1746126996.634979:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3782:x1830945994158848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126996.634980:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994159872 00000100:00100000:1.0:1746126996.634982:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994159872 00000100:00100000:1.0:1746126996.634992:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21012 00000100:00100000:1.0:1746126996.634995:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3782:x1830945994159360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126996.635011:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746126996.635013:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746126995 -> 1746126995 00002000:00010000:0.0:1746126996.635015:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746126994 -> 1746126994 00002000:00010000:0.0:1746126996.635017:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746126995 -> 1746126995 00002000:00010000:0.0:1746126996.635018:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746126996.635036:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994158848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (104us total) trans 17179875503 rc 0/0 00000100:00100000:0.0:1746126996.635041:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21011 00000100:00100000:0.0:1746126996.635049:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21013 00000100:00100000:1.0:1746126996.635051:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3782:x1830945994159360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (94us total) trans 17179875504 rc 0/0 00000100:00100000:0.0:1746126996.635052:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3782:x1830945994159872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.635110:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994159872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (133us total) trans 17179875505 rc 0/0 00000100:00100000:1.0:1746126996.635607:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21012 00000100:00100000:1.0:1746126996.635622:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994159744 00000100:00100000:0.0:1746126996.635623:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21013 00000100:00100000:1.0:1746126996.635624:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994159744 00000100:00100000:1.0:1746126996.635634:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21014 00000100:00100000:1.0:1746126996.635638:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3785:x1830945994159744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126996.635675:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:1.0:1746126996.635677:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126996.635678:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126996.635680:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126996.635682:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:1.0:1746126996.635701:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3785:x1830945994159744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (558us total) trans 21474842760 rc 0/0 00000100:00100000:1.0:1746126996.635705:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21014 00000100:00100000:0.0:1746126996.635784:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746126996.635811:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd5500/2, rc 0, transno 21474842755 00000100:00100000:0.0:1746126996.635814:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994158080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126996.635820:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd4e00/2, rc 0, transno 21474842759 00000100:00100000:0.0:1746126996.635823:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994158592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126996.635828:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f14700/2, rc 0, transno 17179875500 00000100:00100000:0.0:1746126996.635830:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994159104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126996.635861:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994160128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126996.635877:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126996.636232:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21016 00000100:00100000:0.0:1746126996.636237:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3784:x1830945994159616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126996.636272:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746126996.636275:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126996.636276:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126996.636278:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126996.636279:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746126996.636299:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3784:x1830945994159616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (515us total) trans 17179875506 rc 0/0 00000100:00100000:0.0:1746126996.636304:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21016 00000004:00080000:0.0:1746126996.636322:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a79500/2, rc 0, transno 21474842761 00000100:00100000:0.0:1746126996.636324:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994160128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126996.636330:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f14380/2, rc 0, transno 17179875506 00000100:00100000:0.0:1746126996.636333:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994159616:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746126996.636878:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.636884:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:0.0:1746126996.636913:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126996.636917:0:7260:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126996.636931:0:7260:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126996.636955:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6ef83fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52296 expref: 11 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.637148:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52296 expref: 10 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.637154:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126996.637156:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746126996.637158:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f121000, rc 0) 00000100:00100000:0.0:1746126996.637377:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:3982:x1830945991404032:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6137us (6327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.637382:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17145 00000100:00100000:0.0:1746126996.637842:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.638149:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.638207:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6489 00000100:00100000:1.0:1746126996.638214:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:3975:x1830945991404288:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:1.0:1746126996.638264:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:3975:x1830945991404288:12345-192.168.203.42@tcp:49:cat.0 Request processed in 51us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.638270:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6489 00000100:00100000:0.0:1746126996.638822:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.638937:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991404544 00000100:00100000:1.0:1746126996.638941:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991404544 00000100:00100000:1.0:1746126996.638962:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6491 00000100:00100000:1.0:1746126996.638966:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:3982:x1830945991404544:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:1.0:1746126996.639021:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:3982:x1830945991404544:12345-192.168.203.42@tcp:49:cat.0 Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.639026:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6491 00000100:00100000:0.0:1746126996.639601:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.639635:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.639639:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991404672 00000100:00100000:1.0:1746126996.639642:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991404672 00000100:00100000:1.0:1746126996.639814:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21018 00000100:00100000:1.0:1746126996.639819:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:3978:x1830945991404672:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126996.639827:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.639838:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef840f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e522a4 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.639855:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef833d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5223b expref: 26 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.639868:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8360 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52265 expref: 10 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.639874:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.639875:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.639878:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef840f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3883008->4100095] (req 3883008->4100095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522a4 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.639898:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8360 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52265 expref: 10 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.639908:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8360 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52265 expref: 10 pid: 12340 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.639917:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994160512:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126996.640781:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.640817:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126996.641121:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef833d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5223b expref: 26 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.641143:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef833d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5223b expref: 26 pid: 12340 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746126996.641153:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994160640:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.641179:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126996.641462:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991405312 00000100:00100000:0.0:1746126996.641465:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991405312 00000100:00100000:0.0:1746126996.641520:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21021 00000100:00100000:0.0:1746126996.641526:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991405184:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126996.641532:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126996.641539:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8424 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e522b9 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.641549:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.641551:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126996.641555:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8424 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b9 expref: 19 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.641564:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8424 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b9 expref: 19 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.641572:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5a00, rc 0) 00000100:00100000:1.0:1746126996.641627:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21023 00000100:00100000:0.0:1746126996.641650:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991405184:12345-192.168.203.42@tcp:101:cat.0 Request processed in 124us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126996.641656:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21021 00000100:00100000:1.0:1746126996.641750:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991405440:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126996.641758:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.641764:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8432 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e522c7 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.641773:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.641780:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8432 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522c7 expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.641788:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8432 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522c7 expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.641796:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7a00, rc 0) 00000100:00100000:1.0:1746126996.641814:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991405440:12345-192.168.203.42@tcp:101:cat.0 Request processed in 182us (352us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126996.641819:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21023 00000100:00100000:0.0:1746126996.641823:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994160512:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126996.641866:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.645894:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.647123:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.647251:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.647284:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991405952 00000100:00100000:1.0:1746126996.647288:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991405952 00000100:00100000:1.0:1746126996.647309:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21026 00000100:00100000:1.0:1746126996.647314:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:3975:x1830945991405952:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126996.647320:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.647327:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8447 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e522d5 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.647392:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126996.647394:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126996.647397:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8447 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->5242879] (req 4825088->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522d5 expref: 30 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.647410:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8447 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->5242879] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522d5 expref: 30 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.647418:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7200, rc 0) 00000100:00100000:1.0:1746126996.647437:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:3975:x1830945991405952:12345-192.168.203.42@tcp:101:cat.0 Request processed in 123us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.647443:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21026 00000100:00100000:0.0:1746126996.648301:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.650514:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.650542:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.650570:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.650586:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991406848 00000100:00100000:0.0:1746126996.650591:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991406848 00002000:00100000:0.0:1746126996.650614:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a5b99180 x1830945991406848/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.650622:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99180 with x1830945991406848 ext(1048576->2097151) 00002000:00010000:0.0:1746126996.650626:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b99180 00000100:00100000:1.0:1746126996.650675:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8327 00000100:00100000:1.0:1746126996.650683:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991406848:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.650776:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8329 00000100:00100000:0.0:1746126996.650782:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991407104:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126996.651273:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.653080:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.657630:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991406848:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6941us (7080us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126996.657638:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8327 00002000:00100000:1.0:1746126996.657645:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a5b99180 x1830945991406848/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.657652:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99180 with x1830945991406848 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.657656:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b99180 00000100:00100000:0.0:1746126996.663758:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.663796:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.669655:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.671802:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.672218:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.672804:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.672878:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991408768 00000100:00100000:0.0:1746126996.672881:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991408768 00000100:00100000:0.0:1746126996.672909:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21028 00000100:00100000:0.0:1746126996.672915:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991408768:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126996.672921:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126996.672927:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099191c00/0x34dc807b6ef8455 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e522ea expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126996.672944:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099191c00/0x34dc807b6ef8455 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522ea expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.672952:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099191c00/0x34dc807b6ef8455 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522ea expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126996.672971:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191c00, rc 0) 00000100:00100000:0.0:1746126996.672990:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991408768:12345-192.168.203.42@tcp:101:cat.0 Request processed in 75us (186us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126996.672998:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21028 00000100:00100000:0.0:1746126996.675189:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.675210:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.675233:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.678025:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.678070:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.678965:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.679700:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.682501:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.684013:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.684061:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991410432 00000100:00100000:1.0:1746126996.684066:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991410432 00002000:00100000:1.0:1746126996.684085:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88007ece4a80 x1830945991410432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.684106:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4a80 with x1830945991410432 ext(2097152->3145727) 00002000:00010000:1.0:1746126996.684110:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece4a80 00000100:00100000:1.0:1746126996.684156:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8333 00000100:00100000:1.0:1746126996.684162:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991410432:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.687314:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.691338:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991410432:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7170us (7320us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126996.691347:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8333 00002000:00100000:1.0:1746126996.691357:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88007ece4a80 x1830945991410432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.691365:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4a80 with x1830945991410432 ext(2097152->3145727) 00002000:00010000:1.0:1746126996.691369:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece4a80 00000100:00100000:0.0:1746126996.694666:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.697336:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.697408:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991410944 00000100:00100000:1.0:1746126996.697413:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991410944 00002000:00100000:1.0:1746126996.697441:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3432447) req@ffff88007ece5880 x1830945991410944/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.697449:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece5880 with x1830945991410944 ext(3145728->3432447) 00010000:00010000:1.0:1746126996.697454:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7fa8000/0x34dc807b6ef845c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522f1 expref: 38 pid: 1964 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.697463:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7fa8000/0x34dc807b6ef845c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522f1 expref: 38 pid: 1964 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.697468:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ece5880 00000100:00100000:1.0:1746126996.697593:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1808 00000100:00100000:1.0:1746126996.697600:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991410944:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746126996.700921:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991410944:12345-192.168.203.42@tcp:4:cat.0 Request processed in 3315us (3583us total) trans 17179875507 rc 0/0 00000100:00100000:1.0:1746126996.700931:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1808 00002000:00100000:1.0:1746126996.700940:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3432447) req@ffff88007ece5880 x1830945991410944/t17179875507(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/448 e 0 to 0 dl 1746127007 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.700948:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece5880 with x1830945991410944 ext(3145728->3432447) 00010000:00010000:1.0:1746126996.700956:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7fa8000/0x34dc807b6ef845c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522f1 expref: 40 pid: 1964 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746126996.700967:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7fa8000/0x34dc807b6ef845c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522f1 expref: 40 pid: 1964 timeout: 991 lvb_type: 0 00002000:00010000:1.0:1746126996.700973:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ece5880 00000100:00100000:0.0:1746126996.704753:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.712026:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.712064:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.712144:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991411456 00000100:00100000:1.0:1746126996.712151:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991411456 00002000:00100000:1.0:1746126996.712182:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009ab0ca80 x1830945991411456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.712191:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ca80 with x1830945991411456 ext(3145728->4194303) 00002000:00010000:1.0:1746126996.712195:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ca80 00000100:00100000:1.0:1746126996.712219:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991411584 00000100:00100000:1.0:1746126996.712221:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991411584 00002000:00100000:1.0:1746126996.712230:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009ab0d880 x1830945991411584/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.712236:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d880 with x1830945991411584 ext(2097152->4194303) 00002000:00010000:1.0:1746126996.712240:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0d880 00000100:00100000:1.0:1746126996.712249:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8334 00000100:00100000:1.0:1746126996.712254:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991411456:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126996.721523:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991411456:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9261us (9495us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126996.721533:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8334 00002000:00100000:1.0:1746126996.721543:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009ab0ca80 x1830945991411456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.721550:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ca80 with x1830945991411456 ext(3145728->4194303) 00002000:00010000:1.0:1746126996.721555:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ca80 00000100:00100000:0.0:1746126996.731629:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.864383:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.868823:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.886027:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.912564:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.922831:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.934409:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.934876:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.938432:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.938477:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.938516:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.938570:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991414144 00000100:00100000:0.0:1746126996.938579:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991414144 00002000:00100000:0.0:1746126996.938621:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2785280->2789375) req@ffff88011dc60000 x1830945991414144/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.938630:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60000 with x1830945991414144 ext(2785280->2789375) 00002000:00010000:0.0:1746126996.938634:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60000 00000100:00100000:0.0:1746126996.938660:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8337 00000100:00100000:0.0:1746126996.938668:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991414144:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126996.939124:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21033 00000100:00100000:1.0:1746126996.939161:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991414272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126996.939171:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.939182:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01a00/0x34dc807b6ef8512 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52330 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.939197:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.939199:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126996.939208:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01a00/0x34dc807b6ef8512 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52330 expref: 40 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.939220:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01a00/0x34dc807b6ef8512 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52330 expref: 40 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126996.939229:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01a00, rc 0) 00000100:00100000:1.0:1746126996.940016:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991414272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 860us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.940022:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21033 00000100:00100000:0.0:1746126996.940125:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991414144:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 1456us (1647us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126996.940151:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8337 00002000:00100000:0.0:1746126996.940159:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2785280->2789375) req@ffff88011dc60000 x1830945991414144/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.940166:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60000 with x1830945991414144 ext(2785280->2789375) 00002000:00010000:0.0:1746126996.940170:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60000 00000100:00100000:0.0:1746126996.951888:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.953344:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.953457:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991414784 00000100:00100000:1.0:1746126996.953466:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991414784 00002000:00100000:1.0:1746126996.953505:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012d28b480 x1830945991414784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.953514:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28b480 with x1830945991414784 ext(0->1048575) 00002000:00010000:1.0:1746126996.953519:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d28b480 00000100:00100000:1.0:1746126996.953543:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8338 00000100:00100000:1.0:1746126996.953553:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991414784:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126996.958521:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.958546:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991414912 00000100:00100000:0.0:1746126996.958557:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991414912 00002000:00100000:0.0:1746126996.958587:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012d28aa00 x1830945991414912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.958596:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28aa00 with x1830945991414912 ext(1048576->2097151) 00002000:00010000:0.0:1746126996.958600:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d28aa00 00000100:00100000:0.0:1746126996.958627:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8339 00000100:00100000:0.0:1746126996.958634:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991414912:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126996.959105:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.959163:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.959238:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991415168 00000100:00100000:1.0:1746126996.959242:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991415168 00002000:00100000:1.0:1746126996.959257:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba54000 x1830945991415168/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/0 e 0 to 0 dl 1746127007 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.959263:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54000 with x1830945991415168 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.959267:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba54000 00000100:00100000:1.0:1746126996.959279:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8341 00000100:00100000:1.0:1746126996.959284:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991415168:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126996.969569:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.970243:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994162688:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126996.970275:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2580479] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 46 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.970295:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9ba1e00, rc 0) 00000100:00100000:1.0:1746126996.970334:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:3988:x1830945991414400:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 14862us (18455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126996.970340:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21034 00000100:00100000:1.0:1746126996.973766:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.975452:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991414912:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16813us (16931us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126996.975461:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8339 00002000:00100000:0.0:1746126996.975471:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012d28aa00 x1830945991414912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126996.975480:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28aa00 with x1830945991414912 ext(1048576->2097151) 00002000:00010000:0.0:1746126996.975484:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d28aa00 00000100:00100000:1.0:1746126996.980285:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991415168:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20992us (21112us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126996.980297:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8341 00002000:00100000:1.0:1746126996.980309:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba54000 x1830945991415168/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:2/0 lens 488/440 e 0 to 0 dl 1746127007 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126996.980317:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54000 with x1830945991415168 ext(1048576->2097151) 00002000:00010000:1.0:1746126996.980322:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba54000 00000100:00100000:0.0:1746126996.987456:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126996.997529:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126996.998806:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991416320 00000100:00100000:1.0:1746126996.998810:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991416320 00000100:00100000:1.0:1746126996.998833:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21035 00000100:00100000:1.0:1746126996.998839:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:3997:x1830945991416320:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126996.998848:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126996.998861:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013084e400/0x34dc807b6ef8520 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5233e expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.998880:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e983600/0x34dc807b6ef84f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2785280->4816895] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5231b expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.998886:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126996.998888:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126996.998891:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e400/0x34dc807b6ef8520 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5233e expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.998918:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e983600/0x34dc807b6ef84f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2785280->4816895] (req 2785280->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5231b expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126996.998931:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e983600/0x34dc807b6ef84f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2785280->4816895] (req 2785280->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5231b expref: 31 pid: 1964 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126996.998942:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994162944:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126996.999436:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.000579:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994162944:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.000599:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013084e400/0x34dc807b6ef8520 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5233e expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.000610:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013084e400, rc 0) 00000100:00100000:1.0:1746126997.000645:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f528050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:3997:x1830945991416320:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1806us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.000651:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21035 00000100:00100000:0.0:1746126997.001529:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.016487:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:0.0:1746126997.016651:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126997.018356:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.019238:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.027471:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.028198:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.028481:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991417216 00000100:00100000:1.0:1746126997.028488:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991417216 00000100:00100000:1.0:1746126997.028534:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991417344 00000100:00100000:1.0:1746126997.028537:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991417344 00000100:00100000:1.0:1746126997.028568:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21036 00000100:00100000:1.0:1746126997.028575:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991417216:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.028589:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.028601:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef854a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5234c expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.028618:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.028620:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.028627:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef854a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5234c expref: 18 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.028638:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef854a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5234c expref: 18 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.028648:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013084e600, rc 0) 00000100:00100000:1.0:1746126997.028683:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991417216:12345-192.168.203.42@tcp:101:cat.0 Request processed in 108us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.028689:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21036 00000100:00100000:1.0:1746126997.028701:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21037 00000100:00100000:1.0:1746126997.028705:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991417344:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.028711:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.028720:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6ef8551 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52353 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.028750:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994163200:192.168.203.42@tcp:106: 00000100:00080000:0.0:1746126997.028779:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746126997.028782:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126997.028803:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.029303:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126997.029401:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.029425:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:1.0:1746126997.031681:0:3542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746126994 -> 1746126995 00000100:00100000:1.0:1746126997.031696:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994163200:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126997.031720:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6ef8551 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52353 expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.031732:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6ef8551 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52353 expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.031766:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013084e200, rc 0) 00000100:00100000:1.0:1746126997.031791:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991417344:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3084us (3593us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126997.031798:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21037 00000100:00100000:1.0:1746126997.031904:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994163328:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.032082:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.032924:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991418112 00000100:00100000:1.0:1746126997.032929:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991418112 00010000:00010000:1.0:1746126997.032951:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdac200/0x34dc807b6ef836e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5225e expref: 10 pid: 12340 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.032977:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9784 00000100:00100000:1.0:1746126997.032982:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991418112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.032992:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.033004:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdac200/0x34dc807b6ef836e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5225e expref: 10 pid: 12340 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.033012:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdac200/0x34dc807b6ef836e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5225e expref: 10 pid: 12340 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.033027:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdac200/0x34dc807b6ef836e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5225e expref: 10 pid: 12340 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.033037:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.033058:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991418112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 76us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.033064:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9784 00000100:00100000:0.0:1746126997.033167:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994163456:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126997.033176:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994163584:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126997.033196:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8558 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5235a expref: 19 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126997.033206:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35dc00, rc 0) 00000100:00100000:0.0:1746126997.033224:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+19:3993:x1830945991417472:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4325us (4420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126997.033229:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21038 00000100:00100000:0.0:1746126997.035904:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.037119:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991418240 00000100:00100000:1.0:1746126997.037126:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991418240 00010000:00010000:1.0:1746126997.037243:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6ef842b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522c0 expref: 19 pid: 3542 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.037701:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9785 00000100:00100000:1.0:1746126997.037708:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991418240:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.037720:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.037736:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6ef842b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522c0 expref: 19 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.037746:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6ef842b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522c0 expref: 19 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.037763:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6ef842b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522c0 expref: 19 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.037775:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.038231:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991418240:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 522us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.038238:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9785 00000100:00100000:0.0:1746126997.044273:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.044845:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991418368 00000100:00100000:1.0:1746126997.044852:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991418368 00010000:00010000:1.0:1746126997.044878:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009867fa00/0x34dc807b6ef8344 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52234 expref: 34 pid: 9612 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.044913:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9786 00000100:00100000:1.0:1746126997.044919:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991418368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.044930:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.044943:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009867fa00/0x34dc807b6ef8344 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52234 expref: 34 pid: 9612 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.044952:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009867fa00/0x34dc807b6ef8344 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52234 expref: 34 pid: 9612 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.044970:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009867fa00/0x34dc807b6ef8344 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52234 expref: 34 pid: 9612 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.044982:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.044984:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.044989:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5235a expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.044997:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5235a expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.045027:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5235a expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.045040:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994163712:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.045089:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.049182:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994163712:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.049198:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.049246:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991418368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4325us (4978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.049255:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9786 00000100:00100000:1.0:1746126997.050784:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.055747:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.058071:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.058285:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991418880 00000100:00100000:1.0:1746126997.058290:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991418880 00010000:00010000:1.0:1746126997.058311:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef854a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5234c expref: 20 pid: 3542 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.058346:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9787 00000100:00100000:1.0:1746126997.058352:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991418880:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.058360:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.058373:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef854a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5234c expref: 20 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.058441:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef854a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5234c expref: 19 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.058457:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef854a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5234c expref: 19 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.058470:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.058487:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991418880:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 135us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.058492:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9787 00000100:00100000:0.0:1746126997.061468:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.061509:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.062854:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.062905:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991419264 00000100:00100000:1.0:1746126997.062909:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991419264 00010000:00010000:1.0:1746126997.062924:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e400/0x34dc807b6ef8520 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5233e expref: 33 pid: 16295 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.063065:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9788 00000100:00100000:1.0:1746126997.063070:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991419264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.063078:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.063107:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013084e400/0x34dc807b6ef8520 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5233e expref: 33 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.063116:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013084e400/0x34dc807b6ef8520 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5233e expref: 33 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.063228:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013084e400/0x34dc807b6ef8520 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5233e expref: 33 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.063239:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.063240:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.063246:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6ef855f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4825087] (req 2097152->2846719) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52361 expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.063253:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6ef855f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4825087] (req 2097152->2846719) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52361 expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.063272:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6ef855f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4825087] (req 2097152->2846719) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52361 expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.063285:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994164224:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126997.064058:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.064752:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.064913:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994164224:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.064926:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.064945:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991419264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1874us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.064950:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9788 00000100:00100000:0.0:1746126997.067694:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.071715:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.076397:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.077183:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.077415:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.087620:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.088229:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991420672 00000100:00100000:1.0:1746126997.088237:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991420672 00010000:00010000:1.0:1746126997.088266:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6ef855f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->4825087] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52361 expref: 21 pid: 1964 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.088301:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9789 00000100:00100000:1.0:1746126997.088309:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991420672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.088319:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.088334:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6ef855f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->4825087] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52361 expref: 21 pid: 1964 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.088344:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6ef855f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->4825087] (req 2097152->2846719) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52361 expref: 21 pid: 1964 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.088361:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6ef855f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->4825087] (req 2097152->2846719) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52361 expref: 21 pid: 1964 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.088385:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.088387:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.088394:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf6000/0x34dc807b6ef8574 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52376 expref: 30 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.088401:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf6000/0x34dc807b6ef8574 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52376 expref: 30 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.088408:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.088409:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.088412:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef857b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2846720->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5237d expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.088418:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef857b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2846720->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5237d expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.088441:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef857b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2846720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5237d expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.088450:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994164480:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.088631:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbf6000/0x34dc807b6ef8574 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52376 expref: 30 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.088740:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994164608:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.088760:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.090852:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994164480:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.090862:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994164608:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.090877:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.090903:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991420672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2595us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.090911:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9789 00000100:00100000:0.0:1746126997.091122:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.091213:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.091404:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8348 00000100:00100000:1.0:1746126997.091411:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991421184:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.096105:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991421184:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4679us (4877us total) trans 0 rc 630784/630784 00000100:00100000:1.0:1746126997.096113:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8348 00002000:00100000:1.0:1746126997.096118:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4825087) req@ffff88009942e680 x1830945991421184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 630784/630784 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.096124:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942e680 with x1830945991421184 ext(4194304->4825087) 00002000:00010000:1.0:1746126997.096127:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942e680 00000100:00100000:0.0:1746126997.097164:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.098284:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.098735:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.098770:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991421568 00000100:00100000:1.0:1746126997.098774:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991421568 00002000:00100000:1.0:1746126997.098794:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2580479) req@ffff88009cc3dc00 x1830945991421568/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.098802:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3dc00 with x1830945991421568 ext(2097152->2580479) 00010000:00010000:1.0:1746126997.098807:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 40 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.098821:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 40 pid: 16295 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.098828:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cc3dc00 00000100:00100000:1.0:1746126997.098876:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1812 00000100:00100000:1.0:1746126997.098883:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991421568:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126997.102369:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.102395:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.103294:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991421568:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4410us (4558us total) trans 17179875508 rc 0/0 00000100:00100000:1.0:1746126997.103302:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1812 00002000:00100000:1.0:1746126997.103310:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2580479) req@ffff88009cc3dc00 x1830945991421568/t17179875508(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/448 e 0 to 0 dl 1746127008 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.103318:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3dc00 with x1830945991421568 ext(2097152->2580479) 00010000:00010000:1.0:1746126997.103324:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 44 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.103334:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 44 pid: 16295 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.103340:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cc3dc00 00000100:00100000:0.0:1746126997.106853:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.106927:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991421952 00000100:00100000:1.0:1746126997.106934:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991421952 00010000:00010000:1.0:1746126997.106960:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 42 pid: 16295 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.107920:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9790 00000100:00100000:1.0:1746126997.107929:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991421952:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.107940:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.107953:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 42 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.107965:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 42 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.107979:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef8519 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52337 expref: 42 pid: 16295 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.107996:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.107997:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.108002:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e5400/0x34dc807b6ef8582 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52384 expref: 19 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.108006:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e5400/0x34dc807b6ef8582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52384 expref: 19 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.108026:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e5400/0x34dc807b6ef8582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52384 expref: 19 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.108033:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994165248:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.108112:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.109597:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994165248:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.109612:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.109648:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991421952:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1721us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.109658:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9790 00000100:00100000:0.0:1746126997.114888:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.114937:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.115014:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991422336 00000100:00100000:1.0:1746126997.115018:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991422336 00002000:00100000:1.0:1746126997.115038:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cc3f480 x1830945991422336/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.115046:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3f480 with x1830945991422336 ext(2097152->4194303) 00002000:00010000:1.0:1746126997.115051:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3f480 00000100:00100000:1.0:1746126997.115171:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8349 00000100:00100000:1.0:1746126997.115182:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991422336:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.118405:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.118890:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991422720 00000100:00100000:1.0:1746126997.118897:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991422720 00000100:00100000:1.0:1746126997.118954:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17153 00000100:00100000:1.0:1746126997.118961:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4005:x1830945991422720:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126997.118981:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.118994:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef859e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523a0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746126997.119572:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746126997.119874:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.119885:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.119893:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.119904:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.119908:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.119913:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120033:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120042:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120048:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126997.120055:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126997.120123:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120143:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120148:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120152:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.120155:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120160:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120169:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126997.120171:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126997.120174:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120182:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35400/0x34dc807b6ef85b3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120197:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120202:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120206:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120209:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120213:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c34800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.120215:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120219:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120225:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126997.120226:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.120228:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120232:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34800/0x34dc807b6ef85a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120238:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120242:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120247:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120251:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.120253:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120257:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120262:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619300) 00010000:00010000:1.0:1746126997.120264:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.120265:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120269:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.120298:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef859e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a0 expref: 37 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.120305:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef859e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a0 expref: 37 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.120311:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c35000, rc 0) 00000100:00100000:1.0:1746126997.120356:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4005:x1830945991422720:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1395us (1956us total) trans 8589938056 rc 301/301 00000100:00100000:1.0:1746126997.120362:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17153 00000100:00100000:1.0:1746126997.135515:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991422336:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20330us (20570us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746126997.135529:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8349 00002000:00100000:1.0:1746126997.135543:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cc3f480 x1830945991422336/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.135551:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3f480 with x1830945991422336 ext(2097152->4194303) 00002000:00010000:1.0:1746126997.135556:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3f480 00000100:00100000:0.0:1746126997.143576:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.143662:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991422976 00000100:00100000:1.0:1746126997.143671:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991422976 00002000:00100000:1.0:1746126997.144290:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009cc3ca80 x1830945991422976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.144298:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3ca80 with x1830945991422976 ext(4194304->4829183) 00002000:00010000:1.0:1746126997.144302:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3ca80 00000100:00100000:1.0:1746126997.144332:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8351 00000100:00100000:1.0:1746126997.144340:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991422976:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.153164:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991422976:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8817us (9587us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746126997.153174:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8351 00002000:00100000:1.0:1746126997.153184:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009cc3ca80 x1830945991422976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.153193:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3ca80 with x1830945991422976 ext(4194304->4829183) 00002000:00010000:1.0:1746126997.153198:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3ca80 00000100:00100000:0.0:1746126997.177613:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.185735:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.185775:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.195505:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.195551:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.195697:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991423744 00000100:00100000:1.0:1746126997.195705:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991423744 00000100:00100000:1.0:1746126997.195742:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17154 00000100:00100000:1.0:1746126997.195749:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4008:x1830945991423744:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126997.195769:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.195782:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef85c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523b5 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.195839:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.195849:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.195858:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.195868:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.195873:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.195878:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.195950:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.195957:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196359:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126997.196367:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126997.196415:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196424:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196429:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196434:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.196437:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196442:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196450:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126997.196453:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126997.196456:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196460:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6ef85e4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196550:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196555:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196559:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196564:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196567:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c34400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.196570:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196574:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196580:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126997.196582:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.196585:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196589:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34400/0x34dc807b6ef85cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196595:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196600:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196603:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196607:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.196608:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196613:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196617:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619000) 00010000:00010000:1.0:1746126997.196619:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.196621:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196628:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef85d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.196655:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef85c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523b5 expref: 19 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.196661:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef85c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523b5 expref: 19 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.196667:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c34e00, rc 0) 00000100:00100000:1.0:1746126997.196992:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4008:x1830945991423744:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1241us (1438us total) trans 8589938057 rc 301/301 00000100:00100000:1.0:1746126997.196998:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17154 00000100:00100000:0.0:1746126997.202849:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.202942:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.209687:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.209817:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991424256 00000100:00100000:1.0:1746126997.209825:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991424256 00002000:00100000:1.0:1746126997.209860:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3436544->3440639) req@ffff88012d3fc000 x1830945991424256/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.209869:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fc000 with x1830945991424256 ext(3436544->3440639) 00010000:00010000:1.0:1746126997.209875:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096643400/0x34dc807b6ef85dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ae expref: 42 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.209888:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096643400/0x34dc807b6ef85dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ae expref: 42 pid: 3542 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.209894:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3fc000 00000100:00100000:1.0:1746126997.209924:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1813 00000100:00100000:1.0:1746126997.209930:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991424256:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126997.210043:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991424256:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 112us (362us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126997.210048:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1813 00002000:00100000:1.0:1746126997.210053:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3436544->3440639) req@ffff88012d3fc000 x1830945991424256/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/4536 e 0 to 0 dl 1746127008 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.210060:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fc000 with x1830945991424256 ext(3436544->3440639) 00010000:00010000:1.0:1746126997.210065:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096643400/0x34dc807b6ef85dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ae expref: 42 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.210073:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096643400/0x34dc807b6ef85dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ae expref: 42 pid: 3542 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.210078:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3fc000 00000100:00100000:0.0:1746126997.212680:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.212727:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.220704:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.224916:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.231021:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.231705:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991425664 00000100:00100000:1.0:1746126997.231712:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991425664 00000100:00100000:1.0:1746126997.231762:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17155 00000100:00100000:1.0:1746126997.231769:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4012:x1830945991425664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.231787:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.231801:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6ef85f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523c3 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.231854:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231863:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231871:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231881:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231886:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231890:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231956:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231964:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.231969:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126997.231976:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126997.232021:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232026:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232031:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232036:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.232039:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232044:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232053:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126997.232055:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126997.232058:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232063:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35000/0x34dc807b6ef860e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232106:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232112:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232116:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232121:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232124:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c34a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.232127:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232150:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232156:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126997.232158:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.232161:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232165:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34a00/0x34dc807b6ef8600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232172:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232177:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232181:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232185:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c34e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.232188:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232192:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232197:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619000) 00010000:00010000:1.0:1746126997.232200:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.232202:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232206:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.232232:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6ef85f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523c3 expref: 39 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.232239:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6ef85f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523c3 expref: 39 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.232245:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c34000, rc 0) 00000100:00100000:1.0:1746126997.232293:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4012:x1830945991425664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 524us (1277us total) trans 8589938059 rc 301/301 00000100:00100000:1.0:1746126997.232300:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17155 00000100:00100000:0.0:1746126997.233444:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.234019:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.235884:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.235901:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.235923:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.235942:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991426432 00000100:00100000:1.0:1746126997.235945:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991426432 00000100:00100000:1.0:1746126997.235969:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21051 00000100:00100000:1.0:1746126997.235975:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991426304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.235986:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.235998:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c35800/0x34dc807b6ef861c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523ca expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.236034:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994166272:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126997.236076:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.238543:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994166272:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126997.238557:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c35800/0x34dc807b6ef861c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ca expref: 32 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.238566:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c35800/0x34dc807b6ef861c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ca expref: 32 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.238585:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c35800, rc 0) 00000100:00100000:1.0:1746126997.238600:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991426304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2626us (2718us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126997.238605:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21051 00000100:00100000:0.0:1746126997.247613:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.247710:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991426688 00000100:00100000:1.0:1746126997.247717:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991426688 00000100:00100000:1.0:1746126997.247760:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21054 00000100:00100000:1.0:1746126997.247766:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4012:x1830945991426688:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.247782:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.247797:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8631 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523df expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.247843:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5235a expref: 18 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.247848:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.247849:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.247852:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8631 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523df expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.247881:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5235a expref: 18 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.247888:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8558 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5235a expref: 18 pid: 1964 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.247897:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994166528:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.248221:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.249344:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994166528:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.249371:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8631 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523df expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.249382:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c34e00, rc 0) 00000100:00100000:1.0:1746126997.249423:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4012:x1830945991426688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1656us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.249430:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21054 00000100:00100000:0.0:1746126997.251311:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.255592:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.262904:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.263278:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8354 00000100:00100000:1.0:1746126997.263287:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991427200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.270513:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991427200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7218us (7607us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126997.270524:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8354 00002000:00100000:1.0:1746126997.270534:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009d1b5500 x1830945991427200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.270543:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5500 with x1830945991427200 ext(1048576->2097151) 00002000:00010000:1.0:1746126997.270548:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b5500 00000100:00100000:0.0:1746126997.276917:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.276978:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991427328 00000100:00100000:1.0:1746126997.276987:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991427328 00000100:00100000:1.0:1746126997.277036:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21055 00000100:00100000:1.0:1746126997.277045:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4012:x1830945991427328:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.277061:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.277075:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c35800/0x34dc807b6ef8638 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523e6 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.277109:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.277111:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.277118:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c35800/0x34dc807b6ef8638 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523e6 expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.277157:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c35800/0x34dc807b6ef8638 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523e6 expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.277172:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c35800, rc 0) 00000100:00100000:1.0:1746126997.277216:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4012:x1830945991427328:12345-192.168.203.42@tcp:101:cat.0 Request processed in 172us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.277222:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21055 00000100:00100000:0.0:1746126997.281227:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.281455:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991427584 00000100:00100000:1.0:1746126997.281464:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991427584 00002000:00100000:1.0:1746126997.281502:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009d1b5880 x1830945991427584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.281511:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5880 with x1830945991427584 ext(2097152->3145727) 00002000:00010000:1.0:1746126997.281515:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b5880 00000100:00100000:1.0:1746126997.281547:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8355 00000100:00100000:1.0:1746126997.281555:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991427584:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.291879:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991427584:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10318us (10653us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126997.291890:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8355 00002000:00100000:1.0:1746126997.291901:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009d1b5880 x1830945991427584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.291910:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5880 with x1830945991427584 ext(2097152->3145727) 00002000:00010000:1.0:1746126997.291915:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b5880 00000100:00100000:0.0:1746126997.295208:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.295290:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991427712 00000100:00100000:1.0:1746126997.295297:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991427712 00000100:00100000:1.0:1746126997.295336:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21056 00000100:00100000:1.0:1746126997.295343:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4012:x1830945991427712:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.295357:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.295371:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523ed expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.295393:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef85f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4063231) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523bc expref: 19 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.295399:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.295401:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.295403:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 44 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.295424:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef85f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4063231) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523bc expref: 19 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.295433:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef85f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4063231) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523bc expref: 19 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.295442:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994166784:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.295511:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.296573:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994166784:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.296590:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 44 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.296600:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c35000, rc 0) 00000100:00100000:1.0:1746126997.296874:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4012:x1830945991427712:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1530us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.296881:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21056 00000100:00100000:0.0:1746126997.297023:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.297602:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991427840 00000100:00100000:1.0:1746126997.298216:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991427840 00002000:00100000:1.0:1746126997.298247:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3883008->4063231) req@ffff88009d1b4e00 x1830945991427840/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.298257:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4e00 with x1830945991427840 ext(3883008->4063231) 00010000:00010000:1.0:1746126997.298263:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef85f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523bc expref: 20 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.298275:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef85f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523bc expref: 20 pid: 3542 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.298280:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b4e00 00000100:00100000:1.0:1746126997.298308:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1816 00000100:00100000:1.0:1746126997.298315:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991427840:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746126997.301272:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991427840:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 2951us (4243us total) trans 17179875510 rc 0/0 00000100:00100000:1.0:1746126997.301281:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1816 00002000:00100000:1.0:1746126997.301291:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3883008->4063231) req@ffff88009d1b4e00 x1830945991427840/t17179875510(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/448 e 0 to 0 dl 1746127008 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.301299:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4e00 with x1830945991427840 ext(3883008->4063231) 00010000:00010000:1.0:1746126997.301306:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef85f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523bc expref: 22 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.301322:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef85f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523bc expref: 22 pid: 3542 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.301328:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b4e00 00000100:00100000:0.0:1746126997.303172:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.306565:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.306682:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991428224 00000100:00100000:1.0:1746126997.306688:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991428224 00002000:00100000:1.0:1746126997.306713:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88009d1b5f80 x1830945991428224/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.306722:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5f80 with x1830945991428224 ext(2097152->3145727) 00002000:00010000:1.0:1746126997.306727:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b5f80 00000100:00100000:1.0:1746126997.307069:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8356 00000100:00100000:1.0:1746126997.307076:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991428224:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.312905:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991428224:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5823us (6335us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126997.312914:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8356 00002000:00100000:1.0:1746126997.312921:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88009d1b5f80 x1830945991428224/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.312927:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5f80 with x1830945991428224 ext(2097152->3145727) 00002000:00010000:1.0:1746126997.312932:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b5f80 00000100:00100000:0.0:1746126997.316771:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.316858:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991428352 00000100:00100000:1.0:1746126997.316867:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991428352 00000100:00100000:1.0:1746126997.316921:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21057 00000100:00100000:1.0:1746126997.316928:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4012:x1830945991428352:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.316944:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.316957:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8646 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523f4 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.316980:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef85c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3891200->4825087] (req 3891200->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a7 expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.316987:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.316989:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.316991:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8646 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523f4 expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.317013:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef85c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3891200->4825087] (req 3891200->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a7 expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.317022:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef85c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3891200->4825087] (req 3891200->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a7 expref: 34 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.317032:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994167040:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.317117:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.317992:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994167040:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.318009:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8646 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523f4 expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.318020:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4c00, rc 0) 00000100:00100000:1.0:1746126997.318052:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4012:x1830945991428352:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1124us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.318061:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21057 00000100:00100000:0.0:1746126997.318503:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.318552:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991428480 00000100:00100000:1.0:1746126997.318556:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991428480 00002000:00100000:1.0:1746126997.318576:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3891200->4194303) req@ffff88009d1b6d80 x1830945991428480/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.318585:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6d80 with x1830945991428480 ext(3891200->4194303) 00010000:00010000:1.0:1746126997.318591:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef85c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3891200->4825087] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a7 expref: 34 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.318606:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef85c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3891200->4825087] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a7 expref: 34 pid: 3542 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.318611:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1b6d80 00000100:00100000:1.0:1746126997.318631:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1817 00000100:00100000:1.0:1746126997.318636:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991428480:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746126997.321025:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991428480:12345-192.168.203.42@tcp:4:cat.0 Request processed in 2384us (2519us total) trans 21474842768 rc 0/0 00000100:00100000:1.0:1746126997.321035:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1817 00002000:00100000:1.0:1746126997.321043:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3891200->4194303) req@ffff88009d1b6d80 x1830945991428480/t21474842768(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/448 e 0 to 0 dl 1746127008 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.321051:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6d80 with x1830945991428480 ext(3891200->4194303) 00010000:00010000:1.0:1746126997.321058:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef85c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3891200->4825087] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a7 expref: 36 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.321070:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef85c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3891200->4825087] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523a7 expref: 36 pid: 3542 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.321076:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1b6d80 00000100:00100000:0.0:1746126997.323342:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.329689:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.329740:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.329829:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991428992 00000100:00100000:1.0:1746126997.329836:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991428992 00002000:00100000:1.0:1746126997.329868:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880096631c00 x1830945991428992/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.329877:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631c00 with x1830945991428992 ext(3145728->4194303) 00002000:00010000:1.0:1746126997.329881:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096631c00 00000100:00100000:1.0:1746126997.329892:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991429120 00000100:00100000:1.0:1746126997.329893:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991429120 00002000:00100000:1.0:1746126997.329902:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff880096630a80 x1830945991429120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.329908:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630a80 with x1830945991429120 ext(3145728->4194303) 00002000:00010000:1.0:1746126997.329910:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096630a80 00000100:00100000:1.0:1746126997.329933:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8357 00000100:00100000:1.0:1746126997.329938:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991428992:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.335274:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991428992:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5329us (5585us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126997.335284:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8357 00002000:00100000:1.0:1746126997.335294:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880096631c00 x1830945991428992/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.335302:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631c00 with x1830945991428992 ext(3145728->4194303) 00002000:00010000:1.0:1746126997.335306:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096631c00 00000100:00100000:0.0:1746126997.336460:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.336759:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991429376 00000100:00100000:1.0:1746126997.336772:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991429376 00000100:00100000:1.0:1746126997.336821:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17156 00000100:00100000:1.0:1746126997.336828:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4015:x1830945991429376:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126997.336847:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.336861:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009da61c00/0x34dc807b6ef864d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e523fb expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.336913:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.336923:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.336931:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.336940:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.336946:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.336950:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337015:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337022:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337027:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126997.337038:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126997.337080:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337086:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337106:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337111:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f86200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.337114:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337119:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337127:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126997.337152:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126997.337156:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337160:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef8662 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337189:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337194:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337199:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337207:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337211:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800967e5400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.337213:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337217:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337223:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126997.337225:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.337227:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337231:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6ef8654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337236:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337241:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337245:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337249:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f86c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.337251:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337255:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337263:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619300) 00010000:00010000:1.0:1746126997.337265:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.337267:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337271:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef865b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.337294:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009da61c00/0x34dc807b6ef864d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523fb expref: 41 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.337300:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009da61c00/0x34dc807b6ef864d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523fb expref: 41 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.337306:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009da61c00, rc 0) 00000100:00100000:1.0:1746126997.337350:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4015:x1830945991429376:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 522us (897us total) trans 8589938062 rc 301/301 00000100:00100000:1.0:1746126997.337356:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17156 00000100:00100000:0.0:1746126997.341600:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.349075:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.349291:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991429760 00000100:00100000:1.0:1746126997.349300:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991429760 00000100:00100000:1.0:1746126997.349343:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21058 00000100:00100000:1.0:1746126997.349350:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4015:x1830945991429760:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126997.349364:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.349377:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f86a00/0x34dc807b6ef8670 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52402 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.349402:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8646 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523f4 expref: 36 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.349427:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.349428:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.349432:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f86a00/0x34dc807b6ef8670 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3694592->3923967] (req 3694592->3923967) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52402 expref: 36 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.349461:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8646 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523f4 expref: 36 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.349471:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8646 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523f4 expref: 36 pid: 9613 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.349480:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994167296:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.350121:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.350931:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994167296:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.350952:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f86a00/0x34dc807b6ef8670 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3694592->3923967] (req 3694592->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52402 expref: 36 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.350964:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f86a00, rc 0) 00000100:00100000:1.0:1746126997.351699:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4015:x1830945991429760:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2346us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.351707:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21058 00000100:00100000:0.0:1746126997.353278:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.355376:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.361209:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.365165:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.377027:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.377082:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991430912 00000100:00100000:1.0:1746126997.377097:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991430912 00000100:00100000:1.0:1746126997.377169:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17157 00000100:00100000:1.0:1746126997.377177:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4020:x1830945991430912:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.377197:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.377211:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86800/0x34dc807b6ef8677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52409 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.377266:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377275:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377284:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377296:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377300:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377305:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377376:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377384:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377390:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126997.377398:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126997.377445:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377454:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377459:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377463:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f86600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.377466:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377471:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377480:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126997.377482:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126997.377485:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377489:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86600/0x34dc807b6ef868c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377520:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377525:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377529:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377533:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377537:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f87200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.377539:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377543:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377548:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126997.377550:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.377553:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377556:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef867e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377568:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377572:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377576:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377580:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f87000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126997.377582:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377586:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377590:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619000) 00010000:00010000:1.0:1746126997.377592:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126997.377595:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377602:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef8685 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126997.377633:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86800/0x34dc807b6ef8677 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52409 expref: 21 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.377639:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86800/0x34dc807b6ef8677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52409 expref: 21 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.377646:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f86800, rc 0) 00000100:00100000:1.0:1746126997.377700:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4020:x1830945991430912:12345-192.168.203.42@tcp:101:cat.0 Request processed in 523us (679us total) trans 8589938064 rc 301/301 00000100:00100000:1.0:1746126997.377705:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17157 00000100:00100000:0.0:1746126997.379162:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.384457:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.384516:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991431296 00000100:00100000:1.0:1746126997.384523:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991431296 00000100:00100000:1.0:1746126997.384581:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21059 00000100:00100000:1.0:1746126997.384588:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991431296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.384603:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.384615:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f87000/0x34dc807b6ef869a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52410 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.384634:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.384635:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.384642:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f87000/0x34dc807b6ef869a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52410 expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.384654:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f87000/0x34dc807b6ef869a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52410 expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.384669:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f87000, rc 0) 00000100:00100000:1.0:1746126997.384717:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991431296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 130us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.384723:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21059 00000100:00100000:0.0:1746126997.384803:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.384831:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991431552 00000100:00100000:1.0:1746126997.384834:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991431552 00000100:00100000:1.0:1746126997.384856:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21060 00000100:00100000:1.0:1746126997.384861:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991431552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.384868:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.384875:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5241e expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.384886:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.384887:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.384891:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 22 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.384900:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 22 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.384907:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f87200, rc 0) 00000100:00100000:0.0:1746126997.384911:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991431424 00000100:00100000:0.0:1746126997.384915:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991431424 00000100:00100000:1.0:1746126997.384926:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991431552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 64us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.384931:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21060 00000100:00100000:0.0:1746126997.384940:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21061 00000100:00100000:0.0:1746126997.384945:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991431424:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126997.384952:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126997.384958:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef86a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52417 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126997.384979:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef86a8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52417 expref: 22 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126997.384987:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800911dee00/0x34dc807b6ef86a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52417 expref: 22 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126997.385008:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911dee00, rc 0) 00000100:00100000:0.0:1746126997.385301:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991431424:12345-192.168.203.42@tcp:101:cat.0 Request processed in 340us (404us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126997.385313:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21061 00000100:00100000:0.0:1746126997.394405:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.394495:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991431808 00000100:00100000:1.0:1746126997.394505:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991431808 00002000:00100000:1.0:1746126997.394543:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009c428380 x1830945991431808/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.394552:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428380 with x1830945991431808 ext(1048576->2097151) 00002000:00010000:1.0:1746126997.394557:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428380 00000100:00100000:1.0:1746126997.394584:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8362 00000100:00100000:1.0:1746126997.394591:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991431808:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.399319:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991431808:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4721us (4915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126997.399330:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8362 00002000:00100000:1.0:1746126997.399340:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009c428380 x1830945991431808/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.399349:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428380 with x1830945991431808 ext(1048576->2097151) 00002000:00010000:1.0:1746126997.399354:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428380 00000100:00100000:0.0:1746126997.402834:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.407695:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.407741:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.407923:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8364 00000100:00100000:1.0:1746126997.407931:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991432448:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.413536:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991432448:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5605us (5793us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126997.413544:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8364 00002000:00100000:1.0:1746126997.413549:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88009c42a680 x1830945991432448/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.413557:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42a680 with x1830945991432448 ext(2097152->3145727) 00002000:00010000:1.0:1746126997.413560:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c42a680 00000100:00100000:0.0:1746126997.421642:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.424536:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.424598:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991432704 00000100:00100000:1.0:1746126997.424603:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991432704 00002000:00100000:1.0:1746126997.424629:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3694592->3923967) req@ffff88009c42b480 x1830945991432704/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.424639:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b480 with x1830945991432704 ext(3694592->3923967) 00010000:00010000:1.0:1746126997.424644:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094f86a00/0x34dc807b6ef8670 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3694592->4825087] (req 3694592->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52402 expref: 35 pid: 9613 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.424654:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094f86a00/0x34dc807b6ef8670 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3694592->4825087] (req 3694592->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52402 expref: 35 pid: 9613 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746126997.424660:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c42b480 00000100:00100000:1.0:1746126997.424853:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1818 00000100:00100000:1.0:1746126997.424860:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991432704:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126997.428641:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.433853:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.433899:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.434159:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8366 00000100:00100000:0.0:1746126997.434165:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991433344:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126997.442507:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991433344:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8333us (8598us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126997.442518:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8366 00002000:00100000:1.0:1746126997.442528:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009c428e00 x1830945991433344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126997.442537:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428e00 with x1830945991433344 ext(3145728->4194303) 00002000:00010000:1.0:1746126997.442541:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c428e00 00000100:00100000:0.0:1746126997.450955:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.455213:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.563406:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.563675:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991434112 00000100:00100000:1.0:1746126997.563683:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991434112 00000100:00100000:1.0:1746126997.563765:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6505 00000100:00100000:1.0:1746126997.563772:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:3971:x1830945991434112:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:1.0:1746126997.563914:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:3971:x1830945991434112:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 143us (515us total) trans 8589938067 rc 0/0 00000100:00100000:1.0:1746126997.563920:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6505 00000100:00080000:0.0:1746126997.564342:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746126997.567111:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.567494:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.570831:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.570913:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.573529:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.582217:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.589635:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.589685:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.589767:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991435392 00000100:00100000:1.0:1746126997.589775:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991435392 00010000:00010000:1.0:1746126997.589806:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f87000/0x34dc807b6ef869a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52410 expref: 24 pid: 9613 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.589826:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991435520 00000100:00100000:1.0:1746126997.589828:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991435520 00010000:00010000:1.0:1746126997.589838:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c34e00/0x34dc807b6ef8631 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523df expref: 37 pid: 9613 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.589853:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9800 00000100:00100000:1.0:1746126997.589859:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991435392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.589871:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.589888:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f87000/0x34dc807b6ef869a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52410 expref: 24 pid: 9613 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.589897:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f87000/0x34dc807b6ef869a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52410 expref: 24 pid: 9613 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.589937:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f87000/0x34dc807b6ef869a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52410 expref: 24 pid: 9613 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.589955:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.589988:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991435392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 129us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.589994:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9800 00000100:00100000:0.0:1746126997.593655:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.603432:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.603877:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.606205:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.606244:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.606268:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991436544 00000100:00100000:0.0:1746126997.606272:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991436544 00002000:00100000:0.0:1746126997.607237:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4825087) req@ffff8800a7c50380 x1830945991436544/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126997.607246:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50380 with x1830945991436544 ext(4194304->4825087) 00010000:00010000:0.0:1746126997.607253:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8703 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52441 expref: 36 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:0.0:1746126997.607262:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8703 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52441 expref: 36 pid: 3542 timeout: 992 lvb_type: 1 00002000:00010000:0.0:1746126997.607268:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c50380 00000100:00100000:0.0:1746126997.607298:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1819 00000100:00100000:0.0:1746126997.607305:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991436544:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126997.611471:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.611492:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.611535:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.611575:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991436800 00000100:00100000:0.0:1746126997.611583:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991436800 00010000:00010000:0.0:1746126997.611618:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e368c00/0x34dc807b6ef86af lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52425 expref: 25 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746126997.611644:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991436672 00000100:00100000:0.0:1746126997.611647:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991436672 00010000:00010000:0.0:1746126997.611657:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c35800/0x34dc807b6ef8638 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523e6 expref: 38 pid: 9613 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746126997.611670:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991436928 00000100:00100000:0.0:1746126997.611672:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991436928 00000100:00100000:1.0:1746126997.611700:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9803 00000100:00100000:1.0:1746126997.611716:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991436800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.611732:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.611751:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e368c00/0x34dc807b6ef86af lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52425 expref: 25 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.611763:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e368c00/0x34dc807b6ef86af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52425 expref: 25 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.611783:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.611830:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991436800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 120us (368us total) trans 0 rc 0/0 00010000:00010000:0.0:1746126997.611967:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52296 expref: 22 pid: 7260 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.612180:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9803 00000100:00100000:0.0:1746126997.612699:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9805 00000100:00100000:0.0:1746126997.612705:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991436928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126997.612714:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126997.612719:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52296 expref: 22 pid: 7260 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.612727:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52296 expref: 22 pid: 7260 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.612741:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6ef8401 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52296 expref: 22 pid: 7260 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.612800:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.613163:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126997.613723:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126997.613729:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35e00/0x34dc807b6ef871f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126997.613738:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35e00/0x34dc807b6ef871f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126997.613744:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35e00/0x34dc807b6ef871f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126997.613761:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126997.614998:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991436928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2291us (3461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126997.615005:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9805 00000100:00100000:0.0:1746126997.615430:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991437312 00000100:00100000:0.0:1746126997.615434:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991437312 00010000:00010000:0.0:1746126997.615497:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e368a00/0x34dc807b6ef86b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5242c expref: 23 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746126997.615526:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9806 00000100:00100000:0.0:1746126997.615532:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991437312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126997.615539:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126997.615548:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e368a00/0x34dc807b6ef86b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5242c expref: 23 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.615557:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e368a00/0x34dc807b6ef86b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5242c expref: 23 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.615577:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e368a00/0x34dc807b6ef86b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5242c expref: 23 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.615587:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126997.615603:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991437312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126997.615608:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9806 00000100:00100000:0.0:1746126997.619203:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.619733:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.620455:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace693c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.622930:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994169088:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.622942:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.623098:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991437440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3737us (3893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.623107:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9807 00000100:00100000:0.0:1746126997.627889:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.631289:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.634527:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.650646:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991438080:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 15586us (16112us total) trans 21474842770 rc 0/0 00000100:00100000:0.0:1746126997.650657:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1821 00002000:00100000:0.0:1746126997.650668:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2543615) req@ffff8800a7c52a00 x1830945991438080/t21474842770(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/448 e 0 to 0 dl 1746127008 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126997.650676:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52a00 with x1830945991438080 ext(2097152->2543615) 00010000:00010000:0.0:1746126997.650684:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094b9fa00/0x34dc807b6ef8718 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4825087] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52456 expref: 24 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.650699:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094b9fa00/0x34dc807b6ef8718 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4825087] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52456 expref: 24 pid: 3542 timeout: 992 lvb_type: 0 00002000:00010000:0.0:1746126997.650705:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c52a00 00000100:00100000:0.0:1746126997.655534:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.655643:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991438464 00000100:00100000:1.0:1746126997.655651:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991438464 00010000:00010000:1.0:1746126997.655682:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b9fa00/0x34dc807b6ef8718 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4825087] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52456 expref: 24 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.655719:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9808 00000100:00100000:1.0:1746126997.655726:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991438464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.655737:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.655751:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b9fa00/0x34dc807b6ef8718 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->4825087] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52456 expref: 24 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.655761:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b9fa00/0x34dc807b6ef8718 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->4825087] (req 2097152->2543615) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52456 expref: 24 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.655779:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b9fa00/0x34dc807b6ef8718 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->4825087] (req 2097152->2543615) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52456 expref: 24 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.655805:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.655808:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.655813:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9c00/0x34dc807b6ef873b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5246b expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.655821:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9c00/0x34dc807b6ef873b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5246b expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.655849:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9c00/0x34dc807b6ef873b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5246b expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.655859:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994169344:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.655932:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443240 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.661773:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994169344:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.661792:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.661857:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991438464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6130us (6327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.661867:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9808 00000100:00100000:0.0:1746126997.664196:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.675430:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.679521:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.689349:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.691660:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.693196:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.701203:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.709794:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.712035:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.712075:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991440128 00000100:00100000:1.0:1746126997.712080:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991440128 00010000:00010000:1.0:1746126997.712111:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9c00/0x34dc807b6ef873b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5246b expref: 36 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746126997.712148:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9809 00000100:00100000:0.0:1746126997.712155:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991440128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126997.712164:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126997.712180:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9c00/0x34dc807b6ef873b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5246b expref: 36 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.712190:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9c00/0x34dc807b6ef873b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5246b expref: 36 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.712217:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9c00/0x34dc807b6ef873b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5246b expref: 36 pid: 3542 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746126997.712240:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126997.712273:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2029:x1830945991440128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126997.712278:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9809 00000100:00100000:0.0:1746126997.713577:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.737633:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.739056:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.739585:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991440640 00000100:00100000:1.0:1746126997.739591:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991440640 00010000:00010000:1.0:1746126997.739613:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef8773 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52487 expref: 25 pid: 3542 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.739634:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9810 00000100:00100000:1.0:1746126997.739639:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991440640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.739649:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.739664:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef8773 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52487 expref: 25 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.739674:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef8773 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52487 expref: 25 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.739691:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096621000/0x34dc807b6ef8773 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52487 expref: 25 pid: 3542 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.739713:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.739714:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.739719:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096620800/0x34dc807b6ef877a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5248e expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.739725:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096620800/0x34dc807b6ef877a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5248e expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.739749:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096620800/0x34dc807b6ef877a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5248e expref: 34 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.739758:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994169984:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.739813:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126997.742832:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.742869:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.742897:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991440896 00000100:00100000:0.0:1746126997.742903:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991440896 00002000:00100000:0.0:1746126997.742937:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3117056->3121151) req@ffff88011dc61f80 x1830945991440896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126997.742949:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc61f80 with x1830945991440896 ext(3117056->3121151) 00002000:00010000:0.0:1746126997.742953:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc61f80 00000100:00100000:0.0:1746126997.742980:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991441152 00000100:00100000:0.0:1746126997.742982:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991441152 00002000:00100000:0.0:1746126997.742994:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88011dc60a80 x1830945991441152/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126997.743001:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60a80 with x1830945991441152 ext(3145728->4194303) 00002000:00010000:0.0:1746126997.743004:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60a80 00000100:00100000:1.0:1746126997.743067:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994169984:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.743082:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.743197:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991440640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3557us (4142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.743204:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9810 00000100:00100000:0.0:1746126997.743482:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8372 00000100:00100000:0.0:1746126997.743489:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991441152:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126997.746975:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.747018:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991441280 00000100:00100000:1.0:1746126997.747026:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991441280 00000100:00100000:1.0:1746126997.747072:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21075 00000100:00100000:1.0:1746126997.747081:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4029:x1830945991441280:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126997.747109:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.747123:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3a00/0x34dc807b6ef8788 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5249c expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.747166:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 45 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.747174:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.747179:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.747181:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.747184:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3a00/0x34dc807b6ef8788 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2834431] (req 2097152->2834431) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5249c expref: 45 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.747206:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.747216:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 21 pid: 9613 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.747226:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994170112:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.747915:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 45 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.747924:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 45 pid: 9613 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.747931:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994170240:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.747951:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.751142:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994170112:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.751155:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994170240:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.751177:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3a00/0x34dc807b6ef8788 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2834431] (req 2097152->2834431) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5249c expref: 45 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.751192:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3a00, rc 0) 00000100:00100000:1.0:1746126997.751230:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4029:x1830945991441280:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4150us (4260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.751236:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21075 00000100:00100000:0.0:1746126997.753409:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.754210:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991441408 00000100:00100000:1.0:1746126997.754218:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991441408 00010000:00010000:1.0:1746126997.754249:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 45 pid: 9613 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.754279:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9811 00000100:00100000:1.0:1746126997.754286:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991441408:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.754298:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.754313:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 45 pid: 9613 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.754764:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 45 pid: 9613 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.754786:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef863f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e523ed expref: 45 pid: 9613 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746126997.754821:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.754863:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991441408:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 578us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.754870:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9811 00000100:00100000:0.0:1746126997.756931:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.756978:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.757043:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991441536 00000100:00100000:1.0:1746126997.757049:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991441536 00010000:00010000:1.0:1746126997.757073:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 22 pid: 9613 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.757106:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9812 00000100:00100000:1.0:1746126997.757112:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991441536:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126997.757122:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126997.757150:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 22 pid: 9613 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.757160:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 22 pid: 9613 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.757176:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f87200/0x34dc807b6ef86a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5241e expref: 22 pid: 9613 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746126997.757185:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.757187:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.757192:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3a00/0x34dc807b6ef8788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2834431) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5249c expref: 43 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.757204:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3a00/0x34dc807b6ef8788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2834431) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5249c expref: 43 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.757227:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3a00/0x34dc807b6ef8788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2834431) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5249c expref: 43 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.757237:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994170368:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.757299:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126997.764778:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.768266:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.777637:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.784044:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.801073:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.808829:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.809046:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991443200 00000100:00100000:0.0:1746126997.809055:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991443200 00002000:00100000:0.0:1746126997.809157:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009d1b7b80 x1830945991443200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/0 e 0 to 0 dl 1746127008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126997.809166:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b7b80 with x1830945991443200 ext(4194304->4829183) 00002000:00010000:0.0:1746126997.809172:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b7b80 00000100:00100000:0.0:1746126997.809211:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8374 00000100:00100000:0.0:1746126997.809219:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991443200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126997.812615:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.813642:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991443200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4422us (4852us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746126997.813650:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8374 00002000:00100000:0.0:1746126997.813657:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009d1b7b80 x1830945991443200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:3/0 lens 488/440 e 0 to 0 dl 1746127008 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126997.813665:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b7b80 with x1830945991443200 ext(4194304->4829183) 00002000:00010000:0.0:1746126997.813669:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b7b80 00000100:00100000:1.0:1746126997.816225:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.816329:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.816349:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.816588:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.816697:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991443840 00000100:00100000:0.0:1746126997.816703:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991443840 00000100:00100000:1.0:1746126997.816813:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991443968 00000100:00100000:1.0:1746126997.816816:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991443968 00000100:00100000:0.0:1746126997.816855:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21079 00000100:00100000:0.0:1746126997.816862:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991443840:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126997.816876:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126997.816890:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f47c00/0x34dc807b6ef87c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e524c6 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126997.816911:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126997.816913:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126997.816920:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f47c00/0x34dc807b6ef87c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524c6 expref: 46 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126997.816931:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f47c00/0x34dc807b6ef87c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524c6 expref: 46 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126997.816940:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f47c00, rc 0) 00000100:00100000:0.0:1746126997.816970:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991443840:12345-192.168.203.42@tcp:101:cat.0 Request processed in 109us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126997.816976:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21079 00000100:00100000:0.0:1746126997.818685:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.818757:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991444096 00000100:00100000:1.0:1746126997.818761:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991444096 00000100:00100000:1.0:1746126997.818795:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21082 00000100:00100000:1.0:1746126997.818800:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991444096:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.818808:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.818815:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2a00/0x34dc807b6ef87dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e524d4 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.818831:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2a00/0x34dc807b6ef87dc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524d4 expref: 25 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.818838:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2a00/0x34dc807b6ef87dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524d4 expref: 25 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.818849:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2a00, rc 0) 00000100:00100000:1.0:1746126997.819175:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991444096:12345-192.168.203.42@tcp:101:cat.0 Request processed in 373us (492us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126997.819181:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21082 00000100:00100000:0.0:1746126997.830606:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.830666:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991444224 00000100:00100000:1.0:1746126997.830674:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991444224 00000100:00100000:1.0:1746126997.830718:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21083 00000100:00100000:1.0:1746126997.830725:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4039:x1830945991444224:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.830740:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.830753:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef87e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e524db expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.830776:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef870a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52448 expref: 23 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.830782:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.830783:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.830790:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef87e3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524db expref: 36 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.830813:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef870a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52448 expref: 23 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.830823:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef870a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52448 expref: 23 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.830837:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994170880:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.830911:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.831946:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994170880:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.831963:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef87e3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524db expref: 36 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.831974:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3000, rc 0) 00000100:00100000:1.0:1746126997.832013:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4039:x1830945991444224:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1288us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.832020:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21083 00000100:00100000:0.0:1746126997.832413:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.840193:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.844039:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.856212:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.856310:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991444864 00000100:00100000:1.0:1746126997.856318:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991444864 00000100:00100000:1.0:1746126997.856369:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21084 00000100:00100000:1.0:1746126997.856376:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4039:x1830945991444864:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126997.856391:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.856405:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef87ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e524e2 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.856426:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096620800/0x34dc807b6ef877a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5248e expref: 37 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.856433:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.856435:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126997.856437:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef87ea lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524e2 expref: 37 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.856465:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096620800/0x34dc807b6ef877a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5248e expref: 37 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.856474:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096620800/0x34dc807b6ef877a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5248e expref: 37 pid: 3542 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746126997.856484:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994171136:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.856560:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.857552:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994171136:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.857568:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef87ea lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524e2 expref: 37 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.857578:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3200, rc 0) 00000100:00100000:1.0:1746126997.857608:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4039:x1830945991444864:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1232us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.857613:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21084 00000100:00100000:0.0:1746126997.858369:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.865714:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.868526:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.868608:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994171264:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126997.868626:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126997.868669:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991445120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2806us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126997.868677:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9815 00000100:00100000:0.0:1746126997.872594:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.876684:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.876735:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.910430:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.941446:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.941515:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991446400 00000100:00100000:1.0:1746126997.941523:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991446400 00000100:00100000:1.0:1746126997.941571:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21085 00000100:00100000:1.0:1746126997.941578:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4042:x1830945991446400:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126997.941593:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.941607:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e524f0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.941637:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 45 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.941649:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e982800/0x34dc807b6ef841d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b2 expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.941655:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef8367 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52250 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.941661:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.941662:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.941665:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f0 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.941689:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef8367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52250 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.941698:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef8367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52250 expref: 8 pid: 12333 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.941707:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171392:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.941796:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e982800/0x34dc807b6ef841d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b2 expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.941803:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e982800/0x34dc807b6ef841d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b2 expref: 23 pid: 9611 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.941814:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171520:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.941839:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 45 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.941846:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 45 pid: 12340 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.941853:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171648:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.941866:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.943170:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.943177:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171520:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.943182:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171648:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.943200:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f0 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.943211:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2600, rc 0) 00000100:00100000:1.0:1746126997.943245:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4042:x1830945991446400:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1667us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.943251:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21085 00000100:00100000:0.0:1746126997.944669:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.944816:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.944855:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.945474:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991446784 00000100:00100000:0.0:1746126997.945478:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991446784 00010000:00010000:0.0:1746126997.945491:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 46 pid: 12340 timeout: 992 lvb_type: 1 00000100:00100000:0.0:1746126997.945505:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9818 00000100:00100000:0.0:1746126997.945510:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991446784:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126997.945516:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126997.945527:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 46 pid: 12340 timeout: 992 lvb_type: 1 00010000:00010000:0.0:1746126997.945535:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 46 pid: 12340 timeout: 992 lvb_type: 1 00000100:00080000:1.0:1746126997.945542:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746126997.945546:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c2ac00/0x34dc807b6ef8328 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52226 expref: 46 pid: 12340 timeout: 992 lvb_type: 1 00010000:00010000:0.0:1746126997.945557:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126997.945559:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126997.945565:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f0 expref: 21 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126997.945572:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f0 expref: 21 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.945734:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f0 expref: 21 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126997.945749:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994171776:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126997.945791:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126997.947298:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994171776:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126997.947674:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126997.947709:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991446784:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2197us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.947717:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9818 00000100:00100000:0.0:1746126997.947910:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.950503:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.950579:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991447168 00000100:00100000:1.0:1746126997.950586:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991447168 00000100:00100000:1.0:1746126997.950633:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21086 00000100:00100000:1.0:1746126997.950640:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4042:x1830945991447168:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126997.950653:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126997.950667:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef881b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e524f7 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.950689:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099190800/0x34dc807b6ef8336 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5222d expref: 44 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.950696:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8424 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b9 expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.950701:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6ef8352 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52257 expref: 7 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.950711:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.950713:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126997.950716:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef881b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f7 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.950740:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6ef8352 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52257 expref: 7 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.950749:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6ef8352 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52257 expref: 7 pid: 1964 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.950759:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171904:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.950843:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8424 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b9 expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.950850:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8424 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522b9 expref: 23 pid: 9611 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.950957:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994172032:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.950987:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099190800/0x34dc807b6ef8336 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5222d expref: 44 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126997.950994:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099190800/0x34dc807b6ef8336 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5222d expref: 44 pid: 9613 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746126997.951006:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994172160:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.951024:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126997.953305:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126997.953392:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994171904:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.953405:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994172032:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126997.953980:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994172160:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126997.954002:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef881b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f7 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126997.954011:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3600, rc 0) 00000100:00100000:1.0:1746126997.954040:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4042:x1830945991447168:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3400us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126997.954045:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21086 00000100:00100000:0.0:1746126997.954262:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.955369:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.962212:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126997.996003:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.007958:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.009834:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.045476:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.048017:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.056579:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991449472 00000100:00100000:1.0:1746126998.056587:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991449472 00000100:00100000:1.0:1746126998.056959:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6513 00000100:00100000:1.0:1746126998.056970:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b49dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4052:x1830945991449472:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746126998.057158:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b49dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:4052:x1830945991449472:12345-192.168.203.42@tcp:35:cat.0 Request processed in 191us (1451us total) trans 8589938083 rc 0/0 00000100:00100000:1.0:1746126998.057164:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6513 00000100:00100000:0.0:1746126998.057689:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991449984 00000100:00100000:0.0:1746126998.057694:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991449984 00000100:00100000:0.0:1746126998.057710:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6514 00000100:00100000:0.0:1746126998.057715:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4051:x1830945991449984:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746126998.057787:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4051:x1830945991449984:12345-192.168.203.42@tcp:35:cat.0 Request processed in 70us (272us total) trans 8589938084 rc 0/0 00000100:00100000:0.0:1746126998.057793:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6514 00000100:00100000:0.0:1746126998.068210:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.068767:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.068798:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.068823:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.068852:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991450240 00000100:00100000:0.0:1746126998.068861:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991450240 00000100:00100000:0.0:1746126998.068900:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991450112 00000100:00100000:0.0:1746126998.068902:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991450112 00000100:00100000:0.0:1746126998.068911:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991450496 00000100:00100000:0.0:1746126998.068913:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991450496 00000100:00100000:0.0:1746126998.068923:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991450368 00000100:00100000:0.0:1746126998.068924:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991450368 00000100:00100000:0.0:1746126998.068935:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21087 00000100:00100000:0.0:1746126998.068942:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991450240:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126998.068955:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.068969:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967fc200/0x34dc807b6ef888b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5251a expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.069010:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994172416:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126998.069069:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.069112:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21088 00000100:00100000:0.0:1746126998.069118:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991450112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126998.069124:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.069148:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967fca00/0x34dc807b6ef8892 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52513 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.069169:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994172544:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126998.069197:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.069215:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21089 00000100:00100000:0.0:1746126998.069220:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991450496:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126998.069227:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.069235:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967fc800/0x34dc807b6ef8899 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52528 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.069245:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.069247:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.069253:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fc800/0x34dc807b6ef8899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52528 expref: 27 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.069265:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967fc800/0x34dc807b6ef8899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52528 expref: 27 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.069273:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fc800, rc 0) 00000100:00100000:0.0:1746126998.069290:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2026:x1830945991450496:12345-192.168.203.42@tcp:101:cat.0 Request processed in 70us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.069295:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21089 00000100:00100000:0.0:1746126998.069307:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21090 00000100:00100000:0.0:1746126998.069311:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991450368:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126998.069316:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.069320:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967fda00/0x34dc807b6ef88a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52521 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.069327:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.069329:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.069332:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fda00/0x34dc807b6ef88a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52521 expref: 27 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.069339:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967fda00/0x34dc807b6ef88a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52521 expref: 27 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.069349:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fda00, rc 0) 00000100:00100000:0.0:1746126998.069362:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991450368:12345-192.168.203.42@tcp:101:cat.0 Request processed in 50us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.069366:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21090 00000100:00080000:0.0:1746126998.069384:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126998.092245:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.106011:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.107875:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.108645:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.108773:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.109405:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991451520 00000100:00100000:0.0:1746126998.109408:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991451520 00002000:00100000:0.0:1746126998.109426:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a79180 x1830945991451520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.109432:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79180 with x1830945991451520 ext(1048576->2097151) 00002000:00010000:0.0:1746126998.109435:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79180 00000100:00100000:0.0:1746126998.109448:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1828 00000100:00100000:0.0:1746126998.109452:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991451264:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126998.109567:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.109637:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8381 00000100:00100000:0.0:1746126998.109642:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991451136:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126998.110280:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8382 00000100:00100000:0.0:1746126998.110286:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991451520:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126998.110900:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991451648 00000100:00100000:0.0:1746126998.110905:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991451648 00000100:00100000:0.0:1746126998.110930:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21092 00000100:00100000:0.0:1746126998.110935:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4046:x1830945991451648:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126998.110945:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.110960:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52536 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.110980:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126998.110985:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6ef88a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5252f expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.110990:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126998.110993:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.111026:0:12333:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6ef88a7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5252f expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.111037:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.111046:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094476a00, rc 0) 00000100:00100000:0.0:1746126998.111072:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4046:x1830945991451648:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 136us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.111078:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21092 00000100:00100000:0.0:1746126998.126863:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991451136:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17209us (18984us total) trans 0 rc 438272/438272 00000100:00100000:0.0:1746126998.126877:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8381 00002000:00100000:0.0:1746126998.126889:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1658880->2097151) req@ffff88007ec7ad80 x1830945991451136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 438272/438272 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.126898:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7ad80 with x1830945991451136 ext(1658880->2097151) 00002000:00010000:0.0:1746126998.126904:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec7ad80 00000100:00100000:0.0:1746126998.127037:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991451520:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16750us (18263us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126998.127042:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8382 00002000:00100000:0.0:1746126998.127048:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a79180 x1830945991451520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.127054:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79180 with x1830945991451520 ext(1048576->2097151) 00002000:00010000:0.0:1746126998.127057:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79180 00000100:00100000:0.0:1746126998.128366:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991451264:12345-192.168.203.42@tcp:4:cat.0 Request processed in 18909us (19718us total) trans 17179875512 rc 0/0 00000100:00100000:0.0:1746126998.128376:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1828 00002000:00100000:0.0:1746126998.128383:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1990656->2097151) req@ffff880130a7b800 x1830945991451264/t17179875512(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/448 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.128391:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b800 with x1830945991451264 ext(1990656->2097151) 00010000:00010000:0.0:1746126998.128401:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f0 expref: 26 pid: 1964 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.128417:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2600/0x34dc807b6ef8814 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f0 expref: 26 pid: 1964 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746126998.128429:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a7b800 00000100:00100000:0.0:1746126998.132986:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.148989:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.149038:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.149082:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.150176:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991452672 00000100:00100000:1.0:1746126998.150181:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991452672 00002000:00100000:1.0:1746126998.150223:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff880123474000 x1830945991452672/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.150232:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474000 with x1830945991452672 ext(2097152->3145727) 00002000:00010000:1.0:1746126998.150236:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123474000 00000100:00100000:1.0:1746126998.150260:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8383 00000100:00100000:1.0:1746126998.150265:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991452672:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126998.162270:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991452672:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11993us (13176us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126998.162281:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8383 00002000:00100000:1.0:1746126998.162292:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff880123474000 x1830945991452672/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.162305:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474000 with x1830945991452672 ext(2097152->3145727) 00002000:00010000:1.0:1746126998.162311:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123474000 00000100:00100000:0.0:1746126998.170713:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.173282:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991453312 00000100:00100000:0.0:1746126998.173286:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991453312 00010000:00010000:0.0:1746126998.173305:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6ef88a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5252f expref: 48 pid: 12333 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746126998.173329:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9823 00000100:00100000:0.0:1746126998.173335:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991453312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.173343:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.173363:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6ef88a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5252f expref: 48 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.173373:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6ef88a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5252f expref: 48 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.173389:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6ef88a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5252f expref: 48 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.173405:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.173406:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.173412:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.173420:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.173441:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.173450:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994173184:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126998.173874:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.176813:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.177586:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.177617:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.177742:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994173184:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126998.177755:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126998.177788:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991453312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4453us (4544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.177797:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9823 00000100:00100000:1.0:1746126998.183432:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.183465:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.183500:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.183797:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21098 00000100:00100000:1.0:1746126998.183804:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991454080:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.183811:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.183819:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098672600/0x34dc807b6ef88fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52560 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.183842:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994173696:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126998.184446:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.187242:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994173696:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126998.187261:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098672600/0x34dc807b6ef88fb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52560 expref: 26 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.187271:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098672600/0x34dc807b6ef88fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52560 expref: 26 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.187294:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098672600, rc 0) 00000100:00100000:1.0:1746126998.187318:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991454080:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3515us (3817us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126998.187324:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21098 00000100:00100000:0.0:1746126998.191001:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991453568:12345-192.168.203.42@tcp:4:cat.0 Request processed in 13028us (13371us total) trans 17179875513 rc 0/0 00000100:00100000:0.0:1746126998.191013:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1830 00002000:00100000:0.0:1746126998.191024:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1658879) req@ffff880094824000 x1830945991453568/t17179875513(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/448 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.191034:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824000 with x1830945991453568 ext(1048576->1658879) 00010000:00010000:0.0:1746126998.191045:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef881b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f7 expref: 25 pid: 1964 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.191060:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3600/0x34dc807b6ef881b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524f7 expref: 25 pid: 1964 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746126998.191067:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094824000 00000100:00100000:0.0:1746126998.193410:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.193466:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.193473:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991454336 00000100:00100000:1.0:1746126998.193481:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991454336 00000100:00100000:1.0:1746126998.193533:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21099 00000100:00100000:1.0:1746126998.193540:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4054:x1830945991454336:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126998.193557:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.193573:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef8902 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5256e expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.193606:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef87ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524e2 expref: 37 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.193614:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967fc800/0x34dc807b6ef8899 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52528 expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.193624:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.193626:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.193630:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef8902 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5256e expref: 28 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.193659:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967fc800/0x34dc807b6ef8899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52528 expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.193669:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967fc800/0x34dc807b6ef8899 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52528 expref: 28 pid: 9613 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746126998.193681:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994173824:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.193768:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef87ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524e2 expref: 37 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.193776:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef87ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524e2 expref: 37 pid: 1964 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.193784:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994173952:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.193803:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.199402:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994173824:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.199415:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994173952:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.199443:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef8902 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5256e expref: 28 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.199465:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673000, rc 0) 00000100:00100000:1.0:1746126998.199489:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4054:x1830945991454336:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5950us (6088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.199497:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21099 00000100:00100000:0.0:1746126998.200877:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.204452:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.204556:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.205590:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991454976 00000100:00100000:1.0:1746126998.205595:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991454976 00002000:00100000:1.0:1746126998.206407:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123475c00 x1830945991454976/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.206418:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475c00 with x1830945991454976 ext(1048576->2097151) 00010000:00010000:1.0:1746126998.206427:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef88df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5254b expref: 47 pid: 11152 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.206445:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef88df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5254b expref: 47 pid: 11152 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746126998.206452:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880123475c00 00000100:00100000:1.0:1746126998.206473:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1831 00000100:00100000:1.0:1746126998.206479:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991454976:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126998.209872:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.209948:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991455232 00000100:00100000:1.0:1746126998.209955:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991455232 00002000:00100000:1.0:1746126998.209992:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2555904->2559999) req@ffff880123477480 x1830945991455232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.210001:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477480 with x1830945991455232 ext(2555904->2559999) 00002000:00010000:1.0:1746126998.210005:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123477480 00000100:00100000:1.0:1746126998.210276:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8386 00000100:00100000:1.0:1746126998.210283:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2026:x1830945991455232:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126998.210380:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2026:x1830945991455232:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 98us (517us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126998.210386:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8386 00002000:00100000:1.0:1746126998.210390:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2555904->2559999) req@ffff880123477480 x1830945991455232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/4536 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.210397:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477480 with x1830945991455232 ext(2555904->2559999) 00002000:00010000:1.0:1746126998.210400:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123477480 00000100:00100000:1.0:1746126998.215027:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991454976:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 8536us (10459us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126998.215039:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1831 00002000:00100000:1.0:1746126998.215052:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123475c00 x1830945991454976/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.215062:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475c00 with x1830945991454976 ext(1048576->2097151) 00010000:00010000:1.0:1746126998.215072:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef88df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5254b expref: 47 pid: 11152 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.215102:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef88df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5254b expref: 47 pid: 11152 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746126998.215110:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880123475c00 00000100:00100000:0.0:1746126998.224537:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.224575:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.224914:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.224940:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21101 00000100:00100000:0.0:1746126998.224947:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4054:x1830945991455616:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126998.224955:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.224965:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef8910 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5257c expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.224980:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6ef878f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524a3 expref: 25 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.224988:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f47c00/0x34dc807b6ef87c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524c6 expref: 47 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.224993:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.224994:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.224997:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef8910 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5257c expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.225018:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f47c00/0x34dc807b6ef87c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524c6 expref: 47 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.225027:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f47c00/0x34dc807b6ef87c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524c6 expref: 47 pid: 9613 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746126998.225035:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994174464:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126998.225063:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6ef878f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524a3 expref: 25 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.225069:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6ef878f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524a3 expref: 25 pid: 9611 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746126998.225076:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994174592:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126998.225102:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.226881:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994174464:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.226893:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994174592:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.226921:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef8910 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5257c expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.226935:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f561a00, rc 0) 00000100:00100000:1.0:1746126998.227680:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4054:x1830945991455616:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2730us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.227688:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21101 00000100:00100000:0.0:1746126998.230364:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.230396:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.230483:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994174720:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126998.231215:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126998.231266:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991455488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6240us (6349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.231276:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9827 00000100:00100000:0.0:1746126998.231878:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991456000 00000100:00100000:0.0:1746126998.231884:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991456000 00002000:00100000:0.0:1746126998.231917:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2555904->3145727) req@ffff880094b78380 x1830945991456000/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.231925:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78380 with x1830945991456000 ext(2555904->3145727) 00010000:00010000:0.0:1746126998.231933:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef8902 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5256e expref: 27 pid: 1964 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.231944:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef8902 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5256e expref: 27 pid: 1964 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746126998.231950:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78380 00000100:00100000:0.0:1746126998.231974:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1832 00000100:00100000:0.0:1746126998.231979:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991456000:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746126998.237948:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.245708:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.246786:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991456000:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 14804us (15447us total) trans 21474842773 rc 0/0 00000100:00100000:1.0:1746126998.246796:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1832 00002000:00100000:1.0:1746126998.246805:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2555904->3145727) req@ffff880094b78380 x1830945991456000/t21474842773(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/448 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.246814:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78380 with x1830945991456000 ext(2555904->3145727) 00010000:00010000:1.0:1746126998.246822:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef8902 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5256e expref: 29 pid: 1964 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.246835:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6ef8902 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5256e expref: 29 pid: 1964 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746126998.246841:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78380 00000100:00100000:0.0:1746126998.251737:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.256660:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.256764:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991457152 00000100:00100000:1.0:1746126998.256769:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991457152 00002000:00100000:1.0:1746126998.256800:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009cbb2d80 x1830945991457152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.256809:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb2d80 with x1830945991457152 ext(2097152->3145727) 00002000:00010000:1.0:1746126998.256813:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb2d80 00000100:00100000:1.0:1746126998.256840:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8389 00000100:00100000:1.0:1746126998.256846:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991457152:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126998.270662:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.271008:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991457280 00000100:00100000:1.0:1746126998.271016:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991457280 00000100:00100000:1.0:1746126998.271061:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21102 00000100:00100000:1.0:1746126998.271066:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4052:x1830945991457280:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.271079:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.271121:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef8917 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52583 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.271211:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef8910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5257c expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.271217:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.271219:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.271222:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef8917 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52583 expref: 46 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.271251:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef8910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5257c expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.271261:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f561a00/0x34dc807b6ef8910 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5257c expref: 23 pid: 16295 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.271272:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994175104:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.271351:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.272465:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994175104:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.272488:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef8917 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52583 expref: 46 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.272498:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801361ec200, rc 0) 00000100:00100000:1.0:1746126998.272534:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4052:x1830945991457280:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1467us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.272541:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21102 00000100:00100000:0.0:1746126998.273425:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.276924:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.284440:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.284479:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.284530:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991457792 00000100:00100000:1.0:1746126998.284538:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991457792 00002000:00100000:1.0:1746126998.284570:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cbb0000 x1830945991457792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.284579:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb0000 with x1830945991457792 ext(2097152->4194303) 00002000:00010000:1.0:1746126998.284584:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cbb0000 00000100:00100000:1.0:1746126998.284606:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991458048 00000100:00100000:1.0:1746126998.284608:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991458048 00002000:00100000:1.0:1746126998.284617:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009cbb0e00 x1830945991458048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.284623:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb0e00 with x1830945991458048 ext(3145728->4194303) 00002000:00010000:1.0:1746126998.284626:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb0e00 00000100:00100000:1.0:1746126998.284649:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8390 00000100:00100000:1.0:1746126998.284655:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991457792:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126998.291946:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.299639:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991457792:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14976us (15197us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746126998.299648:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8390 00002000:00100000:1.0:1746126998.299660:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cbb0000 x1830945991457792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.299668:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb0000 with x1830945991457792 ext(2097152->4194303) 00002000:00010000:1.0:1746126998.299673:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cbb0000 00000100:00100000:1.0:1746126998.300605:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.303493:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126998.304161:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304168:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:0.0:1746126998.304204:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126998.304208:0:11634:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126998.304219:0:11634:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304226:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304234:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304238:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304242:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304247:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304252:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b23200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126998.304255:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304260:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304268:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126998.304270:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126998.304273:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304277:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23200/0x34dc807b6ef8925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304298:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6ef892c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304303:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6ef892c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304307:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6ef892c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304311:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b23400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126998.304313:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6ef892c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304317:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6ef892c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304322:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662ef00) 00010000:00010000:0.0:1746126998.304324:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126998.304326:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6ef892c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304331:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6ef892c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.304357:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef891e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5258a expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.304368:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5258a expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.304373:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126998.304375:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126998.304377:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22600, rc 0) 00000100:00100000:0.0:1746126998.305623:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4058:x1830945991458176:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 12543us (13683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.305629:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17168 00000100:00100000:0.0:1746126998.311312:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.311840:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.312936:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21104 00000100:00100000:1.0:1746126998.312943:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991458816:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.312949:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.312957:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9e00/0x34dc807b6ef8941 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52598 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.312978:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994175616:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126998.313046:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.313235:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.313259:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.313276:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991459200 00000100:00100000:1.0:1746126998.313279:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991459200 00002000:00100000:1.0:1746126998.313307:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4825087) req@ffff880130a74a80 x1830945991459200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.313316:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a74a80 with x1830945991459200 ext(4194304->4825087) 00002000:00010000:1.0:1746126998.313320:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a74a80 00000100:00100000:1.0:1746126998.313330:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8392 00000100:00100000:1.0:1746126998.313334:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991459200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126998.321529:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994175616:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126998.321561:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9e00/0x34dc807b6ef8941 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52598 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.321573:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9e00/0x34dc807b6ef8941 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52598 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.322152:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c9e00, rc 0) 00000100:00100000:1.0:1746126998.322178:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2028:x1830945991458816:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 9235us (10337us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126998.322185:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21104 00000100:00100000:0.0:1746126998.327707:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991459712 00000100:00100000:0.0:1746126998.327715:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991459712 00000100:00100000:0.0:1746126998.327795:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17169 00000100:00100000:0.0:1746126998.327803:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4058:x1830945991459712:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126998.327819:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.327871:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1afa00/0x34dc807b6ef895d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525b4 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.327907:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991459968 00000100:00100000:1.0:1746126998.327910:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991459968 00000100:00100000:1.0:1746126998.327932:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17170 00000100:00100000:1.0:1746126998.327936:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4061:x1830945991459968:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.327945:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.327951:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef8964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525bb expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.328015:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328025:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328033:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328043:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328050:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328054:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328165:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8a00/0x34dc807b6ef8979 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328183:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8a00/0x34dc807b6ef8979 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328189:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8a00/0x34dc807b6ef8979 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746126998.328196:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126998.328251:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328256:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328261:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328265:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328269:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c9e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126998.328272:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328276:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328287:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126998.328289:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126998.328298:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328303:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9e00/0x34dc807b6ef896b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126998.328383:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.328391:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5258a expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.328396:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8a00/0x34dc807b6ef8979 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126998.328401:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.328410:0:11634:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8a00/0x34dc807b6ef8979 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746126998.328424:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5258a expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.328433:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef8933 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5258a expref: 10 pid: 11634 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746126998.328442:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cbb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994175744:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126998.328503:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1746126998.328943:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328949:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328953:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328956:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c8600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126998.328958:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328962:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328967:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69ae00) 00010000:00010000:1.0:1746126998.328969:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126998.328971:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.328974:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8600/0x34dc807b6ef8972 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.329019:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef8964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525bb expref: 34 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.329028:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8a00/0x34dc807b6ef8979 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525bb expref: 33 pid: 7259 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.329034:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8a00/0x34dc807b6ef8979 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525bb expref: 33 pid: 7259 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.329039:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8a00, rc 0) 00000100:00100000:1.0:1746126998.329288:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4061:x1830945991459968:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1350us (1446us total) trans 8589938088 rc 0/0 00000100:00100000:1.0:1746126998.329293:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17170 00000100:00100000:1.0:1746126998.332238:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.332238:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cbb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994175744:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126998.332256:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:0.0:1746126998.334036:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.336558:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.336591:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.336619:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.336644:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.336670:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.336729:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991460608 00000100:00100000:1.0:1746126998.336737:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991460608 00000100:00100000:1.0:1746126998.336763:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991460864 00000100:00100000:1.0:1746126998.336765:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991460864 00000100:00100000:1.0:1746126998.336773:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991460480 00000100:00100000:1.0:1746126998.336775:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991460480 00000100:00100000:1.0:1746126998.336783:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991460736 00000100:00100000:1.0:1746126998.336785:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991460736 00000100:00100000:1.0:1746126998.336796:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21108 00000100:00100000:1.0:1746126998.336802:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2026:x1830945991460608:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.336814:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126998.336886:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21110 00000100:00100000:0.0:1746126998.336892:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2026:x1830945991460480:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126998.336897:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.336902:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136bc6e00/0x34dc807b6ef899c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525c2 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.336930:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994175872:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126998.336988:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1746126998.337096:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9e00/0x34dc807b6ef898e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525c9 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.337119:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994176000:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126998.337165:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443480 going to sleep for 11 seconds 00010000:00010000:1.0:1746126998.337251:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.337257:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746126998.337271:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126998.337351:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1afa00/0x34dc807b6ef895d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525b4 expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.337364:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525b4 expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.337369:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.337370:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126998.337372:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d1ae000, rc 0) 00000100:00100000:1.0:1746126998.337390:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4058:x1830945991459712:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 9589us (9749us total) trans 8589938090 rc 0/0 00000100:00100000:1.0:1746126998.337395:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17169 00000100:00100000:1.0:1746126998.340914:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994176000:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126998.340973:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9e00/0x34dc807b6ef898e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525c9 expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.341289:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9e00/0x34dc807b6ef898e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525c9 expref: 28 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.341297:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c9e00, rc 0) 00000100:00100000:1.0:1746126998.341736:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991460608:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4933us (5181us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126998.341744:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21108 00000100:00100000:0.0:1746126998.344215:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.344292:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991461120 00000100:00100000:1.0:1746126998.344299:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991461120 00000100:00100000:1.0:1746126998.344341:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17171 00000100:00100000:1.0:1746126998.344351:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4058:x1830945991461120:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.344371:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.344447:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6ef89b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525de expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.344513:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.344523:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525b4 expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.344528:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.344550:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525b4 expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.344559:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d1ae000/0x34dc807b6ef8987 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525b4 expref: 11 pid: 11634 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.344568:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994176128:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.344999:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.347274:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.347344:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991461248 00000100:00100000:1.0:1746126998.347350:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991461248 00000100:00100000:1.0:1746126998.347434:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21112 00000100:00100000:1.0:1746126998.347440:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4061:x1830945991461248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.347453:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.347466:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6ef89bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525e5 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.347488:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.347495:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.347496:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.347499:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6ef89bf lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525e5 expref: 27 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.347519:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.347527:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094476a00/0x34dc807b6ef88ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52536 expref: 45 pid: 12333 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.347536:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994176256:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.347970:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.349694:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.349737:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994176128:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.349758:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:1.0:1746126998.349981:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994176256:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.349996:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6ef89bf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525e5 expref: 27 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.350009:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6600, rc 0) 00000100:00100000:1.0:1746126998.350052:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4061:x1830945991461248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2611us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.350059:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21112 00000100:00100000:0.0:1746126998.350850:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126998.350913:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.350920:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746126998.350956:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746126998.350959:0:11634:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746126998.350971:0:11634:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.351013:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6ef89b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525de expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.351024:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525de expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.351029:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.351032:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126998.351034:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7c00, rc 0) 00000100:00100000:1.0:1746126998.351072:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4058:x1830945991461120:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6724us (6861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.351081:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17171 00000100:00100000:0.0:1746126998.353553:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.353702:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.353899:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991461632 00000100:00100000:1.0:1746126998.353906:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991461632 00000100:00100000:1.0:1746126998.353932:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991461760 00000100:00100000:1.0:1746126998.353934:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991461760 00000100:00100000:1.0:1746126998.353946:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21113 00000100:00100000:1.0:1746126998.353953:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991461632:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.353966:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.353979:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6ef89c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525ec expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.354016:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994176384:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126998.354072:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.356228:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994176384:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126998.356250:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6ef89c6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525ec expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.356262:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6ef89c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525ec expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.356271:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7a00, rc 0) 00000100:00100000:1.0:1746126998.356289:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991461632:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2337us (2742us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126998.356295:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21113 00000100:00100000:0.0:1746126998.357994:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.361654:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.361735:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991462144 00000100:00100000:1.0:1746126998.361746:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991462144 00000100:00100000:0.0:1746126998.361747:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.361793:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17172 00000100:00100000:1.0:1746126998.361801:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4058:x1830945991462144:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.361824:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.361839:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef89d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e525fa expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.361917:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.361929:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.361937:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746126998.361946:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126998.364148:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef89d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 13 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.364164:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 12 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.364171:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.364173:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126998.364176:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6000, rc 0) 00000100:00100000:1.0:1746126998.364194:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4058:x1830945991462144:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2394us (2553us total) trans 8589938091 rc 0/0 00000100:00100000:1.0:1746126998.364200:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17172 00000100:00100000:0.0:1746126998.374769:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.374799:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.375438:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.389485:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994176896:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126998.390563:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.390594:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.390621:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.390633:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991463552 00000100:00100000:0.0:1746126998.390636:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991463552 00010000:00010000:0.0:1746126998.390653:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5600/0x34dc807b6ef8416 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522ab expref: 29 pid: 9613 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746126998.390670:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9838 00000100:00100000:0.0:1746126998.390675:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991463552:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.390683:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.390691:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5600/0x34dc807b6ef8416 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522ab expref: 29 pid: 9613 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.390700:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e5600/0x34dc807b6ef8416 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522ab expref: 29 pid: 9613 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.390717:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5600/0x34dc807b6ef8416 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522ab expref: 29 pid: 9613 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.390731:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126998.390750:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991463552:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.390756:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9838 00000100:00100000:0.0:1746126998.390833:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991463296 00000100:00100000:0.0:1746126998.390836:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991463296 00000100:00100000:0.0:1746126998.390855:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21121 00000100:00100000:0.0:1746126998.390860:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4061:x1830945991463296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126998.390873:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.390886:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52601 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.390903:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126998.390906:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.390911:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746126998.390915:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 28 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.390930:0:16295:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.390947:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 28 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.390956:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914ae00, rc 0) 00000100:00100000:0.0:1746126998.390975:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4061:x1830945991463296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 115us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.390981:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21121 00000100:00100000:1.0:1746126998.391068:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991463808 00000100:00100000:1.0:1746126998.391073:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991463808 00000100:00100000:1.0:1746126998.391110:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17173 00000100:00100000:1.0:1746126998.391115:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4064:x1830945991463808:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126998.391150:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.391161:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6ef8a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52608 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.391220:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391231:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391240:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391253:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391258:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391263:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391352:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391363:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.391368:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.391393:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.391402:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 11 pid: 11634 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.391413:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994178816:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.391466:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.397203:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9839 00000100:00100000:1.0:1746126998.397213:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991464320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126998.397224:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.397245:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6ef832f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5221f expref: 38 pid: 1507 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.397255:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6ef832f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5221f expref: 38 pid: 1507 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.397285:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.397288:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.397292:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.397301:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.397318:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.397359:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991464320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 147us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.397367:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9839 00010000:00010000:0.0:1746126998.397373:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6ef832f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5221f expref: 38 pid: 1507 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746126998.397403:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994177024:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126998.397429:0:11152:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397530:0:11152:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397538:0:11152:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397559:0:11152:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397567:0:11152:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397578:0:11152:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397584:0:11152:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b22600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126998.397587:0:11152:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397594:0:11152:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397608:0:11152:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.397614:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b22600/0x34dc807b6ef89e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.397682:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991462528:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 21278us (22915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.397690:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21115 00000100:00100000:1.0:1746126998.398009:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.398739:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.399020:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.399049:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.399063:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991465344 00000100:00100000:1.0:1746126998.399065:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991465344 00010000:00010000:1.0:1746126998.399076:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef87e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524db expref: 38 pid: 1964 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.399098:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9840 00000100:00100000:1.0:1746126998.399104:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991464704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126998.399114:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.399140:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e88fa00/0x34dc807b6ef8948 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5259f expref: 12 pid: 12340 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399150:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e88fa00/0x34dc807b6ef8948 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5259f expref: 12 pid: 12340 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399165:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e88fa00/0x34dc807b6ef8948 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5259f expref: 12 pid: 12340 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399180:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.399204:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991464704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 100us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.399209:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9840 00000100:00100000:1.0:1746126998.399221:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9842 00000100:00100000:1.0:1746126998.399226:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991465344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126998.399231:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.399236:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef87e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524db expref: 38 pid: 1964 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.399244:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef87e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524db expref: 38 pid: 1964 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.399254:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef87e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e524db expref: 38 pid: 1964 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.399261:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.399272:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991465344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 46us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.399276:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9842 00000100:00100000:1.0:1746126998.399285:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9843 00000100:00100000:1.0:1746126998.399289:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991465472:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126998.399294:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.399300:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8447 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522d5 expref: 36 pid: 16295 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.399307:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8447 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522d5 expref: 36 pid: 16295 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.399316:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8447 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e522d5 expref: 36 pid: 16295 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.399323:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.399332:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991465472:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.399336:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9843 00000100:00100000:1.0:1746126998.399357:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.399393:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.399408:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9844 00000100:00100000:1.0:1746126998.399413:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991464064:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126998.399420:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.399425:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef89a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525d0 expref: 28 pid: 12333 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399433:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef89a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525d0 expref: 28 pid: 12333 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746126998.399533:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.399567:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.399577:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991464960 00000100:00100000:0.0:1746126998.399580:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991464960 00010000:00010000:1.0:1746126998.399598:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef89a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525d0 expref: 28 pid: 12333 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.399598:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef8956 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525ad expref: 10 pid: 12333 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399607:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.399620:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991464064:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 207us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.399625:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9844 00000100:00100000:0.0:1746126998.399626:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991465216 00000100:00100000:0.0:1746126998.399628:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991465216 00010000:00010000:0.0:1746126998.399635:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fda00/0x34dc807b6ef88a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52521 expref: 27 pid: 9613 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746126998.399645:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9846 00000100:00100000:1.0:1746126998.399650:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9847 00000100:00100000:0.0:1746126998.399650:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991464960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126998.399654:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991465216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.399655:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.399662:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.399663:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef8956 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525ad expref: 10 pid: 12333 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399666:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967fda00/0x34dc807b6ef88a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52521 expref: 27 pid: 9613 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.399671:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef8956 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525ad expref: 10 pid: 12333 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399673:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967fda00/0x34dc807b6ef88a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52521 expref: 27 pid: 9613 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399681:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967fda00/0x34dc807b6ef88a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52521 expref: 27 pid: 9613 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.399681:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef8956 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525ad expref: 10 pid: 12333 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399688:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.399689:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.399690:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746126998.399692:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef8a05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.399697:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef8a05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.399701:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991464960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.399706:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9846 00010000:00010000:1.0:1746126998.399711:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.399721:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991465216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 66us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.399727:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9847 00000100:00100000:0.0:1746126998.399734:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.399746:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991463936 00000100:00100000:1.0:1746126998.399749:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991463936 00010000:00010000:1.0:1746126998.399760:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef894f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525a6 expref: 11 pid: 9611 timeout: 993 lvb_type: 1 00000100:00100000:0.0:1746126998.399760:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.399778:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9848 00000100:00100000:1.0:1746126998.399783:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991463936:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126998.399788:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.399794:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef894f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525a6 expref: 11 pid: 9611 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399801:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef894f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525a6 expref: 11 pid: 9611 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399810:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef894f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525a6 expref: 11 pid: 9611 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746126998.399817:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.399829:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991463936:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.399834:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9848 00000100:00100000:1.0:1746126998.400188:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.400201:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.400218:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.400307:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.400338:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994178816:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.400354:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:0.0:1746126998.400457:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991465728 00000100:00100000:0.0:1746126998.400460:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991465728 00010000:00010000:0.0:1746126998.400470:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 12 pid: 11634 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746126998.400481:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9850 00000100:00100000:0.0:1746126998.400485:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2028:x1830945991465600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.400490:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.400496:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef8917 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52583 expref: 48 pid: 16295 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.400503:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef8917 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52583 expref: 48 pid: 16295 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.400513:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef8917 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52583 expref: 48 pid: 16295 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.400521:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.400522:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.400525:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.400530:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.400556:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126998.400574:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2028:x1830945991465600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 88us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.400580:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9850 00000100:00100000:0.0:1746126998.400591:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9851 00000100:00100000:0.0:1746126998.400596:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991465728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.400602:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.400607:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 12 pid: 11634 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.400613:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 12 pid: 11634 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.400624:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6ef89db lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525fa expref: 12 pid: 11634 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.400633:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126998.400637:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.400647:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.400652:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746126998.400662:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126998.400675:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991465728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 79us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.400680:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9851 00010000:00010000:1.0:1746126998.400973:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.400981:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.400993:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.400999:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.401005:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.401011:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e8c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126998.401014:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.401019:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.401029:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.401035:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8c00/0x34dc807b6ef8a0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.401063:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2028:x1830945991463168:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 23448us (23713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.401068:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21120 00010000:00010000:1.0:1746126998.401096:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401101:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746126998.401115:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126998.401211:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401215:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401220:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401224:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbf7a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126998.401227:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401232:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401239:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.401242:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746126998.401244:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401248:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7a00/0x34dc807b6ef8a2f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401263:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401268:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401276:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401280:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401283:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbf6a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126998.401286:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401291:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401297:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126998.401299:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126998.401301:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401306:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6a00/0x34dc807b6ef8a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401396:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401402:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401407:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401411:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbf7000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126998.401413:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401422:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401428:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a200) 00010000:00010000:1.0:1746126998.401430:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126998.401432:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401436:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8a28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746126998.401473:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6ef8a1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52608 expref: 53 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.401479:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6ef8a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52608 expref: 53 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.401486:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6c00, rc 0) 00000100:00100000:1.0:1746126998.401509:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:4064:x1830945991463808:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10394us (10949us total) trans 8589938092 rc 301/301 00000100:00100000:1.0:1746126998.401514:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17173 00000100:00100000:0.0:1746126998.414585:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126998.415238:0:12333:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415248:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415267:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415275:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415282:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415289:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098672000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126998.415293:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415301:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098672000/0x34dc807b6ef89f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415312:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.415314:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.415321:0:12333:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415328:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.415362:0:12333:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.415380:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093641180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994178944:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126998.415474:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.420093:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.427480:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.428000:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991466368 00000100:00100000:1.0:1746126998.428012:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991466368 00000100:00100000:1.0:1746126998.428071:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17174 00000100:00100000:1.0:1746126998.428093:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4058:x1830945991466368:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:1.0:1746126998.428194:0:11634:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.428229:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6ef89b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e525de expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.428285:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.428291:0:11634:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.428368:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4058:x1830945991466368:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 285us (898us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746126998.428374:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17174 00000100:00100000:0.0:1746126998.433854:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.439982:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991467008 00000100:00100000:0.0:1746126998.439991:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991467008 00000100:00100000:0.0:1746126998.440039:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6519 00000100:00100000:0.0:1746126998.440048:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b49dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4058:x1830945991467008:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1746126998.440621:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b49dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4058:x1830945991467008:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 573us (722us total) trans 8589938094 rc 0/0 00000100:00100000:0.0:1746126998.440628:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6519 00000100:00100000:0.0:1746126998.444549:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.462184:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.462669:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.462732:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.462770:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.475604:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.475660:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.478448:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.478518:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991468544 00000100:00100000:1.0:1746126998.478525:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991468544 00000100:00100000:1.0:1746126998.478572:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17175 00000100:00100000:1.0:1746126998.478580:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4067:x1830945991468544:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126998.478606:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.478625:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef8a60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52632 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.478730:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8a67 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.478745:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8a67 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126998.478756:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8a67 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746126998.478767:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126998.478867:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef8a60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52632 expref: 36 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.478899:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef8a67 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52632 expref: 35 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.478907:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.478909:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126998.478913:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7200, rc 0) 00000100:00100000:1.0:1746126998.478940:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+35:4067:x1830945991468544:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 360us (500us total) trans 8589938095 rc 0/0 00000100:00100000:1.0:1746126998.478946:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17175 00000100:00100000:0.0:1746126998.497403:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.497496:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991468672 00000100:00100000:1.0:1746126998.497527:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991468672 00000100:00100000:1.0:1746126998.497580:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21127 00000100:00100000:1.0:1746126998.497588:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4067:x1830945991468672:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126998.497602:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.497637:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098673000/0x34dc807b6ef8a75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52639 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.497674:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef8a59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5262b expref: 29 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.497681:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.497683:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.497686:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098673000/0x34dc807b6ef8a75 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3313664->3379199] (req 3313664->3379199) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52639 expref: 29 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.497711:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef8a59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5262b expref: 29 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.497721:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef8a59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5262b expref: 29 pid: 9613 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746126998.497732:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994179072:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.497815:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.502749:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994179072:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.502776:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098673000/0x34dc807b6ef8a75 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3313664->3379199] (req 3313664->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52639 expref: 29 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.502793:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673000, rc 0) 00000100:00100000:1.0:1746126998.502855:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4067:x1830945991468672:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5267us (5458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.502863:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21127 00000100:00100000:0.0:1746126998.504089:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.504729:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.511285:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.515683:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.516193:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.516211:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991469696 00000100:00100000:1.0:1746126998.516216:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991469696 00000100:00100000:1.0:1746126998.516244:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21128 00000100:00100000:1.0:1746126998.516250:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4064:x1830945991469696:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126998.516260:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.516276:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52640 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.516299:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098673000/0x34dc807b6ef8a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52639 expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.516311:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.516313:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.516316:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3198976->4038655] (req 3198976->4038655) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 48 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.516344:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098673000/0x34dc807b6ef8a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->3379199) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52639 expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.516356:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098673000/0x34dc807b6ef8a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->3379199) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52639 expref: 27 pid: 11152 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.516368:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994179328:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.516437:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904439c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.520012:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.520040:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994179328:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.520076:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3198976->4038655] (req 3198976->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 48 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.520104:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673800, rc 0) 00000100:00100000:1.0:1746126998.520172:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4064:x1830945991469696:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3921us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.520180:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21128 00000100:00100000:0.0:1746126998.526034:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.529192:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.536482:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.538820:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.538850:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.539715:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991470848 00000100:00100000:0.0:1746126998.539719:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.539725:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991470848 00000100:00100000:0.0:1746126998.540268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.540477:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991471104 00000100:00100000:0.0:1746126998.540480:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991471104 00000100:00100000:1.0:1746126998.540842:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1148 00000100:00100000:1.0:1746126998.540852:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2026:x1830945991470848:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1746126998.540927:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2026:x1830945991470848:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 77us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.541122:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1148 00000100:00100000:0.0:1746126998.541149:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1149 00000100:00100000:0.0:1746126998.541156:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2026:x1830945991471104:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1746126998.541196:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2026:x1830945991471104:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 41us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.541201:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1149 00000100:00100000:0.0:1746126998.543265:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.543402:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991471360 00000100:00100000:1.0:1746126998.543412:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991471360 00000100:00100000:1.0:1746126998.543474:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6520 00000100:00100000:1.0:1746126998.543482:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:4064:x1830945991471360:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746126998.543749:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:4064:x1830945991471360:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 267us (487us total) trans 8589938096 rc 0/0 00000100:00100000:1.0:1746126998.543756:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6520 00000100:00100000:0.0:1746126998.546484:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.549269:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.549291:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991472000 00000100:00100000:1.0:1746126998.549297:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991472000 00000100:00100000:1.0:1746126998.549334:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6521 00000100:00100000:1.0:1746126998.549341:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:4072:x1830945991472000:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746126998.549496:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:4072:x1830945991472000:12345-192.168.203.42@tcp:35:cat.0 Request processed in 155us (232us total) trans 8589938098 rc 0/0 00000100:00100000:1.0:1746126998.549502:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6521 00000100:00100000:0.0:1746126998.549527:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.551471:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.551508:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.551676:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991472128 00000100:00100000:1.0:1746126998.551682:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991472128 00000100:00100000:1.0:1746126998.551714:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991472256 00000100:00100000:1.0:1746126998.551716:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991472256 00000100:00100000:1.0:1746126998.551736:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21129 00000100:00100000:1.0:1746126998.551742:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991472128:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.551757:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.551774:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f120a00/0x34dc807b6ef8aa6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5264e expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.551793:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.551795:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.551803:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f120a00/0x34dc807b6ef8aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5264e expref: 35 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.551817:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f120a00/0x34dc807b6ef8aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5264e expref: 35 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.551826:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f120a00, rc 0) 00000100:00100000:1.0:1746126998.551855:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2029:x1830945991472128:12345-192.168.203.42@tcp:101:cat.0 Request processed in 113us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.551860:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21129 00000100:00100000:1.0:1746126998.554934:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.555033:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.555044:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991472640 00000100:00100000:0.0:1746126998.555048:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991472640 00000100:00100000:0.0:1746126998.555068:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21133 00000100:00100000:0.0:1746126998.555073:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991472640:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126998.555094:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.555101:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6000/0x34dc807b6ef8abb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5266a expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.555116:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.555118:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.555122:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6000/0x34dc807b6ef8abb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5266a expref: 37 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.555151:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6000/0x34dc807b6ef8abb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5266a expref: 37 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126998.555157:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e8e6000, rc 0) 00000100:00100000:0.0:1746126998.555174:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991472640:12345-192.168.203.42@tcp:101:cat.0 Request processed in 101us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.555179:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21133 00000100:00100000:0.0:1746126998.564536:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.564575:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.564601:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.564642:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.564670:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991472896 00000100:00100000:0.0:1746126998.564679:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991472896 00000100:00100000:1.0:1746126998.564695:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991473408 00000100:00100000:1.0:1746126998.564700:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991473408 00002000:00100000:1.0:1746126998.564728:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fd9500 x1830945991473408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.564728:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012d288e00 x1830945991472896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.564739:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9500 with x1830945991473408 ext(1048576->2097151) 00002000:00100000:0.0:1746126998.564739:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288e00 with x1830945991472896 ext(0->1048575) 00002000:00010000:1.0:1746126998.564744:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fd9500 00002000:00010000:0.0:1746126998.564744:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d288e00 00000100:00100000:1.0:1746126998.564759:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991473664 00000100:00100000:1.0:1746126998.564761:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991473664 00002000:00100000:1.0:1746126998.564768:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fdb480 x1830945991473664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.564775:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb480 with x1830945991473664 ext(1048576->2097151) 00002000:00010000:1.0:1746126998.564777:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fdb480 00000100:00100000:0.0:1746126998.565048:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991473152 00000100:00100000:0.0:1746126998.565052:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991473152 00000100:00100000:1.0:1746126998.565056:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8403 00000100:00100000:1.0:1746126998.565062:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2029:x1830945991473408:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:0.0:1746126998.565065:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a2fd9f80 x1830945991473152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.565091:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9f80 with x1830945991473152 ext(1048576->2097151) 00002000:00010000:0.0:1746126998.565095:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fd9f80 00000100:00100000:0.0:1746126998.565108:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8404 00000100:00100000:0.0:1746126998.565114:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991472896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126998.580175:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2029:x1830945991473408:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15111us (15597us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126998.580181:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8403 00002000:00100000:1.0:1746126998.580187:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fd9500 x1830945991473408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.580194:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9500 with x1830945991473408 ext(1048576->2097151) 00002000:00010000:1.0:1746126998.580198:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fd9500 00000100:00100000:0.0:1746126998.594261:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.594309:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.594454:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991473920 00000100:00100000:1.0:1746126998.594465:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991473920 00002000:00100000:1.0:1746126998.594512:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880130a78a80 x1830945991473920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.594522:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78a80 with x1830945991473920 ext(2097152->4194303) 00002000:00010000:1.0:1746126998.594528:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a78a80 00000100:00100000:1.0:1746126998.594553:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991474176 00000100:00100000:1.0:1746126998.594555:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991474176 00002000:00100000:1.0:1746126998.594566:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880130a7b480 x1830945991474176/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 504/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.594572:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b480 with x1830945991474176 ext(2097152->4194303) 00002000:00010000:1.0:1746126998.594575:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7b480 00000100:00100000:1.0:1746126998.594586:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8407 00000100:00100000:1.0:1746126998.594592:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991473920:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126998.614807:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.641977:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.644598:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.644922:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.644952:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9856 00000100:00100000:0.0:1746126998.644960:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991474688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.644975:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.644995:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094504e00/0x34dc807b6ef8a44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52616 expref: 29 pid: 3542 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.645005:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094504e00/0x34dc807b6ef8a44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52616 expref: 29 pid: 3542 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.645117:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094504e00/0x34dc807b6ef8a44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52616 expref: 29 pid: 3542 timeout: 993 lvb_type: 1 00010000:00010000:0.0:1746126998.645161:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.645163:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.645170:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.645183:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.645269:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.645280:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994179840:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126998.645359:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.647097:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.649054:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.653331:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.654995:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.659914:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.733936:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.751061:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.751172:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.767266:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991476352:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14155us (16127us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746126998.767279:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8413 00002000:00100000:1.0:1746126998.767290:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1208320->2097151) req@ffff8800a5b98000 x1830945991476352/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.767299:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98000 with x1830945991476352 ext(1208320->2097151) 00002000:00010000:1.0:1746126998.767305:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b98000 00000100:00100000:0.0:1746126998.772670:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.776789:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.787240:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.791412:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.792272:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991476992 00000100:00100000:1.0:1746126998.792280:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991476992 00002000:00100000:1.0:1746126998.792322:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3198976->4038655) req@ffff880094e6c000 x1830945991476992/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.792331:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6c000 with x1830945991476992 ext(3198976->4038655) 00010000:00010000:1.0:1746126998.792339:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 49 pid: 11152 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.792352:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 49 pid: 11152 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746126998.792359:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094e6c000 00000100:00100000:0.0:1746126998.810262:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.810366:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991477120 00000100:00100000:1.0:1746126998.810374:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991477120 00010000:00010000:1.0:1746126998.810412:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 51 pid: 11152 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.810452:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9860 00000100:00100000:1.0:1746126998.810459:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2026:x1830945991477120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126998.810475:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126998.810493:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 51 pid: 11152 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.810505:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4038655) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 51 pid: 11152 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.810527:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6ef8a7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4038655) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52640 expref: 51 pid: 11152 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.810557:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.810559:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.810566:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfdc00/0x34dc807b6ef8b01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5268d expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.810574:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfdc00/0x34dc807b6ef8b01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5268d expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.810605:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfdc00/0x34dc807b6ef8b01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5268d expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.810616:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994180608:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126998.810696:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.812475:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994180608:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126998.812496:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.812543:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991477120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2084us (2291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.812555:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9860 00000100:00100000:0.0:1746126998.818936:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.846952:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.849663:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.852314:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.852383:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991478016 00000100:00100000:1.0:1746126998.852389:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991478016 00000100:00100000:1.0:1746126998.852543:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6522 00000100:00100000:1.0:1746126998.852550:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+58:4086:x1830945991478016:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746126998.852794:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.852969:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+59:4086:x1830945991478016:12345-192.168.203.42@tcp:35:cat.0 Request processed in 419us (656us total) trans 8589938101 rc 0/0 00000100:00100000:1.0:1746126998.852974:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6522 00000100:00100000:0.0:1746126998.854060:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.854837:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.855807:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.855832:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.855850:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.855867:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.856160:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21140 00000100:00100000:1.0:1746126998.856171:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991478784:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.856177:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.856184:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11a00/0x34dc807b6ef8b39 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526b0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.856217:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994181120:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126998.856255:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746126998.858759:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746126996 -> 1746126997 00002000:00010000:1.0:1746126998.858763:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746126995 -> 1746126997 00002000:00010000:1.0:1746126998.858765:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746126996 -> 1746126997 00000100:00100000:1.0:1746126998.858781:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994181120:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126998.858804:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11a00/0x34dc807b6ef8b39 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526b0 expref: 39 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.858815:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11a00/0x34dc807b6ef8b39 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526b0 expref: 39 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.858825:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11a00, rc 0) 00000100:00100000:1.0:1746126998.858849:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991478784:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2682us (3015us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126998.858855:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21140 00000100:00100000:0.0:1746126998.860043:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.862521:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.862571:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.865581:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.865942:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991479552 00000100:00100000:1.0:1746126998.865949:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991479552 00002000:00100000:1.0:1746126998.865987:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (1028096->1048575) req@ffff88009942d180 x1830945991479552/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.865996:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d180 with x1830945991479552 ext(1028096->1048575) 00010000:00010000:1.0:1746126998.866003:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 27 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746126998.866014:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 27 pid: 9612 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746126998.866019:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942d180 00000100:00100000:1.0:1746126998.866050:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1838 00000100:00100000:1.0:1746126998.866057:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2026:x1830945991479552:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126998.866172:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.866196:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991479808 00000100:00100000:1.0:1746126998.866199:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991479808 00000100:00100000:1.0:1746126998.866220:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6523 00000100:00100000:1.0:1746126998.866225:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+35:30905:x1830945991479808:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126998.866386:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+36:30905:x1830945991479808:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 159us (213us total) trans 8589938102 rc 0/0 00000100:00100000:1.0:1746126998.866395:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6523 00000100:00100000:0.0:1746126998.867251:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.868050:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991479552:12345-192.168.203.42@tcp:4:cat.0 Request processed in 1991us (2468us total) trans 21474842774 rc 0/0 00000100:00100000:0.0:1746126998.868057:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1838 00002000:00100000:0.0:1746126998.868064:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (1028096->1048575) req@ffff88009942d180 x1830945991479552/t21474842774(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/448 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.868073:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d180 with x1830945991479552 ext(1028096->1048575) 00010000:00010000:0.0:1746126998.868092:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 29 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.868103:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 29 pid: 9612 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746126998.868108:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942d180 00000100:00100000:1.0:1746126998.868197:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126998.870623:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8b47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526b7 expref: 52 pid: 1507 timeout: 993 lvb_type: 1 00000100:00100000:3.0:1746126998.870657:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9864 00000100:00100000:3.0:1746126998.870663:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2027:x1830945991480192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126998.870672:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126998.870689:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8b47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526b7 expref: 52 pid: 1507 timeout: 993 lvb_type: 1 00010000:00010000:3.0:1746126998.870697:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8b47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526b7 expref: 52 pid: 1507 timeout: 993 lvb_type: 1 00010000:00010000:3.0:1746126998.870713:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8b47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526b7 expref: 52 pid: 1507 timeout: 993 lvb_type: 1 00010000:00010000:3.0:1746126998.870722:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126998.870752:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2027:x1830945991480192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.870758:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9864 00000100:00100000:0.0:1746126998.872255:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.872281:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.872299:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.872313:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.872325:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991481216 00000100:00100000:0.0:1746126998.872329:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991481216 00010000:00010000:0.0:1746126998.872346:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 29 pid: 9612 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.872424:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991480448 00000100:00100000:3.0:1746126998.872427:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991480448 00000100:00100000:3.0:1746126998.872445:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991480704 00000100:00100000:3.0:1746126998.872446:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991480704 00000100:00100000:0.0:1746126998.872453:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9865 00000100:00100000:3.0:1746126998.872455:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991480960 00000100:00100000:3.0:1746126998.872456:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991480960 00000100:00100000:3.0:1746126998.872466:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21145 00000100:00100000:0.0:1746126998.872469:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991481216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746126998.872471:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991480448:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126998.872483:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126998.872484:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126998.872496:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094505a00/0x34dc807b6ef8b78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526d3 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.872504:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 29 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.872518:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 29 pid: 9612 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.872535:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994182016:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126998.872537:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.872539:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.872545:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 36 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.872552:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 36 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.872577:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 36 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126998.872584:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.872590:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994182144:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126998.872602:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21146 00000100:00100000:3.0:1746126998.872607:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2027:x1830945991480704:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126998.872613:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126998.872620:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526e1 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.872631:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126998.872633:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126998.872639:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 8 pid: 1964 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126998.872643:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00010000:00010000:3.0:1746126998.872650:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 8 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126998.872656:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47c00, rc 0) 00000100:00100000:3.0:1746126998.872676:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991480704:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 69us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.872681:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21146 00000100:00100000:3.0:1746126998.872692:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21147 00000100:00100000:0.0:1746126998.872693:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.872696:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991480960:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126998.872700:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126998.872706:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094505c00/0x34dc807b6ef8b86 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526ef expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.872726:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991480320 00000100:00100000:3.0:1746126998.872729:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994182272:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126998.872731:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991480320 00000100:00100000:3.0:1746126998.872751:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.872839:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.872851:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991480576 00000100:00100000:1.0:1746126998.872854:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991480576 00000100:00100000:1.0:1746126998.872870:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21148 00000100:00100000:1.0:1746126998.872874:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991480576:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.872880:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.872886:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664c400/0x34dc807b6ef8b8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526da expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.872909:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994182400:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126998.872929:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.872948:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126998.872950:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfdc00/0x34dc807b6ef8b01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5268d expref: 30 pid: 9612 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.872957:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991480832 00000100:00100000:1.0:1746126998.872959:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991480832 00000100:00100000:1.0:1746126998.872974:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21149 00000100:00100000:0.0:1746126998.872974:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9866 00000100:00100000:1.0:1746126998.872978:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991480832:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.872983:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.872988:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6ef8b94 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526e8 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.872997:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.872998:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.873003:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6ef8b94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e8 expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.873017:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6ef8b94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e8 expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.873023:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664cc00, rc 0) 00000100:00100000:1.0:1746126998.873037:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991480832:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 58us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.873042:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21149 00000100:00100000:1.0:1746126998.873076:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.873100:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991481088 00000100:00100000:1.0:1746126998.873102:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991481088 00000100:00100000:1.0:1746126998.873114:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21150 00000100:00100000:1.0:1746126998.873118:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991481088:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.873123:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.873155:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096658800/0x34dc807b6ef8b9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526f6 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.873166:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126998.873172:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096658800/0x34dc807b6ef8b9b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526f6 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.873183:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096658800/0x34dc807b6ef8b9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526f6 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.873193:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096658800, rc 0) 00000100:00100000:1.0:1746126998.873205:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991481088:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 87us (129us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126998.873214:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21150 00000100:00100000:0.0:1746126998.873226:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991480320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.873234:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.873245:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfdc00/0x34dc807b6ef8b01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5268d expref: 30 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.873254:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbfdc00/0x34dc807b6ef8b01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5268d expref: 30 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.873266:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfdc00/0x34dc807b6ef8b01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5268d expref: 30 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.873461:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.873463:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.873468:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 50 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.873478:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 50 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.873495:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 50 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.873501:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994182528:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126998.874770:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.881443:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994182528:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126998.881461:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126998.881494:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991480320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8270us (8801us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.881504:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9866 00000100:00100000:0.0:1746126998.881547:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.881754:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994182400:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126998.881776:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664c400/0x34dc807b6ef8b8d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526da expref: 9 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126998.881831:0:12333:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff88012238d500 x1830945994182016) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 29 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.881846:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd000/0x34dc807b6ef8ac9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1028096->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52671 expref: 29 pid: 9612 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.881854:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994182016:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126998.881873:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094505a00/0x34dc807b6ef8b78 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526d3 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126998.881881:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094505a00/0x34dc807b6ef8b78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526d3 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126998.881887:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505a00, rc 0) 00000100:00100000:3.0:1746126998.881904:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991480448:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 9433us (9651us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126998.881908:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21145 00000100:00100000:3.0:1746126998.881941:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994182144:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126998.881949:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126998.881963:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991481216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 9501us (9649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.881971:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9865 00000100:00100000:3.0:1746126998.881998:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991481472 00000100:00100000:3.0:1746126998.882002:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991481472 00002000:00100000:3.0:1746126998.882028:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88008c5bd500 x1830945991481472/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126998.882035:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bd500 with x1830945991481472 ext(0->1048575) 00002000:00010000:3.0:1746126998.882039:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bd500 00000100:00100000:3.0:1746126998.882064:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8416 00000100:00100000:3.0:1746126998.882070:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991481472:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126998.882865:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126998.882932:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664c400/0x34dc807b6ef8b8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526da expref: 9 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.882943:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c400, rc 0) 00000100:00100000:1.0:1746126998.882962:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991480576:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 10087us (10123us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126998.882973:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21148 00000100:00100000:0.0:1746126998.883366:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991481984 00000100:00100000:0.0:1746126998.883369:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991481984 00000100:00100000:1.0:1746126998.883532:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17180 00000100:00100000:1.0:1746126998.883538:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+35:4089:x1830945991481984:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126998.883551:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.883561:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096658000/0x34dc807b6ef8ba2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e526fd expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.883635:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.883646:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8b6a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526c5 expref: 12 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.883652:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.883677:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8b6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526c5 expref: 12 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.883686:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8b6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526c5 expref: 12 pid: 7260 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.883695:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994182656:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.883742:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090443840 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.889533:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.889554:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994182656:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126998.889566:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126998.889574:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746126998.889586:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991482240 00000100:00100000:0.0:1746126998.889591:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991482240 00000100:00100000:0.0:1746126998.889638:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17181 00000100:00100000:0.0:1746126998.889645:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4087:x1830945991482240:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126998.889660:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.889672:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef8bb0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52704 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.889713:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef8bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52704 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.889723:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef8bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52704 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126998.889732:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991482112 00000100:00100000:3.0:1746126998.889736:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991482112 00010000:00010000:0.0:1746126998.889737:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126998.889740:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126998.889742:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10c00, rc 0) 00010000:00010000:3.0:1746126998.889751:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8b6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526c5 expref: 15 pid: 7260 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.889769:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9867 00000100:00100000:3.0:1746126998.889773:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991482112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126998.889773:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4087:x1830945991482240:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 129us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.889778:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17181 00010000:00010000:3.0:1746126998.889780:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126998.889784:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8b6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526c5 expref: 15 pid: 7260 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.889792:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8b6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526c5 expref: 14 pid: 7260 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.889805:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8b6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526c5 expref: 14 pid: 7260 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.889819:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126998.889822:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126998.889829:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126998.889834:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126998.889844:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126998.889860:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991482112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 87us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.889866:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9867 00010000:00010000:1.0:1746126998.889887:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.889893:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126998.889907:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126998.889990:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096658000/0x34dc807b6ef8ba2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 38 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.891228:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 37 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.891237:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.891239:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746126998.891241:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d200, rc 0) 00000100:00100000:1.0:1746126998.891265:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+37:4089:x1830945991481984:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7726us (8400us total) trans 8589938103 rc 0/0 00000100:00100000:1.0:1746126998.891271:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17180 00000100:00100000:0.0:1746126998.891871:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.892072:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991482496 00000100:00100000:1.0:1746126998.892077:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991482496 00000100:00100000:1.0:1746126998.892124:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6524 00000100:00100000:1.0:1746126998.892147:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+58:4082:x1830945991482496:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746126998.892256:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+59:4082:x1830945991482496:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 126us (385us total) trans 8589938104 rc 0/0 00000100:00100000:1.0:1746126998.892261:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6524 00000100:00100000:0.0:1746126998.894560:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.894657:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991482752 00000100:00100000:1.0:1746126998.894665:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991482752 00000100:00100000:1.0:1746126998.894973:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17182 00000100:00100000:1.0:1746126998.894980:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4087:x1830945991482752:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.894999:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.895018:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef8bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5270b expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.895098:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895110:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895121:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895168:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895174:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895180:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895663:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01a00/0x34dc807b6ef8bd3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895673:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01a00/0x34dc807b6ef8bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895679:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01a00/0x34dc807b6ef8bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746126998.895687:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126998.895758:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895765:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895769:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895775:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895780:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096658800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126998.895783:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895789:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895798:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126998.895801:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126998.895805:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895810:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096658800/0x34dc807b6ef8bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895821:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895825:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895830:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895833:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c9d5600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126998.895835:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895840:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895844:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69ac00) 00010000:00010000:1.0:1746126998.895846:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126998.895848:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895852:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c9d5600/0x34dc807b6ef8bcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.895885:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef8bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5270b expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.895895:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01a00/0x34dc807b6ef8bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5270b expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.895902:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126998.895904:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746126998.895906:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01a00, rc 0) 00000100:00100000:1.0:1746126998.895964:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4087:x1830945991482752:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 984us (1412us total) trans 8589938105 rc 0/0 00000100:00100000:1.0:1746126998.895970:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17182 00000100:00100000:0.0:1746126998.899276:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.899670:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.899711:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.899747:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.899783:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.899818:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991483136 00000100:00100000:0.0:1746126998.899823:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991483136 00000100:00100000:0.0:1746126998.899980:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991483264 00000100:00100000:0.0:1746126998.899984:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991483264 00000100:00100000:0.0:1746126998.899999:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991483392 00000100:00100000:0.0:1746126998.900001:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991483392 00000100:00100000:0.0:1746126998.900022:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21151 00000100:00100000:0.0:1746126998.900029:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991482880:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126998.900050:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.900070:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52712 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.900108:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.900111:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.900120:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126998.900149:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21152 00000100:00100000:3.0:1746126998.900159:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991483136:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126998.900160:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126998.900166:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.900171:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb000, rc 0) 00010000:00010000:3.0:1746126998.900174:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be47a00/0x34dc807b6ef8be8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52720 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126998.900215:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994182784:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126998.900219:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991482880:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 189us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126998.900225:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21151 00000100:00100000:3.0:1746126998.900264:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.900607:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21153 00000100:00100000:0.0:1746126998.900617:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991483008:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126998.900627:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126998.900639:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995ea400/0x34dc807b6ef8bef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52719 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.900667:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994182912:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126998.900728:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21154 00000100:00100000:1.0:1746126998.900737:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991483264:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:3.0:1746126998.900738:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21155 00010000:00010000:1.0:1746126998.900745:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126998.900748:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4086:x1830945991483392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.900753:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef8bf6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52727 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.900755:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126998.900762:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5272e expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.900779:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd200/0x34dc807b6ef8ad0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52678 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.900780:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994183040:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126998.900786:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126998.900787:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126998.900791:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 52 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.900807:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd200/0x34dc807b6ef8ad0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52678 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126998.900807:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00010000:00010000:3.0:1746126998.900819:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd200/0x34dc807b6ef8ad0 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52678 expref: 28 pid: 9612 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.900827:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994183168:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126998.900847:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.900971:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126998.902443:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994183168:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.902456:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994183040:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126998.902456:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994182912:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126998.902465:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 52 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.902474:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995ea400/0x34dc807b6ef8bef lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52719 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.902476:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef8bf6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52727 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126998.902477:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47800, rc 0) 00010000:00010000:1.0:1746126998.902485:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef8bf6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52727 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126998.902499:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00200, rc 0) 00000100:00100000:3.0:1746126998.902513:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:4086:x1830945991483392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1766us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.902519:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21155 00000100:00100000:1.0:1746126998.902519:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991483264:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1784us (2772us total) trans 0 rc 301/301 00010000:00010000:0.0:1746126998.902524:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995ea400/0x34dc807b6ef8bef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52719 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126998.902530:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21154 00010000:00010000:0.0:1746126998.902535:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ea400, rc 0) 00000100:00100000:0.0:1746126998.902553:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991483008:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1938us (2842us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126998.902559:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21153 00000100:00100000:3.0:1746126998.902756:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.904814:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.904946:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991483776 00000100:00100000:1.0:1746126998.904952:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991483776 00000100:00100000:1.0:1746126998.904995:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17183 00000100:00100000:1.0:1746126998.905000:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4087:x1830945991483776:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126998.905075:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.905102:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01c00/0x34dc807b6ef8c04 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52735 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.905203:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.905219:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 36 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.905225:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126998.905252:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 36 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.905261:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 36 pid: 7260 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.905271:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994183296:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.905342:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.905806:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.905853:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991483904 00000100:00100000:3.0:1746126998.905857:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991483904 00000100:00100000:3.0:1746126998.905882:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21156 00000100:00100000:3.0:1746126998.905887:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4089:x1830945991483904:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746126998.905895:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126998.905905:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5273c expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.905924:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.905931:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126998.905932:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126998.905935:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.905950:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.905955:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 36 pid: 1507 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.905961:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994183424:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126998.905991:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126998.906872:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994183424:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.906888:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994183296:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126998.906892:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.906901:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126998.906908:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47e00, rc 0) 00000100:00100000:3.0:1746126998.906944:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4089:x1830945991483904:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1056us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.906949:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21156 00000100:00100000:0.0:1746126998.907252:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.907283:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.907329:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991484288 00000100:00100000:3.0:1746126998.907333:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991484288 00010000:00010000:3.0:1746126998.907351:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 37 pid: 7260 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.907370:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991484032 00000100:00100000:3.0:1746126998.907372:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991484032 00010000:00010000:3.0:1746126998.907380:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd200/0x34dc807b6ef8ad0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52678 expref: 31 pid: 9612 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.907394:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9868 00000100:00100000:3.0:1746126998.907399:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+37:2026:x1830945991484288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126998.907408:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126998.907413:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 37 pid: 7260 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.907421:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 37 pid: 7260 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.907439:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6ef8ba9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526fd expref: 37 pid: 7260 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746126998.907450:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126998.907470:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126998.907477:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126998.907489:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126998.907495:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126998.907511:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126998.907534:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:3.0:1746126998.907537:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2026:x1830945991484288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 137us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.907543:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9868 00010000:00010000:0.0:1746126998.907543:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:3.0:1746126998.907553:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9869 00000100:00100000:3.0:1746126998.907557:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991484032:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126998.907564:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126998.907583:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd200/0x34dc807b6ef8ad0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52678 expref: 31 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.907591:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd200/0x34dc807b6ef8ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52678 expref: 31 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.907606:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd200/0x34dc807b6ef8ad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52678 expref: 31 pid: 9612 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.907615:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126998.907617:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126998.907623:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 51 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.907630:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 51 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.907648:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 51 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126998.907658:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994183552:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126998.907695:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746126998.907718:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126998.907725:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126998.907730:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126998.907735:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd01200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126998.907738:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126998.907744:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126998.907757:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126998.907759:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126998.907762:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126998.907766:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01200/0x34dc807b6ef8c0b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126998.907802:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01c00/0x34dc807b6ef8c04 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52735 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.907809:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd01c00/0x34dc807b6ef8c04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52735 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.907816:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01c00, rc 0) 00000100:00100000:0.0:1746126998.907923:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4087:x1830945991483776:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2920us (3113us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126998.907930:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17183 00000100:00100000:3.0:1746126998.909345:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994183552:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126998.909361:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126998.909404:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991484032:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1844us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.909413:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9869 00000100:00100000:1.0:1746126998.910198:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991484544 00000100:00100000:1.0:1746126998.910204:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991484544 00000100:00100000:1.0:1746126998.910245:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6525 00000100:00100000:1.0:1746126998.910256:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b49dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4087:x1830945991484544:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1746126998.910472:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b49dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:4087:x1830945991484544:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 219us (916us total) trans 8589938106 rc 0/0 00000100:00100000:1.0:1746126998.910478:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6525 00000100:00100000:0.0:1746126998.911234:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991484160:12345-192.168.203.42@tcp:4:cat.0 Request processed in 3568us (3784us total) trans 21474842775 rc 0/0 00000100:00100000:0.0:1746126998.911245:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1840 00002000:00100000:0.0:1746126998.911255:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3940352->4194303) req@ffff88009c4ced80 x1830945991484160/t21474842775(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/448 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.911263:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ced80 with x1830945991484160 ext(3940352->4194303) 00010000:00010000:0.0:1746126998.911271:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 39 pid: 1507 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.911341:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 39 pid: 1507 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746126998.911348:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4ced80 00000100:00100000:0.0:1746126998.913223:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.916748:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.916813:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991484928 00000100:00100000:3.0:1746126998.916822:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991484928 00010000:00010000:3.0:1746126998.916854:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 39 pid: 1507 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.916970:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9870 00000100:00100000:3.0:1746126998.916976:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991484928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126998.916986:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126998.917002:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 39 pid: 1507 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.917015:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 39 pid: 1507 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.917033:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094505000/0x34dc807b6ef8b08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52694 expref: 39 pid: 1507 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.917046:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126998.917047:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126998.917053:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.917059:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.917106:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126998.917118:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994183680:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126998.917217:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126998.918050:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994183680:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126998.918064:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126998.918111:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991484928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1134us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.918119:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9870 00000100:00100000:0.0:1746126998.918769:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.918830:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991485184 00000100:00100000:1.0:1746126998.918836:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991485184 00002000:00100000:1.0:1746126998.918868:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3039232->3043327) req@ffff88009c4cd180 x1830945991485184/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.918877:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd180 with x1830945991485184 ext(3039232->3043327) 00002000:00010000:1.0:1746126998.918882:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cd180 00000100:00100000:1.0:1746126998.918912:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8419 00000100:00100000:1.0:1746126998.918918:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991485184:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126998.919031:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991485184:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 113us (263us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126998.919036:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8419 00002000:00100000:1.0:1746126998.919040:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3039232->3043327) req@ffff88009c4cd180 x1830945991485184/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/4536 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.919051:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd180 with x1830945991485184 ext(3039232->3043327) 00002000:00010000:1.0:1746126998.919054:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cd180 00000100:00100000:3.0:1746126998.919669:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2027:x1830945991484800:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6279us (6451us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126998.919678:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8418 00002000:00100000:3.0:1746126998.919683:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c4cca80 x1830945991484800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126998.919691:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cca80 with x1830945991484800 ext(1048576->2097151) 00002000:00010000:3.0:1746126998.919695:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cca80 00000100:00100000:0.0:1746126998.923573:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.923940:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991485312 00000100:00100000:3.0:1746126998.923950:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991485312 00000100:00100000:3.0:1746126998.924008:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21157 00000100:00100000:3.0:1746126998.924016:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4089:x1830945991485312:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746126998.924039:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126998.924058:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52743 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.924098:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 51 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.924105:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126998.924107:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126998.924110:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->2306047] (req 2097152->2306047) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 31 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.924170:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 51 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.924182:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 51 pid: 12333 timeout: 993 lvb_type: 0 00000100:00100000:3.0:1746126998.924201:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994183808:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126998.924291:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:3.0:1746126998.926802:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994183808:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126998.926812:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126998.926834:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->2306047] (req 2097152->2306047) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 31 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126998.926852:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47400, rc 0) 00000100:00100000:1.0:1746126998.926867:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991485440 00000100:00100000:1.0:1746126998.926874:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991485440 00000100:00100000:3.0:1746126998.926894:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4089:x1830945991485312:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2878us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126998.926901:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21157 00000100:00100000:1.0:1746126998.926913:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21158 00000100:00100000:1.0:1746126998.926920:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4086:x1830945991485440:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.926933:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.926948:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5274a expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.926971:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.926979:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.926980:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.926984:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 39 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.927007:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.927017:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 28 pid: 12333 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746126998.927028:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994183936:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.927111:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.927225:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.928291:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991485568 00000100:00100000:3.0:1746126998.928297:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991485568 00002000:00100000:3.0:1746126998.928335:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3575807) req@ffff88009c4ce300 x1830945991485568/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126998.928344:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ce300 with x1830945991485568 ext(3145728->3575807) 00010000:00010000:3.0:1746126998.928352:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 52 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.928363:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 52 pid: 12333 timeout: 993 lvb_type: 0 00002000:00010000:3.0:1746126998.928369:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4ce300 00000100:00100000:3.0:1746126998.928401:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1841 00000100:00100000:3.0:1746126998.928408:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2028:x1830945991485568:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746126998.930671:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.930779:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994183936:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126998.930780:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991485696 00000100:00100000:3.0:1746126998.930787:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991485696 00010000:00010000:1.0:1746126998.930812:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 39 pid: 16295 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746126998.930830:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3039232->3145727) req@ffff88009c4cdc00 x1830945991485696/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746126998.930833:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01e00, rc 0) 00002000:00100000:3.0:1746126998.930839:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cdc00 with x1830945991485696 ext(3039232->3145727) 00010000:00010000:3.0:1746126998.930846:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 29 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.930855:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 29 pid: 12333 timeout: 993 lvb_type: 0 00002000:00010000:3.0:1746126998.930861:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4cdc00 00000100:00100000:1.0:1746126998.930873:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4086:x1830945991485440:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3953us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.930881:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21158 00000100:00100000:3.0:1746126998.930892:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1842 00000100:00100000:3.0:1746126998.930899:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991485696:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746126998.934357:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2028:x1830945991485568:12345-192.168.203.42@tcp:4:cat.0 Request processed in 5938us (7120us total) trans 17179875520 rc 0/0 00000100:00100000:3.0:1746126998.934369:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1841 00002000:00100000:3.0:1746126998.934380:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3575807) req@ffff88009c4ce300 x1830945991485568/t17179875520(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/448 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126998.934390:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ce300 with x1830945991485568 ext(3145728->3575807) 00010000:00010000:3.0:1746126998.934399:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 54 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:3.0:1746126998.934412:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be46e00/0x34dc807b6ef8b71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526cc expref: 54 pid: 12333 timeout: 993 lvb_type: 0 00002000:00010000:3.0:1746126998.934421:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4ce300 00000100:00100000:0.0:1746126998.937110:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.937270:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991485824 00000100:00100000:3.0:1746126998.937278:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991485824 00000100:00100000:0.0:1746126998.937830:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.937847:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991485952 00000100:00100000:0.0:1746126998.937850:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991485952 00010000:00010000:0.0:1746126998.937866:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 31 pid: 12333 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746126998.937886:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9872 00000100:00100000:0.0:1746126998.937891:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991485952:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126998.937899:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126998.937911:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 31 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.937920:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 31 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.937934:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be47e00/0x34dc807b6ef8c12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5273c expref: 31 pid: 12333 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746126998.937956:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.937957:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126998.937962:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.937968:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126998.937985:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126998.937992:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994184192:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126998.938012:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126998.940069:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994184192:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126998.940104:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126998.940173:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991485952:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2280us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.940183:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9872 00000100:00100000:1.0:1746126998.945741:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.945811:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126998.946212:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991486464 00000100:00100000:3.0:1746126998.946217:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991486464 00002000:00100000:3.0:1746126998.946263:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009942ea00 x1830945991486464/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126998.946272:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ea00 with x1830945991486464 ext(2097152->3145727) 00002000:00010000:3.0:1746126998.946277:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942ea00 00000100:00100000:3.0:1746126998.946308:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8420 00000100:00100000:3.0:1746126998.946315:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991486464:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126998.953039:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.953120:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991486720 00000100:00100000:1.0:1746126998.953163:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991486720 00000100:00100000:1.0:1746126998.953223:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6526 00000100:00100000:1.0:1746126998.953231:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+36:4089:x1830945991486720:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746126998.953473:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+37:4089:x1830945991486720:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 242us (441us total) trans 8589938107 rc 0/0 00000100:00100000:1.0:1746126998.953480:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6526 00000100:00100000:3.0:1746126998.954335:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991486464:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8016us (8520us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126998.954346:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8420 00002000:00100000:3.0:1746126998.954355:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009942ea00 x1830945991486464/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126998.954364:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ea00 with x1830945991486464 ext(2097152->3145727) 00002000:00010000:3.0:1746126998.954369:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942ea00 00000100:00100000:0.0:1746126998.960461:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.960536:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991486848 00000100:00100000:1.0:1746126998.960549:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991486848 00000100:00100000:1.0:1746126998.960613:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21159 00000100:00100000:1.0:1746126998.960625:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:4086:x1830945991486848:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126998.960645:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126998.960663:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00600/0x34dc807b6ef8c27 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52751 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.960696:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 30 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.960703:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.960705:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126998.960709:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00600/0x34dc807b6ef8c27 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52751 expref: 54 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.960743:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 30 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.960755:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 30 pid: 12333 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126998.960768:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184320:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126998.960872:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126998.964273:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.964392:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184320:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126998.964425:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00600/0x34dc807b6ef8c27 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52751 expref: 54 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126998.964443:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00600, rc 0) 00000100:00100000:1.0:1746126998.964502:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:4086:x1830945991486848:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3880us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126998.964512:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21159 00000100:00100000:3.0:1746126998.964804:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991486976 00000100:00100000:3.0:1746126998.964811:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991486976 00002000:00100000:3.0:1746126998.964853:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2306047) req@ffff88009c4cc000 x1830945991486976/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746126998.964861:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc000 with x1830945991486976 ext(2097152->2306047) 00010000:00010000:3.0:1746126998.964867:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 31 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126998.964880:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 31 pid: 12333 timeout: 994 lvb_type: 0 00002000:00010000:3.0:1746126998.964887:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4cc000 00000100:00100000:3.0:1746126998.964903:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1843 00000100:00100000:3.0:1746126998.964910:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991486976:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746126998.968839:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991486976:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3917us (4561us total) trans 17179875521 rc 0/0 00000100:00100000:0.0:1746126998.968852:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1843 00002000:00100000:0.0:1746126998.968864:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2306047) req@ffff88009c4cc000 x1830945991486976/t17179875521(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:4/0 lens 488/448 e 0 to 0 dl 1746127009 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126998.968874:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc000 with x1830945991486976 ext(2097152->2306047) 00010000:00010000:0.0:1746126998.968885:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 33 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126998.968899:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6ef8c19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52743 expref: 33 pid: 12333 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126998.968906:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4cc000 00000100:00100000:0.0:1746126998.972850:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.983852:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126998.983925:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126998.984017:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991487488 00000100:00100000:1.0:1746126998.984026:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991487488 00002000:00100000:1.0:1746126998.984073:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cc700 x1830945991487488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/0 e 0 to 0 dl 1746127009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.984095:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc700 with x1830945991487488 ext(3145728->4194303) 00002000:00010000:1.0:1746126998.984100:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cc700 00000100:00100000:1.0:1746126998.984453:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8422 00000100:00100000:1.0:1746126998.984461:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991487488:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126998.996295:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991487488:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11821us (12439us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126998.996308:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8422 00002000:00100000:1.0:1746126998.996319:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cc700 x1830945991487488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:4/0 lens 488/440 e 0 to 0 dl 1746127009 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126998.996330:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc700 with x1830945991487488 ext(3145728->4194303) 00002000:00010000:1.0:1746126998.996335:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cc700 00000100:00100000:0.0:1746126999.015370:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.021610:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.021953:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17184 00000100:00100000:3.0:1746126999.021964:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+59:4095:x1830945991488128:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746126999.021989:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.022008:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505600/0x34dc807b6ef8c2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52758 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.022095:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022107:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022120:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022158:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022164:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022169:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022266:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022275:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022280:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:3.0:1746126999.022289:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746126999.022360:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022367:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022372:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022378:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022383:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094505c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746126999.022386:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022392:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022402:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746126999.022405:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126999.022410:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022418:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6ef8c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022444:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022449:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022453:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022457:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094505a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746126999.022459:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022463:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022470:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829000) 00010000:00010000:3.0:1746126999.022472:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126999.022474:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.022478:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505a00/0x34dc807b6ef8c3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00000100:00080000:0.0:1746126999.022886:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746126999.023720:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505600/0x34dc807b6ef8c2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 62 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.023738:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 61 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.023749:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.023752:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126999.023754:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47400, rc 0) 00000100:00100000:3.0:1746126999.024867:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+61:4095:x1830945991488128:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2900us (3258us total) trans 8589938108 rc 0/0 00000100:00100000:3.0:1746126999.024875:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17184 00000100:00100000:0.0:1746126999.031943:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.032009:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991488256 00000100:00100000:1.0:1746126999.032018:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991488256 00000100:00100000:1.0:1746126999.032075:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21160 00000100:00100000:1.0:1746126999.032093:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:4095:x1830945991488256:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126999.032112:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.032164:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5275f expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.032196:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.032210:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 7 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.032217:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094505200/0x34dc807b6ef8ab4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5265c expref: 55 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.032224:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.032226:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.032229:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1212416->1347583] (req 1212416->1347583) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 55 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.032261:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094505200/0x34dc807b6ef8ab4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5265c expref: 55 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.032272:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094505200/0x34dc807b6ef8ab4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5265c expref: 55 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.032284:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184576:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.032849:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 7 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.032944:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 7 pid: 1964 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.032953:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ece7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184704:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.032987:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.032995:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 31 pid: 16295 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.033003:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184832:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.033018:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.036016:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184576:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.036029:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ece7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184704:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.036036:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994184832:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.036092:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1212416->1347583] (req 1212416->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 55 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.036112:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00a00, rc 0) 00000100:00100000:1.0:1746126999.036189:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:4095:x1830945991488256:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4096us (4256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.036198:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21160 00000100:00100000:0.0:1746126999.037842:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.038068:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.038111:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.038216:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991488384 00000100:00100000:3.0:1746126999.038224:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991488384 00010000:00010000:3.0:1746126999.038275:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 8 pid: 1964 timeout: 994 lvb_type: 1 00000100:00080000:0.0:1746126999.038322:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746126999.038978:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991488640 00000100:00100000:1.0:1746126999.038982:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991488640 00010000:00010000:1.0:1746126999.039017:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 32 pid: 16295 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.039039:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991488512 00000100:00100000:1.0:1746126999.039041:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991488512 00010000:00010000:1.0:1746126999.039051:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094505200/0x34dc807b6ef8ab4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5265c expref: 55 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.039066:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9874 00000100:00100000:1.0:1746126999.039073:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991488384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.039099:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.039121:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 8 pid: 1964 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.039152:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 8 pid: 1964 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.039176:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6ef8b7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e1 expref: 8 pid: 1964 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.039196:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.039240:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2027:x1830945991488384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 167us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.039246:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9874 00000100:00100000:1.0:1746126999.039262:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9875 00000100:00100000:1.0:1746126999.039266:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2027:x1830945991488640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.039272:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.039279:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 32 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.039287:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 32 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.039299:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009914ae00/0x34dc807b6ef8a13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52601 expref: 32 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.039308:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.039323:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2027:x1830945991488640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 56us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.039328:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9875 00000100:00100000:1.0:1746126999.039337:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9876 00000100:00100000:1.0:1746126999.039342:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:2027:x1830945991488512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.039348:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.039353:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094505200/0x34dc807b6ef8ab4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5265c expref: 55 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.039361:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094505200/0x34dc807b6ef8ab4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5265c expref: 55 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.039371:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094505200/0x34dc807b6ef8ab4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5265c expref: 55 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.039380:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.039382:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.039388:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 54 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.039396:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 54 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.039426:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 54 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.039436:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994184960:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126999.039487:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00000100:00080000:0.0:1746126999.039658:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746126999.043770:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.043866:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994184960:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126999.043890:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.043940:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2027:x1830945991488512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4596us (5826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.043951:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9876 00000100:00100000:0.0:1746126999.048023:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.048153:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991489152 00000100:00100000:1.0:1746126999.048162:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991489152 00002000:00100000:1.0:1746126999.048204:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1343488->1347583) req@ffff88009c749c00 x1830945991489152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.048214:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749c00 with x1830945991489152 ext(1343488->1347583) 00002000:00010000:1.0:1746126999.048219:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c749c00 00000100:00100000:1.0:1746126999.049664:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8426 00000100:00100000:1.0:1746126999.049677:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2028:x1830945991489152:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746126999.050059:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2028:x1830945991489152:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 385us (2045us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126999.050065:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8426 00002000:00100000:1.0:1746126999.050072:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1343488->1347583) req@ffff88009c749c00 x1830945991489152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.050096:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749c00 with x1830945991489152 ext(1343488->1347583) 00002000:00010000:1.0:1746126999.050100:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c749c00 00000100:00100000:0.0:1746126999.055491:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.055628:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991489408 00000100:00100000:1.0:1746126999.055637:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991489408 00000100:00100000:1.0:1746126999.055695:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6527 00000100:00100000:1.0:1746126999.055703:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+61:4095:x1830945991489408:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746126999.056612:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+62:4095:x1830945991489408:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 909us (1131us total) trans 8589938109 rc 0/0 00000100:00100000:1.0:1746126999.056620:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6527 00000100:00100000:0.0:1746126999.056826:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991489792 00000100:00100000:0.0:1746126999.056830:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991489792 00000100:00100000:0.0:1746126999.056855:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991490048 00000100:00100000:0.0:1746126999.056857:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991490048 00000100:00100000:0.0:1746126999.056868:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991489664 00000100:00100000:0.0:1746126999.056869:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991489664 00000100:00100000:3.0:1746126999.056874:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991489920 00000100:00100000:3.0:1746126999.056878:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991489920 00000100:00100000:0.0:1746126999.056883:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21161 00000100:00100000:0.0:1746126999.056888:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991489792:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:3.0:1746126999.056899:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21162 00010000:00010000:0.0:1746126999.056899:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126999.056905:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991490048:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.056912:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.056917:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f120c00/0x34dc807b6ef8c58 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52774 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.056919:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52782 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.056936:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.056938:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.056947:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.056961:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.056977:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47a00, rc 0) 00000100:00100000:3.0:1746126999.057064:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991490048:12345-192.168.203.42@tcp:101:cat.0 Request processed in 158us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.057069:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21162 00000100:00100000:3.0:1746126999.057090:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21163 00000100:00100000:3.0:1746126999.057095:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991489664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.057101:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.057108:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6ef8c66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5276d expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.057118:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.057119:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.057123:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6ef8c66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5276d expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.057152:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6ef8c66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5276d expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.057160:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be46200, rc 0) 00000100:00100000:3.0:1746126999.057175:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991489664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 80us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.057181:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21163 00000100:00100000:3.0:1746126999.057189:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21164 00000100:00100000:3.0:1746126999.057194:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991489920:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.057202:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.057211:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8c6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5277b expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.057223:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.057224:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.057227:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8c6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5277b expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.057237:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8c6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5277b expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.057243:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47c00, rc 0) 00000100:00100000:3.0:1746126999.057254:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991489920:12345-192.168.203.42@tcp:101:cat.0 Request processed in 60us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.057258:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21164 00000100:00100000:0.0:1746126999.057271:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994185088:192.168.203.42@tcp:106: 00000100:00080000:3.0:1746126999.057289:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746126999.057325:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.072642:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.072835:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.072900:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991490432 00000100:00100000:1.0:1746126999.072909:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991490432 00002000:00100000:1.0:1746126999.072957:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009c74a680 x1830945991490432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.072967:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74a680 with x1830945991490432 ext(0->1048575) 00002000:00010000:1.0:1746126999.072973:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c74a680 00000100:00100000:1.0:1746126999.073096:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991490560 00000100:00100000:1.0:1746126999.073099:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991490560 00002000:00100000:1.0:1746126999.073115:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c74aa00 x1830945991490560/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.073121:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74aa00 with x1830945991490560 ext(1048576->2097151) 00002000:00010000:1.0:1746126999.073125:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c74aa00 00000100:00100000:1.0:1746126999.075206:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8428 00000100:00100000:1.0:1746126999.075218:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991490560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.086050:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991490560:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10823us (13201us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126999.086063:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8428 00002000:00100000:0.0:1746126999.086074:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c74aa00 x1830945991490560/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.086095:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74aa00 with x1830945991490560 ext(1048576->2097151) 00002000:00010000:0.0:1746126999.086100:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c74aa00 00000100:00100000:0.0:1746126999.097804:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.104466:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.118113:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.118663:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991490944 00000100:00100000:1.0:1746126999.118674:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991490944 00010000:00010000:1.0:1746126999.118716:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 56 pid: 16295 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.118760:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9877 00000100:00100000:1.0:1746126999.118768:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:2026:x1830945991490944:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.118782:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.118802:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 56 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.118814:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1347583) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 56 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.118838:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00a00/0x34dc807b6ef8c51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1347583) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5275f expref: 56 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.118876:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.118878:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.118885:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd000/0x34dc807b6ef8c7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52789 expref: 33 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.118893:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd000/0x34dc807b6ef8c7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52789 expref: 33 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.118928:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd000/0x34dc807b6ef8c7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52789 expref: 33 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.118940:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994185344:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126999.119025:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.123995:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994185344:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126999.124020:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.124096:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:2026:x1830945991490944:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5326us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.124108:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9877 00000100:00100000:0.0:1746126999.126652:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.136504:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991491200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9487us (9849us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126999.136517:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8429 00002000:00100000:3.0:1746126999.136529:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009c74b480 x1830945991491200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.136538:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74b480 with x1830945991491200 ext(1048576->2097151) 00002000:00010000:3.0:1746126999.136544:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c74b480 00000100:00100000:0.0:1746126999.149508:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.158244:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.158307:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.158350:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991491584 00000100:00100000:1.0:1746126999.158358:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991491584 00002000:00100000:1.0:1746126999.158440:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ec7b480 x1830945991491584/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.158449:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7b480 with x1830945991491584 ext(2097152->4194303) 00002000:00010000:1.0:1746126999.158453:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec7b480 00000100:00100000:1.0:1746126999.158476:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991491840 00000100:00100000:1.0:1746126999.158478:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991491840 00002000:00100000:1.0:1746126999.158491:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007ec79500 x1830945991491840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.158498:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79500 with x1830945991491840 ext(2097152->4194303) 00002000:00010000:1.0:1746126999.158500:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec79500 00000100:00100000:1.0:1746126999.158518:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8430 00000100:00100000:1.0:1746126999.158525:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991491584:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.181736:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.183405:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.183521:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991492352 00000100:00100000:3.0:1746126999.183525:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991492352 00000100:00100000:3.0:1746126999.183573:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17185 00000100:00100000:3.0:1746126999.183579:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+37:4107:x1830945991492352:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746126999.183593:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.183781:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52797 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.183889:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.183900:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 61 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.183906:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.183929:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 61 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.183938:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 61 pid: 7259 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.183946:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994185472:192.168.203.42@tcp:104: 00000100:00080000:0.0:1746126999.184044:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746126999.185355:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.187008:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991491584:12345-192.168.203.42@tcp:3:cat.0 Request processed in 28478us (28769us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746126999.187017:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8430 00002000:00100000:1.0:1746126999.187029:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ec7b480 x1830945991491584/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.187039:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7b480 with x1830945991491584 ext(2097152->4194303) 00002000:00010000:1.0:1746126999.187043:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec7b480 00000100:00100000:0.0:1746126999.194090:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.194125:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994185472:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.194178:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:1.0:1746126999.194237:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991492480 00000100:00100000:1.0:1746126999.194242:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991492480 00010000:00010000:1.0:1746126999.194267:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 62 pid: 7259 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.194302:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9878 00000100:00100000:1.0:1746126999.194308:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+62:2027:x1830945991492480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.194318:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.194322:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 62 pid: 7259 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.194330:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 62 pid: 7259 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.194346:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47400/0x34dc807b6ef8c43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52758 expref: 62 pid: 7259 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.194364:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126999.194368:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126999.194375:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126999.194381:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746126999.194395:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.194425:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+61:2027:x1830945991492480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.194430:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9878 00010000:00010000:3.0:1746126999.194543:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.194549:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:3.0:1746126999.194563:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746126999.194664:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46000/0x34dc807b6ef8c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52797 expref: 40 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.194684:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52797 expref: 39 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.194689:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.194691:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126999.194693:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82800, rc 0) 00000100:00100000:3.0:1746126999.194713:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+39:4107:x1830945991492352:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 11134us (11309us total) trans 8589938110 rc 0/0 00000100:00100000:3.0:1746126999.194719:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17185 00000100:00100000:0.0:1746126999.197932:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.198005:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991492736 00000100:00100000:3.0:1746126999.198012:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991492736 00000100:00100000:3.0:1746126999.198719:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17186 00000100:00100000:3.0:1746126999.198728:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+61:4106:x1830945991492736:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746126999.198745:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.198760:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82200/0x34dc807b6ef8c9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5279e expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.198837:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6ef8ca5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.198847:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6ef8ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746126999.198855:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6ef8ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:3.0:1746126999.198864:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746126999.198931:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82200/0x34dc807b6ef8c9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5279e expref: 64 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.198958:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6ef8ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5279e expref: 63 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.198964:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.198966:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126999.198968:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b83400, rc 0) 00000100:00100000:3.0:1746126999.199004:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+63:4106:x1830945991492736:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 278us (1079us total) trans 8589938111 rc 0/0 00000100:00100000:3.0:1746126999.199010:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17186 00000100:00100000:0.0:1746126999.201978:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.202900:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.203251:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991493120 00000100:00100000:3.0:1746126999.203256:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991493120 00000100:00100000:3.0:1746126999.203281:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21168 00000100:00100000:3.0:1746126999.203287:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4106:x1830945991493120:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746126999.203296:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.203309:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef8cb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527a5 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.203330:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 40 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.203337:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8c6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5277b expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.203347:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.203348:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.203352:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef8cb3 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3846144->3923967] (req 3846144->3923967) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527a5 expref: 40 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.203374:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8c6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5277b expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.203383:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8c6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5277b expref: 33 pid: 12333 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.203392:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994185600:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.203449:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 40 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.203456:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 40 pid: 16295 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.203464:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994185728:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.203478:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.204968:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994185600:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.204974:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994185728:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.204988:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef8cb3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3846144->3923967] (req 3846144->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527a5 expref: 40 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.205000:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82600, rc 0) 00000100:00100000:3.0:1746126999.205019:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4106:x1830945991493120:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1733us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.205026:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21168 00000100:00100000:0.0:1746126999.205798:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.205837:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991493248 00000100:00100000:3.0:1746126999.205841:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991493248 00000100:00100000:3.0:1746126999.205859:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21169 00000100:00100000:3.0:1746126999.205863:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4103:x1830945991493248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.205871:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.205879:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be46000/0x34dc807b6ef8cba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527ac expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.205892:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.205893:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.205897:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be46000/0x34dc807b6ef8cba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ac expref: 41 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.205904:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be46000/0x34dc807b6ef8cba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ac expref: 41 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.205909:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be46000, rc 0) 00000100:00100000:3.0:1746126999.205923:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4103:x1830945991493248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.205926:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21169 00000100:00100000:0.0:1746126999.207440:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.207602:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991493376 00000100:00100000:1.0:1746126999.207608:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991493376 00010000:00010000:1.0:1746126999.207628:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 41 pid: 16295 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.207752:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.207838:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9879 00000100:00100000:1.0:1746126999.207845:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991493376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.207854:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.207868:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 41 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.207878:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 41 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.207892:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd01e00/0x34dc807b6ef8c20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5274a expref: 41 pid: 16295 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.207912:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.207935:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991493376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 90us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.207940:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9879 00000100:00100000:0.0:1746126999.208087:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.208103:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991493504 00000100:00100000:0.0:1746126999.208106:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991493504 00000100:00100000:0.0:1746126999.208123:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991493632 00000100:00100000:0.0:1746126999.208125:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991493632 00000100:00100000:0.0:1746126999.208573:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21170 00000100:00100000:0.0:1746126999.208579:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991493504:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126999.208590:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.208598:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc32000/0x34dc807b6ef8cc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527b3 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.208612:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.208619:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc32000/0x34dc807b6ef8cc1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527b3 expref: 34 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.208626:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc32000/0x34dc807b6ef8cc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527b3 expref: 34 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.208637:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32000, rc 0) 00000100:00100000:0.0:1746126999.208657:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991493504:12345-192.168.203.42@tcp:101:cat.0 Request processed in 79us (905us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.208662:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21170 00000100:00100000:0.0:1746126999.208672:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21171 00000100:00100000:0.0:1746126999.208676:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:4107:x1830945991493632:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126999.208682:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.208686:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527ba expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.208696:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.208697:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.208700:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3162112->3203071] (req 3162112->3203071) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.208707:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3162112->3203071] (req 3162112->3203071) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.208713:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32400, rc 0) 00000100:00100000:0.0:1746126999.208725:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4107:x1830945991493632:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 49us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.208729:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21171 00000100:00100000:0.0:1746126999.208869:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.209065:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991493888 00000100:00100000:3.0:1746126999.209070:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991493888 00002000:00100000:3.0:1746126999.209100:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012153d180 x1830945991493888/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.209107:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153d180 with x1830945991493888 ext(2097152->3145727) 00002000:00010000:3.0:1746126999.209110:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153d180 00000100:00100000:3.0:1746126999.209123:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8434 00000100:00100000:3.0:1746126999.209144:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991493888:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.210397:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.210453:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.210477:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991494144 00000100:00100000:1.0:1746126999.210480:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991494144 00000100:00100000:1.0:1746126999.210497:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21172 00000100:00100000:1.0:1746126999.210501:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4099:x1830945991494144:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.210509:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.210517:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e97000/0x34dc807b6ef8ccf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527c1 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.210529:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.210530:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.210535:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e97000/0x34dc807b6ef8ccf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3923968->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c1 expref: 34 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.210543:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e97000/0x34dc807b6ef8ccf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3923968->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c1 expref: 34 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.210548:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e97000, rc 0) 00000100:00100000:1.0:1746126999.210565:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+34:4099:x1830945991494144:12345-192.168.203.42@tcp:101:cat.0 Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.210568:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21172 00000100:00100000:3.0:1746126999.215100:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991493888:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5963us (6222us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126999.215110:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8434 00002000:00100000:3.0:1746126999.215119:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012153d180 x1830945991493888/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.215146:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153d180 with x1830945991493888 ext(2097152->3145727) 00002000:00010000:3.0:1746126999.215151:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153d180 00000100:00100000:0.0:1746126999.215991:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.216013:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.216036:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.216074:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991494528 00000100:00100000:1.0:1746126999.216091:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991494528 00002000:00100000:1.0:1746126999.216119:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3162112->3166207) req@ffff88012153dc00 x1830945991494528/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.216142:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153dc00 with x1830945991494528 ext(3162112->3166207) 00002000:00010000:1.0:1746126999.216145:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153dc00 00000100:00100000:1.0:1746126999.216161:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991494784 00000100:00100000:1.0:1746126999.216164:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991494784 00002000:00100000:1.0:1746126999.216172:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3919872->3923967) req@ffff88012153df80 x1830945991494784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.216179:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153df80 with x1830945991494784 ext(3919872->3923967) 00002000:00010000:1.0:1746126999.216182:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153df80 00000100:00100000:1.0:1746126999.216191:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8435 00000100:00100000:1.0:1746126999.216196:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991494528:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746126999.216443:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991494272 00000100:00100000:3.0:1746126999.216446:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991494272 00000100:00100000:3.0:1746126999.216467:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21173 00000100:00100000:3.0:1746126999.216471:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991494272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.216479:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.216490:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8cd6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527c8 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.216509:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8cd6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c8 expref: 36 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.216518:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be47c00/0x34dc807b6ef8cd6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c8 expref: 36 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.216529:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47c00, rc 0) 00000100:00100000:0.0:1746126999.216614:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8436 00000100:00100000:0.0:1746126999.216620:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991494784:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.216626:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991494528:12345-192.168.203.42@tcp:3:cat.0 Request processed in 429us (611us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126999.216632:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8435 00002000:00100000:1.0:1746126999.216638:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3162112->3166207) req@ffff88012153dc00 x1830945991494528/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.216645:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153dc00 with x1830945991494528 ext(3162112->3166207) 00002000:00010000:1.0:1746126999.216647:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153dc00 00000100:00100000:0.0:1746126999.216666:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991494784:12345-192.168.203.42@tcp:3:cat.0 Request processed in 46us (629us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126999.216671:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8436 00002000:00100000:0.0:1746126999.216676:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3919872->3923967) req@ffff88012153df80 x1830945991494784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.216683:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153df80 with x1830945991494784 ext(3919872->3923967) 00002000:00010000:0.0:1746126999.216685:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153df80 00000100:00100000:3.0:1746126999.216922:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991494272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 449us (932us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126999.216928:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21173 00000100:00100000:0.0:1746126999.220879:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.220920:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.220977:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991495040 00000100:00100000:1.0:1746126999.220985:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991495040 00002000:00100000:1.0:1746126999.221019:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff88012153e300 x1830945991495040/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.221027:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153e300 with x1830945991495040 ext(4825088->4829183) 00002000:00010000:1.0:1746126999.221031:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153e300 00000100:00100000:1.0:1746126999.221045:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991495296 00000100:00100000:1.0:1746126999.221052:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991495296 00002000:00100000:1.0:1746126999.221061:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3198976->3203071) req@ffff88012153e680 x1830945991495296/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.221066:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153e680 with x1830945991495296 ext(3198976->3203071) 00002000:00010000:1.0:1746126999.221070:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153e680 00000100:00100000:1.0:1746126999.221103:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8438 00000100:00100000:1.0:1746126999.221111:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991495296:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.221229:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991495296:12345-192.168.203.42@tcp:3:cat.0 Request processed in 120us (308us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126999.221234:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8438 00002000:00100000:1.0:1746126999.221238:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3198976->3203071) req@ffff88012153e680 x1830945991495296/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.221243:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153e680 with x1830945991495296 ext(3198976->3203071) 00002000:00010000:1.0:1746126999.221246:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153e680 00000100:00100000:0.0:1746126999.226061:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.230405:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991495424 00000100:00100000:3.0:1746126999.230415:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991495424 00000100:00100000:3.0:1746126999.230471:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21174 00000100:00100000:3.0:1746126999.230479:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4103:x1830945991495424:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.230493:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.230508:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527cf expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.230532:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.230540:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef8cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3846144->3923967] (req 3846144->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527a5 expref: 41 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.230545:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126999.230547:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126999.230550:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 5/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.230572:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef8cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3846144->3923967] (req 3846144->3923967) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527a5 expref: 41 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.230586:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6ef8cb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3846144->3923967] (req 3846144->3923967) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527a5 expref: 41 pid: 9612 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.230595:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994186112:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.230675:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.230683:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 32 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.230690:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994186240:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.230703:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.232321:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994186112:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.232329:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994186240:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.232347:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.232358:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be46e00, rc 0) 00000100:00100000:3.0:1746126999.232379:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4103:x1830945991495424:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1902us (6324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.232386:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21174 00000100:00100000:0.0:1746126999.233626:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.233655:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.238839:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991495680:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4878us (5178us total) trans 21474842778 rc 0/0 00000100:00100000:3.0:1746126999.238851:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1846 00002000:00100000:3.0:1746126999.238858:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3162112->3203071) req@ffff88012153ed80 x1830945991495680/t21474842778(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/448 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.238865:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153ed80 with x1830945991495680 ext(3162112->3203071) 00010000:00010000:3.0:1746126999.238872:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 35 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.238882:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 35 pid: 9613 timeout: 994 lvb_type: 0 00002000:00010000:3.0:1746126999.238888:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012153ed80 00000100:00100000:0.0:1746126999.240724:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.242300:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.242446:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991495936 00000100:00100000:3.0:1746126999.242450:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991495936 00010000:00010000:3.0:1746126999.242464:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 35 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.242478:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9882 00000100:00100000:3.0:1746126999.242481:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991495936:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.242496:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.242503:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 35 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.242511:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 35 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.242523:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc32400/0x34dc807b6ef8cc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3162112->3842047] (req 3162112->3203071) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527ba expref: 35 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.242545:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.242547:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.242552:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.242560:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.242584:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 41 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.242593:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994186368:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.242642:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.244656:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994186368:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.244671:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.245096:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991495936:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2611us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.245105:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9882 00000100:00100000:0.0:1746126999.246336:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.246390:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991496192 00000100:00100000:3.0:1746126999.246395:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991496192 00002000:00100000:3.0:1746126999.246425:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012153f800 x1830945991496192/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.246434:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f800 with x1830945991496192 ext(3145728->4194303) 00002000:00010000:3.0:1746126999.246437:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153f800 00000100:00100000:3.0:1746126999.246458:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8439 00000100:00100000:3.0:1746126999.246464:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991496192:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746126999.256571:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991496192:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10099us (10229us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126999.256581:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8439 00002000:00100000:3.0:1746126999.256590:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012153f800 x1830945991496192/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.256599:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f800 with x1830945991496192 ext(3145728->4194303) 00002000:00010000:3.0:1746126999.256603:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153f800 00000100:00100000:0.0:1746126999.261901:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994186496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746126999.261951:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.261972:0:9236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994186496 00000100:00100000:1.0:1746126999.261978:0:9236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994186496 00000100:00100000:1.0:1746126999.262193:0:9236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1746126999.262201:0:9236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3785:x1830945994186496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746126999.262261:0:9236:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445584896 avail 1316122624 00000100:00100000:1.0:1746126999.262308:0:9236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3785:x1830945994186496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.262313:0:9236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1746126999.262350:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994186496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746126999.263600:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.263701:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991496448 00000100:00100000:3.0:1746126999.263706:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991496448 00002000:00100000:3.0:1746126999.263736:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012153c000 x1830945991496448/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.263745:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153c000 with x1830945991496448 ext(4194304->4829183) 00002000:00010000:3.0:1746126999.263750:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153c000 00000100:00100000:3.0:1746126999.263775:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8440 00000100:00100000:3.0:1746126999.263780:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991496448:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746126999.267343:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991496448:12345-192.168.203.42@tcp:3:cat.0 Request processed in 3555us (3738us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746126999.267353:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8440 00002000:00100000:3.0:1746126999.267362:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012153c000 x1830945991496448/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.267371:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153c000 with x1830945991496448 ext(4194304->4829183) 00002000:00010000:3.0:1746126999.267375:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153c000 00000100:00100000:3.0:1746126999.277401:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:444fe009-ee02-43e3-bd8f-cf01026dcff4:3782:1830945994186624:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277453:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.277474:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994187008:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277491:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994187136:0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277501:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277509:0:8221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994186624 00000100:00100000:3.0:1746126999.277513:0:8221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994186624 00000100:00100000:1.0:1746126999.277521:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3785:1830945994187520:0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277540:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277548:0:8221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746126999.277552:0:8221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013110fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3782:x1830945994186624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277552:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3785:1830945994188032:0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277567:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277578:0:8221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013110fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3782:x1830945994186624:12345-0@lo:400:kworker.0 Request processed in 26us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277582:0:8221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1746126999.277582:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746126999.277586:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3785:1830945994186880:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277600:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187008 00000100:00100000:3.0:1746126999.277602:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187008 00000100:00100000:1.0:1746126999.277613:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277619:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1746126999.277622:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994187008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277627:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3785:1830945994187392:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277637:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994187008:12345-0@lo:400:kworker.0 Request processed in 14us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277640:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1746126999.277643:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277650:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187520 00000100:00100000:3.0:1746126999.277652:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187520 00000100:00100000:1.0:1746126999.277652:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994187904:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277663:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994188032 00000100:00100000:3.0:1746126999.277664:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994188032 00000100:00100000:1.0:1746126999.277666:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277672:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994186880 00000100:00100000:3.0:1746126999.277673:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994186880 00000100:00100000:3.0:1746126999.277679:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187392 00000100:00100000:3.0:1746126999.277680:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187392 00000100:00100000:3.0:1746126999.277686:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1746126999.277688:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3785:x1830945994187520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277688:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994187008:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277701:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3785:x1830945994187520:12345-0@lo:400:kworker.0 Request processed in 12us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277704:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1746126999.277708:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1746126999.277710:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3785:x1830945994188032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277712:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1746126999.277717:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3785:x1830945994186880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277719:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3785:x1830945994188032:12345-0@lo:400:kworker.0 Request processed in 8us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277722:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1746126999.277726:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1746126999.277728:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3785:x1830945994187392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277740:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3785:x1830945994187392:12345-0@lo:400:kworker.0 Request processed in 12us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.277742:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3785:x1830945994186880:12345-0@lo:400:kworker.0 Request processed in 25us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277743:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1746126999.277747:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1746126999.277754:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187904 00000100:00100000:3.0:1746126999.277755:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187904 00000100:00100000:3.0:1746126999.277765:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1746126999.277765:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277767:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994187904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277778:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994187904:12345-0@lo:400:kworker.0 Request processed in 11us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.277778:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ece7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3782:1830945994187648:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277781:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1746126999.277784:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187136 00000100:00100000:3.0:1746126999.277786:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187136 00000100:00100000:1.0:1746126999.277792:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277793:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1746126999.277795:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994187136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277804:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:444fe009-ee02-43e3-bd8f-cf01026dcff4:3782:1830945994186624:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277805:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994187136:12345-0@lo:400:kworker.0 Request processed in 9us (41us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277808:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1746126999.277816:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994187136:0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277821:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00080000:3.0:1746126999.277822:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746126999.277824:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1746126999.277825:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126999.277825:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994186752:0@lo:400:kworker.0 00000100:00080000:3.0:1746126999.277826:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746126999.277831:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187648 00000100:00100000:3.0:1746126999.277832:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187648 00000100:00100000:1.0:1746126999.277841:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277842:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1746126999.277844:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3782:x1830945994187648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277853:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3782:1830945994187264:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277857:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3782:x1830945994187648:12345-0@lo:400:kworker.0 Request processed in 12us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277859:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00080000:3.0:1746126999.277866:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746126999.277866:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.277909:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994187776:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277923:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187264 00000100:00100000:3.0:1746126999.277925:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187264 00000100:00100000:1.0:1746126999.277928:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.277937:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1746126999.277939:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3782:x1830945994187264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277946:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ece7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3782:1830945994187648:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277954:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3782:x1830945994187264:12345-0@lo:400:kworker.0 Request processed in 14us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.277957:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1746126999.277960:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3782:1830945994187264:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277965:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994187776 00000100:00100000:3.0:1746126999.277966:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994187776 00000100:00100000:3.0:1746126999.277974:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1746126999.277976:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994187776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277976:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3785:1830945994186880:0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277983:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3785:1830945994187392:0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.277989:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994187904:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277994:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994187776:12345-0@lo:400:kworker.0 Request processed in 17us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.277995:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3785:1830945994187520:0@lo:400:kworker.0 00000100:00100000:3.0:1746126999.277999:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1746126999.278002:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3785:1830945994188032:0@lo:400:kworker.0 00000100:00080000:3.0:1746126999.278007:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746126999.278009:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746126999.278034:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994186752:0@lo:400:kworker.0 00000100:00100000:1.0:1746126999.278041:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994187776:0@lo:400:kworker.0 00000100:00100000:0.0:1746126999.325943:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.326090:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991496576 00000100:00100000:3.0:1746126999.326099:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991496576 00000100:00100000:3.0:1746126999.326183:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17187 00000100:00100000:3.0:1746126999.326190:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:4112:x1830945991496576:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126999.326212:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.326227:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8ce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527d6 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.326273:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326283:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326291:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326303:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326308:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326312:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326364:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326374:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52797 expref: 38 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.326380:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6ef8ca5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5279e expref: 62 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.326390:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.326415:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6ef8ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5279e expref: 62 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.326425:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6ef8ca5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5279e expref: 62 pid: 7259 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.326435:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994188160:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.326516:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52797 expref: 38 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.326523:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6ef8c90 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52797 expref: 38 pid: 7259 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.326529:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994188288:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.326545:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4540 going to sleep for 11 seconds 00000100:00080000:0.0:1746126999.326629:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746126999.329874:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994188160:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.329885:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994188288:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.329888:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126999.329902:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.330031:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991496832 00000100:00100000:1.0:1746126999.330036:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991496832 00000100:00100000:1.0:1746126999.330095:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6528 00000100:00100000:1.0:1746126999.330103:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+63:27908:x1830945991496832:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746126999.330280:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+64:27908:x1830945991496832:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 178us (392us total) trans 8589938112 rc 0/0 00000100:00100000:1.0:1746126999.330287:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6528 00000100:00100000:0.0:1746126999.331465:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.332321:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991497088 00000100:00100000:3.0:1746126999.332329:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991497088 00000100:00100000:3.0:1746126999.333237:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6529 00000100:00100000:3.0:1746126999.333246:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+39:30904:x1830945991497088:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746126999.334219:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+40:30904:x1830945991497088:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 972us (2754us total) trans 8589938113 rc 0/0 00000100:00100000:3.0:1746126999.334226:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6529 00000100:00100000:1.0:1746126999.334320:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.336295:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126999.336678:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336685:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746126999.336722:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746126999.336727:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746126999.336738:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336746:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336753:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336757:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336762:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336766:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c35da00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746126999.336769:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336774:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336784:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746126999.336786:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126999.336789:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336792:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35da00/0x34dc807b6ef8ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336800:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336805:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.336809:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.337018:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c35ca00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746126999.337020:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.337025:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.337032:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829300) 00010000:00010000:3.0:1746126999.337034:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126999.337036:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.337040:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8cf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.337068:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35dc00/0x34dc807b6ef8ce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527d6 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.337091:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527d6 expref: 17 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.337097:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.337099:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126999.337101:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d146e00, rc 0) 00000100:00100000:3.0:1746126999.337433:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:4112:x1830945991496576:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 11242us (11494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.337439:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17187 00000100:00100000:0.0:1746126999.339659:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.339693:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.339722:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.339749:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.339790:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991497472 00000100:00100000:0.0:1746126999.339796:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991497472 00000100:00100000:3.0:1746126999.339900:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991497600 00000100:00100000:3.0:1746126999.339903:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991497600 00000100:00100000:0.0:1746126999.340339:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991497856 00000100:00100000:0.0:1746126999.340341:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991497856 00000100:00100000:3.0:1746126999.340599:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21176 00000100:00100000:3.0:1746126999.340605:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991497728:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126999.340612:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.340620:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8d07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527eb expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.340629:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.340630:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.340635:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8d07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527eb expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.340643:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8d07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527eb expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.340650:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4e00, rc 0) 00000100:00100000:0.0:1746126999.340689:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21177 00000100:00100000:0.0:1746126999.340694:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991497600:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126999.340699:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.340704:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527e4 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.340713:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.340714:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.340718:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.340725:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.340731:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6000, rc 0) 00000100:00100000:3.0:1746126999.340985:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991497728:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 380us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.340989:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21176 00000100:00100000:0.0:1746126999.341072:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991497600:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 377us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.341085:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21177 00000100:00100000:0.0:1746126999.343895:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.344021:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991498112 00000100:00100000:3.0:1746126999.344027:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991498112 00000100:00100000:3.0:1746126999.344071:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17188 00000100:00100000:3.0:1746126999.344090:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:4112:x1830945991498112:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126999.344103:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.344119:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8d1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e527f9 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.344221:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8d23 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.344234:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527d6 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.344241:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8d23 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.344265:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527d6 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.344274:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146e00/0x34dc807b6ef8cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527d6 expref: 18 pid: 13448 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.344284:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994188544:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.344401:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.345551:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994188544:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.345567:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8d23 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746126999.346270:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126999.346788:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8d23 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.346795:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8d23 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746126999.346810:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746126999.346894:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6ef8d1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f9 expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.346905:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8d23 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f9 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.346910:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.346912:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746126999.346914:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e8e6800, rc 0) 00000100:00100000:3.0:1746126999.347193:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4112:x1830945991498112:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3114us (3302us total) trans 8589938114 rc 0/0 00000100:00100000:3.0:1746126999.347199:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17188 00000100:00100000:3.0:1746126999.350099:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991498496 00000100:00100000:3.0:1746126999.350106:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991498496 00000100:00100000:3.0:1746126999.350402:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17189 00000100:00100000:3.0:1746126999.350427:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4112:x1830945991498496:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126999.350469:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.350472:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746126999.350491:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6800/0x34dc807b6ef8d23 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f9 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.350504:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.350507:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126999.350516:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6ef8d31 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52800 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.350586:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef8d38 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.350766:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef8d38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.350775:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef8d38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746126999.350786:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746126999.350858:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6ef8d31 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52800 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.350868:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef8d38 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52800 expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.350873:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.350875:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746126999.350877:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642600, rc 0) 00000100:00100000:3.0:1746126999.350933:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:4112:x1830945991498496:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 507us (1314us total) trans 8589938115 rc 0/0 00000100:00100000:3.0:1746126999.350939:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17189 00000100:00100000:0.0:1746126999.353468:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.353496:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.353527:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.353546:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991498624 00000100:00100000:0.0:1746126999.353553:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991498624 00000100:00100000:0.0:1746126999.353594:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991498752 00000100:00100000:0.0:1746126999.353597:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991498752 00000100:00100000:0.0:1746126999.353617:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991498880 00000100:00100000:0.0:1746126999.353619:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991498880 00000100:00100000:0.0:1746126999.353631:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21179 00000100:00100000:0.0:1746126999.353637:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991498624:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126999.353668:0:12340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.353682:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 41 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.353689:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef8c74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52766 expref: 33 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.353695:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.353699:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.353701:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.353703:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.353728:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.353738:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 11 pid: 16295 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.353754:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994188672:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.353825:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef8c74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52766 expref: 33 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.353832:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef8c74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52766 expref: 33 pid: 9613 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.353839:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994188800:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.353861:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 41 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.353868:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 41 pid: 12333 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.353875:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994188928:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.353888:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.353907:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21181 00000100:00100000:0.0:1746126999.353913:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991498880:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746126999.353928:0:9613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.353938:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd000/0x34dc807b6ef8c7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52789 expref: 33 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.353949:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.353955:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfca00/0x34dc807b6ef8c82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52790 expref: 55 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.353960:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.353961:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.353963:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.353978:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfca00/0x34dc807b6ef8c82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52790 expref: 55 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.353985:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfca00/0x34dc807b6ef8c82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52790 expref: 55 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.353992:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994189184:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.354019:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.354027:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 11 pid: 9613 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.354034:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994189440:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.354058:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd000/0x34dc807b6ef8c7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52789 expref: 33 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.354065:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfd000/0x34dc807b6ef8c7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52789 expref: 33 pid: 9612 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.354072:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994189696:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.354099:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.355561:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21184 00000100:00100000:3.0:1746126999.355579:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991499264:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:3.0:1746126999.355600:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef8d69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.355623:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00600/0x34dc807b6ef8c27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52751 expref: 55 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.355630:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef8d15 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f2 expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.355637:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.355642:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.355644:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.355646:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef8d69 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.355661:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.355669:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 33 pid: 12333 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.355677:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994190720:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.356854:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef8d15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f2 expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.356869:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef8d15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f2 expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.356877:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994190848:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.356905:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd00600/0x34dc807b6ef8c27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52751 expref: 55 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.356911:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00600/0x34dc807b6ef8c27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52751 expref: 55 pid: 16295 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.356917:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994190976:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.356928:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.362084:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c428a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994189824:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.362097:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c42bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994189952:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.362121:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994190848:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.362147:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994190976:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.362158:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994189184:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.362164:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994189056:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.362165:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994189440:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.362170:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994189696:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.362171:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096631880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994189312:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.362177:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096632d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994189568:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.362192:0:9613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.362192:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.362842:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.362905:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.363774:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991499904 00000100:00100000:3.0:1746126999.363777:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991499904 00010000:00010000:3.0:1746126999.363809:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 13 pid: 9613 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.363829:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9886 00000100:00100000:3.0:1746126999.363835:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991499904:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.363847:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.363861:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 13 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.363870:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 13 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.363885:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6ef8d0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527e4 expref: 13 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.363900:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.363930:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991499904:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 95us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.363936:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9886 00000100:00100000:1.0:1746126999.364652:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.364763:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991500032 00000100:00100000:3.0:1746126999.364767:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991500032 00010000:00010000:3.0:1746126999.364779:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 56 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.364793:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9888 00000100:00100000:3.0:1746126999.364798:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:2029:x1830945991500032:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.364803:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.364810:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 56 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.364818:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 56 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.364829:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be47800/0x34dc807b6ef8bfd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5272e expref: 56 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.364838:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.364855:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:2029:x1830945991500032:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.364860:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9888 00000100:00100000:3.0:1746126999.364910:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994190336:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.364918:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994190464:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.364925:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994190592:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.364944:0:12333:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.364994:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994190080:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.365001:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994190208:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.365018:0:9611:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.366924:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994190720:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.366945:0:1507:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef8d69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.368623:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.371116:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.371331:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991500800 00000100:00100000:3.0:1746126999.371336:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991500800 00010000:00010000:3.0:1746126999.371353:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6ef8b94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e8 expref: 14 pid: 11152 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.371479:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9890 00000100:00100000:3.0:1746126999.371484:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991500800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.371492:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.371502:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6ef8b94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e8 expref: 14 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.371510:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6ef8b94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e8 expref: 14 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.371521:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6ef8b94 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526e8 expref: 14 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.371533:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.371552:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991500800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 68us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.371556:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9890 00000100:00100000:0.0:1746126999.371912:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9893 00000100:00100000:0.0:1746126999.371917:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991500160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.371923:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.371930:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 41 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.371937:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 41 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.371946:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc200/0x34dc807b6ef8b4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e526be expref: 41 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.371956:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.371969:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991500160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 52us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.371973:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9893 00000100:00100000:0.0:1746126999.372004:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.372014:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991500416 00000100:00100000:0.0:1746126999.372016:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991500416 00010000:00010000:0.0:1746126999.372025:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8d07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527eb expref: 13 pid: 11152 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.372039:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9894 00000100:00100000:0.0:1746126999.372043:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991500416:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.372047:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.372053:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8d07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527eb expref: 13 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372060:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8d07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527eb expref: 13 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372068:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8d07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527eb expref: 13 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372089:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.372101:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991500416:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 57us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.372105:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9894 00000100:00100000:0.0:1746126999.372153:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.372162:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991499392 00000100:00100000:0.0:1746126999.372164:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991499392 00010000:00010000:0.0:1746126999.372172:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.372183:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9895 00000100:00100000:0.0:1746126999.372187:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991499392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.372192:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.372197:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372203:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372211:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb000/0x34dc807b6ef8be1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52712 expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372218:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.372219:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.372222:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.372227:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.372241:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.372252:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991499392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.372256:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9895 00000100:00100000:0.0:1746126999.372283:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.372291:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991499648 00000100:00100000:0.0:1746126999.372293:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991499648 00010000:00010000:0.0:1746126999.372302:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6000/0x34dc807b6ef8d00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527dd expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.372312:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9896 00000100:00100000:0.0:1746126999.372315:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991499648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.372320:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.372327:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6000/0x34dc807b6ef8d00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527dd expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372334:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6000/0x34dc807b6ef8d00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527dd expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372343:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6000/0x34dc807b6ef8d00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527dd expref: 12 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.372350:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.372360:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991499648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 44us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.372364:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9896 00000100:00100000:0.0:1746126999.373912:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.373931:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991500288 00000100:00100000:0.0:1746126999.373936:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991500288 00010000:00010000:0.0:1746126999.373955:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e97000/0x34dc807b6ef8ccf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3923968->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c1 expref: 33 pid: 9612 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.373974:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9897 00000100:00100000:0.0:1746126999.373979:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991500288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.373988:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746126999.374040:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994191104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746126999.374073:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.374117:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994191104 00000100:00100000:3.0:1746126999.374120:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994191104 00000100:00100000:3.0:1746126999.374156:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1746126999.374161:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3783:x1830945994191104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746126999.374175:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1135058240 pending 6823936 free 3907129344 avail 3675607040 00000100:00100000:3.0:1746126999.374203:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3783:x1830945994191104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.374208:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1746126999.374238:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994191104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1746126999.374268:0:12340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374280:0:12340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374297:0:12340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374304:0:12340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374311:0:12340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374316:0:12340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c7200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746126999.374319:0:12340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374325:0:12340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374338:0:12340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.374344:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6ef8d46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.374402:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991498624:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 20765us (20940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.374409:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21179 00000100:00100000:3.0:1746126999.374449:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.374488:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.374499:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991500544 00000100:00100000:3.0:1746126999.374502:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991500544 00010000:00010000:3.0:1746126999.374514:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef8d15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f2 expref: 11 pid: 16295 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.374530:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991501056 00000100:00100000:3.0:1746126999.374532:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991501056 00010000:00010000:3.0:1746126999.374539:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd03800/0x34dc807b6ef8a3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5260f expref: 34 pid: 12333 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.374551:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9898 00000100:00100000:3.0:1746126999.374555:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991500544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.374561:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.374570:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef8d15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f2 expref: 11 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.374577:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef8d15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f2 expref: 11 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.374589:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c35000/0x34dc807b6ef8d15 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527f2 expref: 11 pid: 16295 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.374598:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.374611:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991500544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.374616:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9898 00000100:00100000:3.0:1746126999.374626:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9899 00000100:00100000:3.0:1746126999.374630:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991501056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.374635:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.374642:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd03800/0x34dc807b6ef8a3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5260f expref: 34 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.374649:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd03800/0x34dc807b6ef8a3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5260f expref: 34 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.374657:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03800/0x34dc807b6ef8a3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5260f expref: 34 pid: 12333 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.374665:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.374676:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991501056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 46us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.374680:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9899 00010000:00010000:0.0:1746126999.374858:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e97000/0x34dc807b6ef8ccf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3923968->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c1 expref: 32 pid: 9612 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.374871:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e97000/0x34dc807b6ef8ccf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3923968->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c1 expref: 32 pid: 9612 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.374881:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e97000/0x34dc807b6ef8ccf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3923968->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527c1 expref: 32 pid: 9612 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.374891:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.374907:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2027:x1830945991500288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 928us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.374912:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9897 00000100:00100000:0.0:1746126999.374941:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.374953:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991501184 00000100:00100000:0.0:1746126999.374956:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991501184 00010000:00010000:0.0:1746126999.374966:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 40 pid: 1964 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.374979:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9900 00000100:00100000:0.0:1746126999.374983:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991501184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.374988:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.374994:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 40 pid: 1964 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.375000:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 40 pid: 1964 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.375013:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6ef8cdd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e527cf expref: 40 pid: 1964 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.375020:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.375021:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.375024:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375030:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375045:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.375059:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991501184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.375063:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9900 00010000:00010000:0.0:1746126999.375091:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375098:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375108:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375114:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375124:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375146:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebe800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126999.375149:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375154:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375161:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375166:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6ef8d5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.375194:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991499136:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 20273us (20784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.375200:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21182 00000100:00100000:0.0:1746126999.375237:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.375247:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991501312 00000100:00100000:0.0:1746126999.375250:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991501312 00010000:00010000:0.0:1746126999.375261:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6ef8c66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5276d expref: 33 pid: 12333 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.375274:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9901 00000100:00100000:0.0:1746126999.375278:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991501312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.375284:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.375291:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6ef8c66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5276d expref: 33 pid: 12333 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.375299:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6ef8c66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5276d expref: 33 pid: 12333 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.375310:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6ef8c66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5276d expref: 33 pid: 12333 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.375318:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.375319:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.375322:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375327:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375340:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.375353:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991501312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 74us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.375358:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9901 00010000:00010000:0.0:1746126999.375372:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375378:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375392:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375397:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375403:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375407:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126999.375409:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375414:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375422:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.375426:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c35800/0x34dc807b6ef8d4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.375455:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991498752:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 21576us (21958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.375459:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21180 00000100:00100000:0.0:1746126999.375494:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.375505:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991501440 00000100:00100000:0.0:1746126999.375507:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991501440 00010000:00010000:0.0:1746126999.375516:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 32 pid: 12333 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.375527:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9902 00000100:00100000:0.0:1746126999.375531:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2029:x1830945991501440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.375537:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.375542:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 32 pid: 12333 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.375548:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 32 pid: 12333 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.375556:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be47a00/0x34dc807b6ef8c5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52782 expref: 32 pid: 12333 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.375563:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.375574:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2029:x1830945991501440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 43us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.375578:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9902 00010000:00010000:1.0:1746126999.376047:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376054:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376066:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376071:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376085:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376090:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126999.376093:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376102:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376111:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.376116:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82800/0x34dc807b6ef8d54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.376167:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991498880:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 22254us (22639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.376172:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21181 00000100:00100000:0.0:1746126999.378536:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.379689:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126999.379910:0:12333:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379918:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379931:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379937:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379943:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379952:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a5a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746126999.379955:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379962:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379969:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.379975:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef8d62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.380007:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991499008:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 24622us (25349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.380013:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21183 00000100:00100000:0.0:1746126999.381837:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.383232:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991501952 00000100:00100000:3.0:1746126999.383240:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991501952 00000100:00100000:0.0:1746126999.386648:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.386828:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.386839:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.386872:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.386885:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991502080 00000100:00100000:3.0:1746126999.386891:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991502080 00010000:00010000:3.0:1746126999.386916:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef8408 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5229d expref: 63 pid: 7259 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.386937:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9905 00000100:00100000:3.0:1746126999.386943:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+63:2027:x1830945991502080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.386952:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.386957:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef8408 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5229d expref: 63 pid: 7259 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.386966:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef8408 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5229d expref: 63 pid: 7259 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.387160:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9907 00000100:00100000:1.0:1746126999.387167:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+64:2027:x1830945991502208:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.387173:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.387176:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef83de lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52281 expref: 64 pid: 11634 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.387213:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef8408 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5229d expref: 64 pid: 7259 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.387255:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.387278:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994191616:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.387284:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994191744:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.387949:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef83de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52281 expref: 62 pid: 11634 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.387959:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef83de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52281 expref: 62 pid: 11634 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.387970:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126999.387973:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126999.387978:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126999.387983:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746126999.387994:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.388009:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+61:2027:x1830945991502208:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 844us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.388014:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9907 00010000:00010000:3.0:1746126999.388206:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.388210:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126999.388213:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126999.388221:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126999.388225:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:3.0:1746126999.388227:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+60:2027:x1830945991502080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1285us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.388233:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9905 00000040:00080000:0.0:1746126999.388452:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1335, 88 off125080 00000004:00080000:0.0:1746126999.388459:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430329876ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388497:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1360, 88 off127368 00000004:00080000:0.0:1746126999.388501:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430371899ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126999.388525:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1361, 88 off127456 00000004:00080000:0.0:1746126999.388528:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430398704ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126999.388537:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1336, 88 off125168 00000004:00080000:0.0:1746126999.388539:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430409789ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388546:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1337, 88 off125256 00000004:00080000:0.0:1746126999.388548:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430418714ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388555:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1362, 88 off127544 00000004:00080000:0.0:1746126999.388557:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430428141ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126999.388564:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1363, 88 off127632 00000004:00080000:0.0:1746126999.388566:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430436959ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126999.388572:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1364, 88 off127720 00000004:00080000:0.0:1746126999.388575:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430445142ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126999.388582:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1338, 88 off125344 00000004:00080000:0.0:1746126999.388584:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430454784ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388593:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1365, 88 off127808 00000004:00080000:0.0:1746126999.388596:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430466462ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126999.388603:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1339, 88 off125432 00000004:00080000:0.0:1746126999.388605:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430475509ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388613:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1366, 88 off127896 00000004:00080000:0.0:1746126999.388616:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430486619ns, next at 847916249980ns, rc = 0 00000040:00080000:0.0:1746126999.388623:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1340, 88 off125520 00000004:00080000:0.0:1746126999.388626:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430496674ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388642:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1341, 88 off125608 00000004:00080000:0.0:1746126999.388645:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430515344ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388652:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1342, 88 off125696 00000004:00080000:0.0:1746126999.388654:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430525194ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388661:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1343, 88 off125784 00000004:00080000:0.0:1746126999.388664:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894430534559ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746126999.388703:0:7260:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1367, 88 off127984 00000004:00080000:0.0:1746126999.388706:0:7260:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894430576749ns, next at 847916249980ns, rc = 0 00000100:00100000:1.0:1746126999.389382:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994191872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746126999.389413:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.389452:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994191872 00000100:00100000:3.0:1746126999.389455:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994191872 00000100:00100000:3.0:1746126999.389473:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1746126999.389477:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3784:x1830945994191872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746126999.389490:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1113054528 pending 9764864 free 3910705152 avail 3679182848 00000100:00100000:3.0:1746126999.389819:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3784:x1830945994191872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 339us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.389824:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1746126999.389972:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994191872:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1746126999.390232:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938116 is committed 00000004:00080000:3.0:1746126999.390236:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1341 committed 00000004:00080000:3.0:1746126999.390251:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1318 committed 00000004:00080000:3.0:1746126999.390261:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1317 committed 00000004:00080000:3.0:1746126999.390263:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1316 committed 00000004:00080000:3.0:1746126999.390264:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1315 committed 00000004:00080000:3.0:1746126999.390266:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1340 committed 00000004:00080000:3.0:1746126999.390268:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1314 committed 00000004:00080000:3.0:1746126999.390269:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1339 committed 00000004:00080000:3.0:1746126999.390271:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1313 committed 00000004:00080000:3.0:1746126999.390272:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1338 committed 00000004:00080000:3.0:1746126999.390273:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1337 committed 00000004:00080000:3.0:1746126999.390275:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1336 committed 00000004:00080000:3.0:1746126999.390276:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1312 committed 00000004:00080000:3.0:1746126999.390277:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1311 committed 00000004:00080000:3.0:1746126999.390278:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1335 committed 00000004:00080000:3.0:1746126999.390280:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1334 committed 00000004:00080000:3.0:1746126999.390281:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1310 committed 00000001:00080000:3.0:1746126999.390287:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938113 is committed 00000001:00080000:3.0:1746126999.390291:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938112 is committed 00000100:00100000:3.0:1746126999.390456:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994192128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.390479:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.390480:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.390498:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994192640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.390501:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.390512:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.390516:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.390526:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994193152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.390529:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.390543:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994192256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.390723:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.390740:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.390752:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.390765:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.390777:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746126999.390781:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.390794:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.390802:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.390814:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.390820:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.390830:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.390836:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.390848:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.390863:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994192896 00000100:00100000:1.0:1746126999.390866:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994192896 00000100:00100000:1.0:1746126999.390877:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994193408 00000100:00100000:1.0:1746126999.390879:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994193408 00000100:00100000:3.0:1746126999.390880:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994193920 00000100:00100000:3.0:1746126999.390883:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994193920 00000100:00100000:1.0:1746126999.390895:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21188 00000100:00100000:3.0:1746126999.390899:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21189 00000100:00100000:1.0:1746126999.390899:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3785:x1830945994192512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.390903:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3785:x1830945994193024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126999.390942:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746126999.390944:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746126999.390946:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:1.0:1746126999.390948:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746126999.390950:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746126999.390967:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3785:x1830945994193024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (226us total) trans 21474842779 rc 0/0 00000100:00100000:1.0:1746126999.390971:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3785:x1830945994192512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (441us total) trans 17179875525 rc 0/0 00000100:00100000:3.0:1746126999.390982:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21189 00000100:00100000:1.0:1746126999.390986:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21188 00000100:00100000:3.0:1746126999.390991:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21190 00000100:00100000:0.0:1746126999.390994:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21191 00000100:00100000:3.0:1746126999.390995:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3785:x1830945994193536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.390997:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21192 00000100:00100000:0.0:1746126999.390999:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3785:x1830945994192384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.391001:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3785:x1830945994192896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.391045:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3785:x1830945994192384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (250us total) trans 21474842780 rc 0/0 00000100:00100000:0.0:1746126999.391050:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21191 00000100:00100000:0.0:1746126999.391059:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21193 00000100:00100000:0.0:1746126999.391063:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3785:x1830945994193408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.391126:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3785:x1830945994193408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (294us total) trans 17179875527 rc 0/0 00000100:00100000:0.0:1746126999.391152:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21193 00000100:00100000:0.0:1746126999.391162:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21194 00000100:00100000:0.0:1746126999.391166:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3785:x1830945994193920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126999.391254:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:1.0:1746126999.391257:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746126999.391259:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126999.391261:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746126999.391262:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:1.0:1746126999.391281:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3785:x1830945994192896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 279us (465us total) trans 17179875528 rc 0/0 00000100:00100000:1.0:1746126999.391286:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21192 00000100:00100000:1.0:1746126999.391303:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.391316:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994192768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.391332:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.391341:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994193280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.391352:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.391358:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994193792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.391368:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.391382:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994192256 00000100:00100000:1.0:1746126999.391384:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994192256 00000100:00100000:1.0:1746126999.391394:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994192768 00000100:00100000:1.0:1746126999.391395:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994192768 00000004:00010000:0.0:1746126999.391396:0:7260:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c5bd880 reply state ffff88007dc67800 transno 8589938116 ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:3.0:1746126999.391399:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3785:x1830945994193536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 403us (632us total) trans 21474842781 rc 0/0 00000100:00100000:1.0:1746126999.391400:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994193280 00000100:00100000:1.0:1746126999.391402:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994193280 00000100:00100000:3.0:1746126999.391404:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21190 00000100:00100000:1.0:1746126999.391407:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994193792 00000100:00100000:1.0:1746126999.391409:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994193792 00010000:00010000:0.0:1746126999.391410:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00000100:00100000:3.0:1746126999.391414:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21195 00010000:00010000:0.0:1746126999.391417:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000100:00100000:3.0:1746126999.391418:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3783:x1830945994192256:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746126999.391420:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746126999.391466:0:7260:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746126999.391471:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3783:x1830945994192256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (167us total) trans 17179875529 rc 0/0 00000100:00100000:1.0:1746126999.391500:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21196 00010000:00080000:0.0:1746126999.391559:0:7260:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746126999.391568:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4112:x1830945991501952:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 8231us (9733us total) trans 8589938116 rc 0/0 00000100:00100000:0.0:1746126999.391573:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17190 00002000:00010000:0.0:1746126999.391598:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:0.0:1746126999.391600:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126999.391602:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126999.391604:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126999.391605:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:0.0:1746126999.391623:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3785:x1830945994193920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 457us (773us total) trans 21474842782 rc 0/0 00000100:00100000:1.0:1746126999.391646:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3783:x1830945994192768:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.391701:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4cf100/2, rc 0, transno 17179875529 00000100:00100000:1.0:1746126999.391705:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994192256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.391794:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3783:x1830945994192768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (408us total) trans 21474842784 rc 0/0 00000100:00100000:1.0:1746126999.391800:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21196 00000004:00080000:1.0:1746126999.391822:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e1180/2, rc 0, transno 21474842784 00000100:00100000:1.0:1746126999.391829:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994192768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.391835:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3fca80/2, rc 0, transno 21474842783 00000100:00100000:1.0:1746126999.391837:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994193280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.391856:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3fce00/2, rc 0, transno 21474842785 00000100:00100000:1.0:1746126999.391857:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994193792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.391881:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994194048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126999.391885:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21195 00000100:00100000:1.0:1746126999.391892:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.391898:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994194048 00000100:00100000:3.0:1746126999.391900:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994194048 00000004:00080000:1.0:1746126999.391903:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e3800/2, rc 0, transno 21474842780 00000100:00100000:1.0:1746126999.391904:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192384:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.391908:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b6300/2, rc 0, transno 17179875528 00000100:00100000:1.0:1746126999.391910:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.391913:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21199 00000004:00080000:1.0:1746126999.391913:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec7a300/2, rc 0, transno 17179875527 00000100:00100000:1.0:1746126999.391915:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.391917:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3785:x1830945994194048:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.391917:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3fed80/2, rc 0, transno 21474842782 00000100:00100000:1.0:1746126999.391919:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.391922:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4cce00/2, rc 0, transno 17179875524 00000100:00100000:1.0:1746126999.391923:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126999.391926:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4cdf80/2, rc 0, transno 17179875525 00000100:00100000:1.0:1746126999.391928:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994192512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126999.391932:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3fe680/2, rc 0, transno 21474842779 00000100:00100000:1.0:1746126999.391934:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.391939:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3fdf80/2, rc 0, transno 21474842781 00000100:00100000:1.0:1746126999.391941:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994193536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126999.391985:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3785:x1830945994194048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (91us total) trans 21474842786 rc 0/0 00000100:00100000:3.0:1746126999.391991:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21199 00000004:00080000:1.0:1746126999.391996:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60000/2, rc 0, transno 21474842786 00000100:00100000:1.0:1746126999.392000:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994194048:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746126999.392007:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126999.392014:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126999.392020:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126999.392024:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012158de00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746126999.392027:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126999.392036:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126999.392045:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.392047:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126999.392049:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746126999.392053:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012158de00/0x34dc807b6ef8d70 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746126999.392100:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21194 00000100:00100000:3.0:1746126999.392261:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.392287:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994193664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.392297:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994193152 00000100:00100000:0.0:1746126999.392299:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994193152 00000100:00100000:3.0:1746126999.392312:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126999.392328:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994193664 00000100:00100000:0.0:1746126999.392330:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994193664 00000004:00080000:3.0:1746126999.392338:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4cd880/2, rc 0, transno 17179875523 00000100:00100000:3.0:1746126999.392341:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994192128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.392341:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21200 00000100:00100000:1.0:1746126999.392345:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21201 00000100:00100000:0.0:1746126999.392345:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3782:x1830945994193152:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126999.392347:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b7100/2, rc 0, transno 17179875526 00000100:00100000:3.0:1746126999.392350:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994192640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.392350:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3782:x1830945994193664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.392399:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3782:x1830945994193664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (86us total) trans 21474842787 rc 0/0 00000100:00100000:0.0:1746126999.392400:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3782:x1830945994193152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (138us total) trans 17179875530 rc 0/0 00000100:00100000:1.0:1746126999.392402:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21201 00000100:00100000:0.0:1746126999.392405:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21200 00000004:00080000:3.0:1746126999.392407:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b7480/2, rc 0, transno 17179875530 00000100:00100000:3.0:1746126999.392410:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994193152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126999.392416:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3ff800/2, rc 0, transno 21474842787 00000100:00100000:3.0:1746126999.392418:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994193664:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1746126999.395105:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875529 is committed 00000001:00080000:0.0:1746126999.395179:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875522 is committed 00000001:00080000:0.0:1746126999.395186:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875521 is committed 00000100:00100000:1.0:1746126999.395521:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.395988:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991502976 00000100:00100000:3.0:1746126999.395997:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991502976 00000100:00100000:3.0:1746126999.396040:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17192 00000100:00100000:3.0:1746126999.396048:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4112:x1830945991502976:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126999.396074:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.396103:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5280e expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.396179:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.396194:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.396211:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.396213:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746126999.396217:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35c000, rc 0) 00000100:00100000:3.0:1746126999.396261:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4112:x1830945991502976:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 214us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.396267:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17192 00000100:00100000:1.0:1746126999.396333:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.396725:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991503232 00000100:00100000:3.0:1746126999.396729:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991503232 00000100:00100000:3.0:1746126999.396912:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6530 00000100:00100000:3.0:1746126999.396918:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4115:x1830945991503232:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746126999.397772:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4115:x1830945991503232:12345-192.168.203.42@tcp:35:cat.0 Request processed in 850us (1435us total) trans 8589938118 rc 0/0 00000100:00100000:3.0:1746126999.397780:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6530 00000100:00100000:0.0:1746126999.398773:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.399797:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.399895:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991503488 00000100:00100000:3.0:1746126999.399899:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991503488 00000100:00100000:3.0:1746126999.399933:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17194 00000100:00100000:3.0:1746126999.399939:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4115:x1830945991503488:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.399953:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.399962:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef8daf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5281c expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.400002:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.400010:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.400018:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746126999.400033:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746126999.400035:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746126999.400044:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.400059:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef8daf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.400071:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.400090:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.400092:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126999.400093:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a4c00, rc 0) 00000100:00100000:3.0:1746126999.400148:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4115:x1830945991503488:12345-192.168.203.42@tcp:101:cat.0 Request processed in 190us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.400154:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17194 00000100:00100000:0.0:1746126999.401813:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.401847:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.401873:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.401889:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.401966:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991503744 00000100:00100000:1.0:1746126999.401973:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991503744 00000100:00100000:0.0:1746126999.401996:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.402001:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991504000 00000100:00100000:1.0:1746126999.402004:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991504000 00000100:00100000:1.0:1746126999.402021:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991504256 00000100:00100000:1.0:1746126999.402023:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991504256 00000100:00100000:1.0:1746126999.402032:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991503616 00000100:00100000:1.0:1746126999.402033:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991503616 00000100:00100000:1.0:1746126999.402043:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991503872 00000100:00100000:1.0:1746126999.402044:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991503872 00000100:00100000:1.0:1746126999.402056:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21202 00000100:00100000:1.0:1746126999.402262:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991503744:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126999.402278:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.402298:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5282a expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126999.402320:0:3148:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c895, atime: 0x6813c895, ctime: 0x6813c895, blocks: 0x800 00000100:00100000:3.0:1746126999.402330:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21204 00010000:00010000:1.0:1746126999.402337:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746126999.402339:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991504256:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126999.402339:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.402346:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.402347:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.402356:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52846 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.402360:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746126999.402369:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c895, atime: 0x6813c895, ctime: 0x6813c895, blocks: 0x1008 00010000:00010000:1.0:1746126999.402369:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4400, rc 0) 00010000:00010000:3.0:1746126999.402378:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.402379:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.402384:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.402394:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.402401:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5a00, rc 0) 00000100:00100000:1.0:1746126999.402405:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991503744:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 343us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.402411:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21202 00000100:00100000:1.0:1746126999.402423:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21205 00000100:00100000:1.0:1746126999.402428:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991503616:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126999.402434:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.402441:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52823 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126999.402451:0:3148:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c895, atime: 0x6813c895, ctime: 0x6813c895, blocks: 0x7f8 00010000:00010000:1.0:1746126999.402458:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.402460:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.402464:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.402473:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.402479:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4e00, rc 0) 00000100:00100000:3.0:1746126999.402639:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991504256:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 300us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.402645:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21204 00000100:00100000:1.0:1746126999.402693:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991503616:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 263us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.402699:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21205 00000100:00100000:0.0:1746126999.402811:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.402862:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.402890:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.402904:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.402924:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.402968:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.402985:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991504896 00000100:00100000:3.0:1746126999.402989:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991504896 00000100:00100000:0.0:1746126999.402998:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.403003:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991505024 00000100:00100000:3.0:1746126999.403004:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991505024 00000100:00100000:3.0:1746126999.403014:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21208 00000100:00100000:3.0:1746126999.403018:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991504384:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.403025:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.403032:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5284d expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.403047:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.403049:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.403053:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 41 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.403062:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 41 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.403068:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5e00, rc 0) 00000100:00100000:3.0:1746126999.403101:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991504384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.403109:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21208 00000100:00100000:3.0:1746126999.403119:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21211 00000100:00100000:3.0:1746126999.403124:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991504768:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.403145:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.403152:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52862 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.403162:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.403164:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.403168:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 41 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.403177:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 41 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.403188:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35ca00, rc 0) 00000100:00100000:3.0:1746126999.403204:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991504768:12345-192.168.203.42@tcp:101:cat.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.403209:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21211 00000100:00100000:0.0:1746126999.408236:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.408270:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.408681:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991505152 00000100:00100000:1.0:1746126999.408689:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991505152 00000100:00100000:0.0:1746126999.408693:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.408711:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.408724:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.409386:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991505408 00000100:00100000:1.0:1746126999.409390:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991505408 00000100:00100000:1.0:1746126999.409413:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991505664 00000100:00100000:1.0:1746126999.409415:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991505664 00000100:00100000:1.0:1746126999.409427:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991505280 00000100:00100000:1.0:1746126999.409428:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991505280 00000100:00100000:1.0:1746126999.409439:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991505536 00000100:00100000:1.0:1746126999.409442:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991505536 00000100:00100000:1.0:1746126999.409456:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21214 00000100:00100000:1.0:1746126999.409463:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991505152:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746126999.409569:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991505152:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 105us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.409575:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21214 00000100:00100000:1.0:1746126999.409590:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21215 00000100:00100000:1.0:1746126999.409595:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991505408:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746126999.409634:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991505408:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 39us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.409639:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21215 00000100:00100000:1.0:1746126999.409647:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21216 00000100:00100000:1.0:1746126999.409651:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991505664:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746126999.409680:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991505664:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 28us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.409688:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21216 00000100:00100000:1.0:1746126999.409697:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21217 00000100:00100000:1.0:1746126999.409700:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991505280:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746126999.409732:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991505280:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 30us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.409736:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21217 00000100:00100000:1.0:1746126999.409745:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21218 00000100:00100000:1.0:1746126999.409750:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991505536:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746126999.409783:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991505536:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 33us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.409788:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21218 00000100:00100000:0.0:1746126999.410749:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.415459:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.415491:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.415516:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.415529:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.415543:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.415596:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.415626:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991505920 00000100:00100000:0.0:1746126999.415633:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991505920 00000100:00100000:0.0:1746126999.415662:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991506048 00000100:00100000:0.0:1746126999.415665:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991506048 00000100:00100000:0.0:1746126999.415688:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991506304 00000100:00100000:0.0:1746126999.415690:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991506304 00000100:00100000:0.0:1746126999.415699:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991506560 00000100:00100000:0.0:1746126999.415700:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991506560 00000100:00100000:0.0:1746126999.415708:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991506176 00000100:00100000:0.0:1746126999.415710:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991506176 00000100:00100000:0.0:1746126999.415717:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991506432 00000100:00100000:0.0:1746126999.415719:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991506432 00000100:00100000:0.0:1746126999.415728:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21220 00000100:00100000:0.0:1746126999.415734:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991505920:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746126999.415816:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991505920:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 82us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.415822:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21220 00000100:00100000:3.0:1746126999.415841:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21221 00000100:00100000:3.0:1746126999.415857:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991506048:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746126999.415951:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991506048:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 100us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.416653:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21222 00000100:00100000:3.0:1746126999.416809:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21221 00000100:00100000:1.0:1746126999.416846:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21223 00000100:00100000:1.0:1746126999.416869:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991506560:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746126999.416926:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991506560:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 61us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.416931:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21223 00000100:00100000:0.0:1746126999.417523:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991506304:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746126999.417592:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991506304:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 78us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.417599:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21222 00000100:00100000:0.0:1746126999.421120:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.425425:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.425479:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.425731:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991507200 00000100:00100000:3.0:1746126999.425739:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991507200 00002000:00100000:3.0:1746126999.425787:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009c428700 x1830945991507200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.425797:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428700 with x1830945991507200 ext(1048576->2097151) 00002000:00010000:3.0:1746126999.425803:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c428700 00000100:00100000:3.0:1746126999.425818:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991507456 00000100:00100000:3.0:1746126999.425820:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991507456 00002000:00100000:3.0:1746126999.425830:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009c42bb80 x1830945991507456/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.425837:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42bb80 with x1830945991507456 ext(0->1048575) 00002000:00010000:3.0:1746126999.425840:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42bb80 00000100:00100000:3.0:1746126999.425865:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8441 00000100:00100000:3.0:1746126999.425872:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991507200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.425979:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8442 00000100:00100000:0.0:1746126999.426038:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991507456:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.427758:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.427792:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.428003:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991507584 00000100:00100000:0.0:1746126999.428006:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991507584 00002000:00100000:0.0:1746126999.428024:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880096630e00 x1830945991507584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.428031:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630e00 with x1830945991507584 ext(1048576->2097151) 00002000:00010000:0.0:1746126999.428036:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096630e00 00000100:00100000:0.0:1746126999.428047:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8444 00000100:00100000:0.0:1746126999.428053:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991507584:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.442250:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.442375:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991508096 00000100:00100000:1.0:1746126999.442385:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991508096 00000100:00100000:1.0:1746126999.442454:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8445 00000100:00100000:1.0:1746126999.442461:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991508096:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746126999.442497:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.442511:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.442513:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.442517:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.442529:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.449094:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.450934:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.450985:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991508608 00000100:00100000:3.0:1746126999.450991:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991508608 00000100:00100000:3.0:1746126999.451040:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8447 00000100:00100000:3.0:1746126999.451046:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991508608:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746126999.451069:0:29584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.451094:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.451096:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.451099:0:29584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.451109:0:29584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.452584:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991507456:12345-192.168.203.42@tcp:3:cat.0 Request processed in 26593us (27099us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126999.452593:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8442 00002000:00100000:0.0:1746126999.452603:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009c42bb80 x1830945991507456/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.452611:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42bb80 with x1830945991507456 ext(0->1048575) 00002000:00010000:0.0:1746126999.452617:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42bb80 00000100:00100000:1.0:1746126999.466636:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.466636:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.467309:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.467341:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991509120 00000100:00100000:1.0:1746126999.467350:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991509120 00000100:00100000:1.0:1746126999.467407:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991509376 00000100:00100000:1.0:1746126999.467410:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991509376 00000100:00100000:1.0:1746126999.467939:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8448 00000100:00100000:1.0:1746126999.467948:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991509120:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746126999.467990:0:20411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.468004:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.468006:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.468011:0:20411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.468025:0:20411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.468789:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.470922:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.472058:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991509632 00000100:00100000:0.0:1746126999.472068:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991509632 00000100:00100000:0.0:1746126999.472157:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8449 00000100:00100000:0.0:1746126999.472166:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991509376:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746126999.472193:0:29588:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.472205:0:29588:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.472207:0:29588:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.472212:0:29588:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.472298:0:29588:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.473297:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.473548:0:29587:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:3.0:1746126999.473557:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991510144 00000100:00100000:3.0:1746126999.473560:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991510144 00000100:00100000:1.0:1746126999.475331:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991507584:12345-192.168.203.42@tcp:3:cat.0 Request processed in 47104us (47401us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126999.475343:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8444 00002000:00100000:1.0:1746126999.475354:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880096630e00 x1830945991507584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.475364:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630e00 with x1830945991507584 ext(1048576->2097151) 00002000:00010000:1.0:1746126999.475369:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096630e00 00000100:00100000:1.0:1746126999.475391:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8451 00000100:00100000:1.0:1746126999.475399:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2029:x1830945991509888:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746126999.475430:0:29586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.475443:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.475444:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.475450:0:29586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.475461:0:29586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.475781:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991507200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 49908us (50365us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126999.475788:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8441 00002000:00100000:0.0:1746126999.475793:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009c428700 x1830945991507200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.475800:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428700 with x1830945991507200 ext(1048576->2097151) 00002000:00010000:0.0:1746126999.475804:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c428700 00000100:00100000:0.0:1746126999.475818:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8452 00000100:00100000:0.0:1746126999.475824:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2029:x1830945991510144:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746126999.475841:0:9618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.475850:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.475851:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.475854:0:9618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.475862:0:9618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.476207:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.476216:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.476228:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.476234:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800967e5e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126999.476237:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.476243:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.476257:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.476276:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5e00/0x34dc807b6ef8e11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.476309:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2028:x1830945991508096:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 33849us (34071us total) trans 0 rc 1040384/1040384 00000100:00100000:1.0:1746126999.476315:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8445 00000100:00100000:1.0:1746126999.476448:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991507072:12345-192.168.203.42@tcp:3:cat.0 Request processed in 50160us (50222us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126999.476453:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8443 00002000:00100000:1.0:1746126999.476458:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094e6f480 x1830945991507072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.476464:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6f480 with x1830945991507072 ext(1048576->2097151) 00002000:00010000:1.0:1746126999.476468:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6f480 00000100:00100000:0.0:1746126999.477583:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991510400 00000100:00100000:0.0:1746126999.477591:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991510400 00000100:00100000:0.0:1746126999.477624:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17196 00000100:00100000:0.0:1746126999.477629:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4122:x1830945991510400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126999.477647:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.477662:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6ef8e65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5287e expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.477727:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477737:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477746:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477755:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477760:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477768:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477869:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477876:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477881:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:0.0:1746126999.477889:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746126999.477949:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477954:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477959:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477964:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918b800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126999.477967:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477972:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.477981:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126999.477984:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746126999.477986:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746126999.477998:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478002:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b800/0x34dc807b6ef8e7a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478016:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478020:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478024:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478028:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918ae00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126999.478030:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478033:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478038:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746126999.478040:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126999.478043:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478046:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef8e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478052:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478056:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478061:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478065:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918ac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746126999.478067:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.478070:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.479161:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce14f00) 00010000:00010000:0.0:1746126999.479163:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746126999.479167:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.479172:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef8e73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.479678:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6ef8e65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5287e expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.479685:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6ef8e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5287e expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.479692:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b600, rc 0) 00000100:00100000:0.0:1746126999.479737:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4122:x1830945991510400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2106us (2838us total) trans 8589938119 rc 301/301 00000100:00100000:0.0:1746126999.479744:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17196 00010000:00010000:3.0:1746126999.488522:0:29585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6ef8e18 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488539:0:29585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6ef8e18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488547:0:29585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6ef8e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488554:0:29585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746126999.488558:0:29585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6ef8e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488566:0:29585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6ef8e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488584:0:29585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6ef8e18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488590:0:29585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6ef8e18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.488687:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2029:x1830945991508352:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 39436us (39607us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126999.488697:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8446 00010000:00010000:3.0:1746126999.488811:0:29584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488819:0:29584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488824:0:29584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488829:0:29584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f86e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746126999.488832:0:29584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488838:0:29584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488853:0:29584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.488859:0:29584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f86e00/0x34dc807b6ef8e1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.488894:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991508608:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 37848us (37963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126999.488900:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8447 00000004:00200000:2.0:1746126999.488928:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746126999.489022:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489029:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489034:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489039:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746126999.489042:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489047:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489054:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.489056:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126999.489059:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489063:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8e42 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489100:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489104:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489107:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489111:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489118:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746126999.489120:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489123:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489156:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746126999.489159:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126999.489162:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489167:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489177:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489181:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489185:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489189:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caebe00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746126999.489191:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489195:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489200:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce14f00) 00010000:00010000:2.0:1746126999.489202:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126999.489205:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489209:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.489244:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8e2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52877 expref: 32 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.489250:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52877 expref: 32 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.489258:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeba00, rc 0) 00000100:00100000:2.0:1746126999.489278:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4119:x1830945991508864:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 18930us (22652us total) trans 8589938120 rc 301/301 00000100:00100000:2.0:1746126999.489284:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17195 00010000:00010000:1.0:1746126999.492422:0:20411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.492437:0:20411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.492444:0:20411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.492450:0:20411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013084e600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126999.492454:0:20411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.492460:0:20411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.492476:0:20411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.492481:0:20411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6ef8e26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.492553:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991509120:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 24602us (25921us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126999.492561:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8448 00010000:00010000:0.0:1746126999.498999:0:9616:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009caebc00/0x34dc807b6ef8e50 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.499021:0:9616:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009caebc00/0x34dc807b6ef8e50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.499028:0:9616:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009caebc00/0x34dc807b6ef8e50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.499035:0:9616:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caebc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746126999.499038:0:9616:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009caebc00/0x34dc807b6ef8e50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.499051:0:9616:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009caebc00/0x34dc807b6ef8e50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.499070:0:9616:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009caebc00/0x34dc807b6ef8e50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.499086:0:9616:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caebc00/0x34dc807b6ef8e50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.499203:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991509632:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 26677us (30413us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126999.499212:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8450 00010000:00010000:2.0:1746126999.505947:0:29588:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.505965:0:29588:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.505974:0:29588:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.505980:0:29588:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918b400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746126999.505984:0:29588:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.505991:0:29588:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.506012:0:29588:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.506018:0:29588:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918b400/0x34dc807b6ef8e49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.506156:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991509376:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 33961us (38817us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126999.506167:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8449 00010000:00010000:1.0:1746126999.510679:0:29586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.510702:0:29586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.510710:0:29586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.510717:0:29586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e981800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746126999.510720:0:29586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.510728:0:29586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.510746:0:29586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.510752:0:29586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e981800/0x34dc807b6ef8e57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.511398:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991509888:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 35993us (40469us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126999.511409:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8451 00010000:00010000:2.0:1746126999.513862:0:9618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.513865:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746126999.513874:0:9618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.513881:0:9618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.513888:0:9618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918a600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746126999.513892:0:9618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.513899:0:9618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.513904:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991510784 00000100:00100000:3.0:1746126999.513914:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991510784 00010000:00010000:2.0:1746126999.513917:0:9618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.513928:0:9618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6ef8e5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.513963:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6531 00000100:00100000:3.0:1746126999.513969:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b49dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4122:x1830945991510784:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746126999.513997:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991510144:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 38172us (40700us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126999.514006:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8452 00000100:00100000:3.0:1746126999.514406:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b49dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4122:x1830945991510784:12345-192.168.203.42@tcp:35:cat.0 Request processed in 436us (547us total) trans 8589938121 rc 0/0 00000100:00100000:3.0:1746126999.514412:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6531 00000100:00100000:0.0:1746126999.520768:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.521029:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991511040 00000100:00100000:2.0:1746126999.521039:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991511040 00000100:00100000:2.0:1746126999.521093:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17197 00000100:00100000:2.0:1746126999.521101:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4121:x1830945991511040:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746126999.521155:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.521172:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52885 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.521243:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521255:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521265:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521276:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521282:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521287:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521374:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521382:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521388:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:2.0:1746126999.521397:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746126999.521455:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521461:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521467:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521476:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746126999.521480:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521486:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521495:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.521498:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746126999.521502:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521507:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6ef8ea4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521559:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521564:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521567:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521571:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521574:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caebe00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746126999.521576:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521580:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521585:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746126999.521587:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126999.521589:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521593:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef8e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521599:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521603:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521607:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521612:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746126999.521613:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521617:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521622:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce14800) 00010000:00010000:2.0:1746126999.521624:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126999.521625:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521629:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeac00/0x34dc807b6ef8e9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746126999.521674:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8e8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52885 expref: 12 pid: 7260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.521903:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.521918:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991511168 00000100:00100000:0.0:1746126999.521921:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991511168 00000100:00100000:0.0:1746126999.521963:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17198 00000100:00100000:0.0:1746126999.521969:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4122:x1830945991511168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126999.521977:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.521984:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6ef8eb2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5288c expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.522024:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.522036:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.522043:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746126999.522045:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52885 expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.522056:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeba00, rc 0) 00000004:00200000:0.0:1746126999.522056:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746126999.522059:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746126999.522067:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.522091:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6ef8eb2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.522104:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.522110:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4121:x1830945991511040:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1011us (1353us total) trans 8589938122 rc 301/301 00010000:00010000:0.0:1746126999.522110:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126999.522112:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746126999.522113:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158400, rc 0) 00000100:00100000:2.0:1746126999.522117:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17197 00000100:00100000:0.0:1746126999.522127:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4122:x1830945991511168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 158us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.522152:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17198 00000100:00100000:0.0:1746126999.526808:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.526926:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991511424 00000100:00100000:3.0:1746126999.526936:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991511424 00000100:00100000:0.0:1746126999.527020:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.527067:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17199 00000100:00100000:3.0:1746126999.527088:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4112:x1830945991511424:12345-192.168.203.42@tcp:36:lfs.0 00000100:00100000:2.0:1746126999.527114:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991511552 00000100:00100000:2.0:1746126999.527118:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991511552 00000100:00100000:2.0:1746126999.527179:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21228 00000100:00100000:2.0:1746126999.527184:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991511552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746126999.527196:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.527212:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52893 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.527237:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.527239:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.527247:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 32 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.527263:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 32 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.527273:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb800, rc 0) 00000100:00100000:2.0:1746126999.527319:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991511552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 134us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.527325:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21228 00010000:00010000:3.0:1746126999.527448:0:10958:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.527468:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd000/0x34dc807b6ef8da8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52815 expref: 8 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.527494:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.527498:0:10958:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126999.527539:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746126999.527550:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.527557:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.527564:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 5/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746126999.527592:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.527603:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 11 pid: 13448 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.527616:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994194304:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.527823:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.527832:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 30 pid: 13448 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.527839:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994194432:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.527859:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.527939:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.527954:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991511680 00000100:00100000:1.0:1746126999.527958:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991511680 00000100:00100000:0.0:1746126999.527967:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.527989:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991511808 00000100:00100000:1.0:1746126999.527991:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991511808 00000100:00100000:1.0:1746126999.528004:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21229 00000100:00100000:1.0:1746126999.528010:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2027:x1830945991511680:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.528017:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126999.528017:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126999.528027:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5289a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.528032:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126999.528040:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.528042:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.528047:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 7 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126999.528053:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746126999.528056:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 7 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.528063:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e9c00, rc 0) 00000100:00100000:0.0:1746126999.528067:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991511936 00000100:00100000:0.0:1746126999.528069:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991511936 00000100:00100000:1.0:1746126999.528093:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2027:x1830945991511680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 83us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.528095:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991512064 00000100:00100000:0.0:1746126999.528097:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991512064 00000100:00100000:1.0:1746126999.528099:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21229 00000100:00100000:0.0:1746126999.528105:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991512192 00000100:00100000:0.0:1746126999.528107:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991512192 00000100:00100000:1.0:1746126999.528109:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21230 00000100:00100000:1.0:1746126999.528112:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991511808:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.528118:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126999.528118:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21231 00000100:00100000:0.0:1746126999.528122:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991511936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.528124:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528a1 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.528143:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.528149:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.528151:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.528151:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528a8 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.528155:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 8 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.528160:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.528161:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.528165:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.528167:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 8 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.528173:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.528174:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8e00, rc 0) 00010000:00010000:0.0:1746126999.528184:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159400, rc 0) 00000100:00100000:1.0:1746126999.528187:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991511808:12345-192.168.203.42@tcp:101:cat.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.528192:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21230 00000100:00100000:0.0:1746126999.528194:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991511936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.528198:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21231 00000100:00100000:1.0:1746126999.528201:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21232 00000100:00100000:1.0:1746126999.528204:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991512064:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746126999.528206:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21233 00010000:00010000:1.0:1746126999.528210:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.528216:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528af expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.528221:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991512192:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.528225:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.528225:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.528226:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.528229:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 34 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.528231:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528b6 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.528238:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 34 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.528238:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.528239:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.528242:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 8 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.528244:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8600, rc 0) 00010000:00010000:0.0:1746126999.528249:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 8 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.528255:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158800, rc 0) 00000100:00100000:1.0:1746126999.528257:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991512064:12345-192.168.203.42@tcp:101:cat.0 Request processed in 52us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.528261:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21232 00000100:00100000:0.0:1746126999.528265:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991512192:12345-192.168.203.42@tcp:101:cat.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.528269:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21233 00000100:00100000:0.0:1746126999.528813:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.528873:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991512448 00000100:00100000:2.0:1746126999.528877:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991512448 00000100:00100000:2.0:1746126999.528899:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17200 00000100:00100000:2.0:1746126999.528903:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4121:x1830945991512448:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746126999.528915:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.528917:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746126999.528924:0:13448:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 12 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.528937:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.528940:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.528946:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126999.528952:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeae00/0x34dc807b6ef8ef1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528bd expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.528982:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746126999.528990:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.528995:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.528999:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746126999.529010:0:13448:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.529024:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.529031:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 7 pid: 13448 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.529040:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994194560:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.529578:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cae40 going to sleep for 11 seconds 00010000:00010000:3.0:1746126999.531270:0:10958:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from blocking AST (req@ffff88012238f480 x1830945994194304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 13 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.531291:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6ef8eb9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5288c expref: 13 pid: 13448 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.531307:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994194304:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.531536:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994194432:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.531556:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.531561:0:10958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746126999.531570:0:10958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.531578:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00000100:00100000:2.0:1746126999.533484:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994194560:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.533524:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746126999.533592:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.533658:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991512576 00000100:00100000:2.0:1746126999.533665:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991512576 00010000:00010000:2.0:1746126999.533694:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 31 pid: 13448 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.533949:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9911 00000100:00100000:2.0:1746126999.533958:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991512576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.534119:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.534127:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 31 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.534165:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 31 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.534187:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6ef8db6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5281c expref: 31 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.534206:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.534211:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.534218:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.534225:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.534231:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746126999.534240:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.534358:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746126999.534602:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.534651:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991512576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 693us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.534658:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9911 00000100:00100000:1.0:1746126999.534808:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.534845:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991512832 00000100:00100000:0.0:1746126999.534849:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991512832 00000100:00100000:0.0:1746126999.534878:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17201 00000100:00100000:0.0:1746126999.534884:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4122:x1830945991512832:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126999.534900:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.534911:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528c4 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.534962:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991512704 00000100:00100000:2.0:1746126999.534965:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991512704 00010000:00010000:2.0:1746126999.534976:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 8 pid: 13448 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.534998:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9912 00000100:00100000:2.0:1746126999.535003:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2028:x1830945991512704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.535009:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.535013:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 8 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.535021:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 8 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.535033:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6ef8d9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5280e expref: 8 pid: 13448 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.535041:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.535045:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746126999.535053:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746126999.535057:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.535086:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2028:x1830945991512704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.535091:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9912 00010000:00010000:3.0:1746126999.535226:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746126999.535233:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00000004:00010000:3.0:1746126999.535342:0:10958:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cc3df80 reply state ffff8800a510a000 transno 8589938123 ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746126999.535351:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746126999.535356:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.535358:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126999.535360:0:10958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.535365:0:10958:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.535370:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746126999.535382:0:10958:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746126999.535438:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4112:x1830945991511424:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 8364us (8640us total) trans 8589938123 rc 0/0 00000100:00100000:3.0:1746126999.535443:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17199 00010000:00010000:2.0:1746126999.535529:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746126999.535534:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000040:00080000:2.0:1746126999.535734:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1344, 88 off125872 00000004:00080000:2.0:1746126999.535739:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894577609457ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.535973:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1368, 88 off128072 00000004:00080000:2.0:1746126999.535981:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894577851113ns, next at 895431202182ns, rc = 0 00010000:00010000:0.0:1746126999.536004:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746126999.536012:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 14 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.536024:0:7258:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.536049:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746126999.536087:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 14 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.536097:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126999.536099:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126999.536102:0:7258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 14 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.536108:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159600, rc 0) 00000040:00080000:2.0:1746126999.536200:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1369, 88 off128160 00000004:00080000:2.0:1746126999.536205:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894578075473ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746126999.536215:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1345, 88 off125960 00000004:00080000:2.0:1746126999.536218:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578088345ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536227:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1346, 88 off126048 00000004:00080000:2.0:1746126999.536230:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578100241ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536236:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1370, 88 off128248 00000004:00080000:2.0:1746126999.536239:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894578109705ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746126999.536246:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1371, 88 off128336 00000004:00080000:2.0:1746126999.536248:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894578118973ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746126999.536256:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1372, 88 off128424 00000004:00080000:2.0:1746126999.536259:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894578129473ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746126999.536271:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1347, 88 off126136 00000004:00080000:2.0:1746126999.536274:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578144428ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536280:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1373, 88 off128512 00000004:00080000:2.0:1746126999.536282:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894578152723ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746126999.536287:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1348, 88 off126224 00000004:00080000:2.0:1746126999.536289:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578160123ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536295:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1374, 88 off128600 00000004:00080000:2.0:1746126999.536298:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894578168345ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746126999.536304:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1349, 88 off126312 00000004:00080000:2.0:1746126999.536306:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578176976ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536313:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1350, 88 off126400 00000004:00080000:2.0:1746126999.536315:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578185930ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536321:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1351, 88 off126488 00000004:00080000:2.0:1746126999.536324:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578194301ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536331:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1352, 88 off126576 00000004:00080000:2.0:1746126999.536333:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894578203750ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746126999.536339:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1375, 88 off128688 00000004:00080000:2.0:1746126999.536342:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894578212351ns, next at 895431202182ns, rc = 0 00000100:00100000:1.0:1746126999.536457:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.536474:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991513088 00000100:00100000:1.0:1746126999.536477:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991513088 00002000:00100000:1.0:1746126999.536507:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009c749f80 x1830945991513088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.536516:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749f80 with x1830945991513088 ext(2097152->4194303) 00002000:00010000:1.0:1746126999.536521:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c749f80 00000100:00100000:1.0:1746126999.536539:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991513344 00000100:00100000:1.0:1746126999.536541:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991513344 00002000:00100000:1.0:1746126999.536554:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012cc9c000 x1830945991513344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.536560:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c000 with x1830945991513344 ext(2097152->4194303) 00002000:00010000:1.0:1746126999.536563:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9c000 00000100:00100000:1.0:1746126999.536574:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8453 00000100:00100000:0.0:1746126999.536578:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4122:x1830945991512832:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1694us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.536579:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991513088:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.536584:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17201 00000100:00100000:2.0:1746126999.536924:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8454 00000100:00100000:2.0:1746126999.536930:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991513344:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.537266:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.537278:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991513472 00000100:00100000:0.0:1746126999.537281:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991513472 00000100:00100000:0.0:1746126999.537297:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17202 00000100:00100000:0.0:1746126999.537301:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4112:x1830945991513472:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746126999.537313:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.537325:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528cb expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.537355:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528cb expref: 9 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.537363:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528cb expref: 9 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.537369:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746126999.537372:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746126999.537374:0:7260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 14 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.537379:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158600, rc 0) 00000100:00100000:0.0:1746126999.537398:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4112:x1830945991513472:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 96us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.537403:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17202 00000001:00080000:0.0:1746126999.541793:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938124 is committed 00000004:00080000:0.0:1746126999.541802:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1350 committed 00000004:00080000:0.0:1746126999.541823:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1327 committed 00000004:00080000:0.0:1746126999.541828:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1326 committed 00000004:00080000:0.0:1746126999.541830:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1325 committed 00000004:00080000:0.0:1746126999.541831:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1324 committed 00000004:00080000:0.0:1746126999.541833:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1349 committed 00000004:00080000:0.0:1746126999.541835:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1323 committed 00000004:00080000:0.0:1746126999.541836:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1348 committed 00000004:00080000:0.0:1746126999.541838:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1322 committed 00000004:00080000:0.0:1746126999.541839:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1347 committed 00000004:00080000:0.0:1746126999.541841:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1346 committed 00000004:00080000:0.0:1746126999.541842:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1345 committed 00000004:00080000:0.0:1746126999.541844:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1321 committed 00000004:00080000:0.0:1746126999.541845:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1320 committed 00000004:00080000:0.0:1746126999.541847:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1344 committed 00000004:00080000:0.0:1746126999.541848:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1343 committed 00000004:00080000:0.0:1746126999.541849:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1319 committed 00000001:00080000:0.0:1746126999.541868:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938123 is committed 00000001:00080000:0.0:1746126999.541887:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938120 is committed 00000004:00080000:0.0:1746126999.541895:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1342 committed 00010000:00010000:2.0:1746126999.541915:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.541928:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.541934:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.541941:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c36000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746126999.541945:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.541951:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.541969:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.541972:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746126999.541976:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.541980:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6ef8ec7 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746126999.542049:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.542055:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000100:00100000:1.0:1746126999.542056:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994195072:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746126999.542057:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746126999.542061:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.542070:0:13448:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.542084:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.542089:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528cb expref: 6 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.542095:0:13448:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528cb expref: 6 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.542100:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528cb expref: 6 pid: 7260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.542116:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746126999.542146:0:13448:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528cb expref: 6 pid: 7260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.542158:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994195712:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126999.542172:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994195584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.542178:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994194816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.542191:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126999.542201:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994194944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.542216:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126999.542227:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994195456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.542252:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.542266:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994196224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.542282:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126999.542282:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994196096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.542294:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994196736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.542295:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126999.542304:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994196608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.542306:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746126999.542315:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.542327:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994195072 00000100:00100000:1.0:1746126999.542332:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994195072 00000100:00100000:0.0:1746126999.542332:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994195584 00000100:00100000:0.0:1746126999.542334:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994195584 00000100:00100000:1.0:1746126999.542355:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994194944 00000100:00100000:1.0:1746126999.542357:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994194944 00000100:00100000:3.0:1746126999.542364:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994194688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746126999.542409:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.542433:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994195200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.542488:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994195456 00000100:00100000:0.0:1746126999.542489:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994196224 00000100:00100000:1.0:1746126999.542490:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994195456 00000100:00100000:0.0:1746126999.542491:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994196224 00000100:00100000:1.0:1746126999.542498:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994196096 00000100:00100000:1.0:1746126999.542499:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994196096 00000100:00100000:0.0:1746126999.542499:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994196736 00000100:00100000:0.0:1746126999.542500:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994196736 00000100:00100000:1.0:1746126999.542505:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994196608 00000100:00100000:0.0:1746126999.542505:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994194688 00000100:00100000:1.0:1746126999.542506:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994196608 00000100:00100000:0.0:1746126999.542507:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994194688 00000100:00100000:1.0:1746126999.542515:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21234 00000100:00100000:1.0:1746126999.542521:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3785:x1830945994195072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.542544:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21235 00000100:00100000:0.0:1746126999.542549:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3784:x1830945994194944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.542598:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21236 00000100:00100000:0.0:1746126999.542602:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3785:x1830945994195584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126999.542614:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746126999.542616:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126999.542618:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126999.542620:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746126999.542621:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:1.0:1746126999.542647:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3785:x1830945994195072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (532us total) trans 21474842789 rc 0/0 00002000:00010000:0.0:1746126999.542647:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:0.0:1746126999.542649:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126999.542651:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746126999.542653:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21234 00002000:00010000:0.0:1746126999.542653:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746126999.542655:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:1.0:1746126999.542665:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21237 00000100:00100000:1.0:1746126999.542669:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3784:x1830945994195456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.542670:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3785:x1830945994195584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (478us total) trans 21474842791 rc 0/0 00000100:00100000:0.0:1746126999.542675:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21236 00000100:00100000:0.0:1746126999.542683:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21238 00000100:00100000:0.0:1746126999.542687:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3785:x1830945994196224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.542696:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746126999.542703:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746126999.542704:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746126999.542706:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746126999.542707:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00000100:00100000:3.0:1746126999.542709:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994195840:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746126999.542709:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:1.0:1746126999.542732:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3784:x1830945994195456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (479us total) trans 21474842792 rc 0/0 00000100:00100000:3.0:1746126999.542733:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746126999.542733:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126999.542735:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126999.542737:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00000100:00100000:1.0:1746126999.542738:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21237 00002000:00010000:0.0:1746126999.542738:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746126999.542740:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746126999.542743:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994196352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.542746:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994195200 00000100:00100000:1.0:1746126999.542748:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994195200 00000100:00100000:1.0:1746126999.542755:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994195840 00000100:00100000:1.0:1746126999.542757:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994195840 00000100:00100000:0.0:1746126999.542759:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3785:x1830945994196224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (476us total) trans 17179875532 rc 0/0 00000100:00100000:3.0:1746126999.542760:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.542763:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994196352 00000100:00100000:1.0:1746126999.542764:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994196352 00000100:00100000:0.0:1746126999.542764:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21238 00000100:00100000:1.0:1746126999.542770:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21239 00000100:00100000:3.0:1746126999.542772:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746126999.542773:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21240 00000100:00100000:1.0:1746126999.542774:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3784:x1830945994196096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.542776:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3785:x1830945994196736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.542777:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994195968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.542788:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746126999.542794:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994196480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.542804:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.542807:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994195968 00000100:00100000:1.0:1746126999.542810:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994195968 00000100:00100000:1.0:1746126999.542819:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994196480 00000100:00100000:1.0:1746126999.542821:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994196480 00000100:00100000:0.0:1746126999.542825:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994196736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (518us total) trans 17179875534 rc 0/0 00000100:00100000:3.0:1746126999.542830:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21241 00000100:00100000:1.0:1746126999.542835:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21242 00000100:00100000:1.0:1746126999.542839:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3782:x1830945994194688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.542841:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21240 00000100:00100000:0.0:1746126999.542849:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21243 00000100:00100000:0.0:1746126999.542852:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3782:x1830945994195200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126999.542875:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126999.542877:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.542879:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.542880:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.542882:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:1.0:1746126999.542901:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3782:x1830945994194688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (496us total) trans 21474842793 rc 0/0 00000100:00100000:1.0:1746126999.542906:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21242 00000100:00100000:0.0:1746126999.542909:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3782:x1830945994195200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (213us total) trans 21474842794 rc 0/0 00000100:00100000:0.0:1746126999.542914:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21243 00000100:00100000:1.0:1746126999.542916:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21244 00000100:00100000:1.0:1746126999.542920:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994195840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.542921:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21245 00000100:00100000:0.0:1746126999.542925:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994196352:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746126999.542946:0:13448:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746126999.542955:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746126999.542956:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994196864:192.168.203.42@tcp:105: 00002000:00010000:1.0:1746126999.542957:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.542959:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.542960:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.542962:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126999.542979:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3782:x1830945994196352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (218us total) trans 17179875536 rc 0/0 00000100:00100000:1.0:1746126999.542981:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3782:x1830945994195840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (248us total) trans 17179875535 rc 0/0 00000100:00100000:0.0:1746126999.542984:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21245 00000100:00100000:1.0:1746126999.542986:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21244 00000100:00100000:0.0:1746126999.542992:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21246 00000100:00100000:1.0:1746126999.542994:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21247 00000100:00100000:0.0:1746126999.542996:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994195968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746126999.542998:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994196480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746126999.543027:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126999.543029:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:0.0:1746126999.543031:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746126996 -> 1746126996 00002000:00010000:0.0:1746126999.543032:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126997 -> 1746126997 00002000:00010000:0.0:1746126999.543034:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746126999.543040:0:3785:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875529 gen 2 00000004:00080000:1.0:1746126999.543044:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099196300, transno 17179875468 00000004:00080000:1.0:1746126999.543049:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099195500, transno 17179875469 00000100:00100000:0.0:1746126999.543050:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3782:x1830945994195968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (261us total) trans 17179875537 rc 0/0 00000004:00080000:1.0:1746126999.543051:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099197100, transno 17179875470 00000004:00080000:1.0:1746126999.543053:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099194000, transno 17179875471 00000004:00080000:1.0:1746126999.543055:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099197b80, transno 17179875472 00000100:00100000:0.0:1746126999.543055:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21246 00000004:00080000:1.0:1746126999.543057:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee8e00, transno 17179875473 00000004:00080000:1.0:1746126999.543059:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099195180, transno 17179875474 00000004:00080000:1.0:1746126999.543061:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099194e00, transno 17179875475 00000004:00080000:1.0:1746126999.543063:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd65c00, transno 17179875476 00000004:00080000:1.0:1746126999.543065:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd65500, transno 17179875477 00000004:00080000:1.0:1746126999.543067:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0ea00, transno 17179875478 00000004:00080000:1.0:1746126999.543069:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0c700, transno 17179875479 00000004:00080000:1.0:1746126999.543070:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd67800, transno 17179875480 00000004:00080000:1.0:1746126999.543072:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0dc00, transno 17179875481 00000004:00080000:1.0:1746126999.543087:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0ed80, transno 17179875482 00000004:00080000:1.0:1746126999.543090:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd64000, transno 17179875483 00000004:00080000:1.0:1746126999.543092:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a1789880, transno 17179875491 00000004:00080000:1.0:1746126999.543094:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fc9500, transno 17179875492 00000004:00080000:1.0:1746126999.543096:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a178b100, transno 17179875493 00000004:00080000:0.0:1746126999.543097:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9d880/2, rc 0, transno 21474842792 00000004:00080000:1.0:1746126999.543098:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a1789180, transno 17179875494 00000004:00080000:1.0:1746126999.543100:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a1789c00, transno 17179875495 00000004:00080000:1.0:1746126999.543102:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a1788a80, transno 17179875496 00000004:00080000:1.0:1746126999.543104:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fcb480, transno 17179875497 00000100:00100000:0.0:1746126999.543105:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994195456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.543106:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fca680, transno 17179875498 00000004:00080000:1.0:1746126999.543108:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fc9c00, transno 17179875499 00000004:00080000:1.0:1746126999.543111:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f14700, transno 17179875500 00000004:00080000:1.0:1746126999.543113:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fc8380, transno 17179875501 00000100:00100000:2.0:1746126999.543114:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000004:00080000:1.0:1746126999.543115:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009da76d80, transno 17179875502 00000100:00100000:0.0:1746126999.543115:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746126999.543117:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fc8a80, transno 17179875503 00000004:00080000:1.0:1746126999.543119:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f14000, transno 17179875504 00000004:00080000:1.0:1746126999.543121:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009da74380, transno 17179875505 00000004:00080000:1.0:1746126999.543123:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f14380, transno 17179875506 00000004:00080000:1.0:1746126999.543125:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cd880, transno 17179875523 00000100:00100000:0.0:1746126999.543126:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994195328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.543127:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cce00, transno 17179875524 00000004:00080000:1.0:1746126999.543144:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cdf80, transno 17179875525 00000004:00080000:1.0:1746126999.543146:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d1b7100, transno 17179875526 00000004:00080000:1.0:1746126999.543149:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ec7a300, transno 17179875527 00000004:00080000:1.0:1746126999.543150:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d1b6300, transno 17179875528 00000004:00080000:1.0:1746126999.543152:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cf100, transno 17179875529 00000100:00100000:1.0:1746126999.543157:0:3785:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009d1b7480 x1830945994193152/t17179875530(17179875530) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127015 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746126999.543165:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9f100/2, rc 0, transno 17179875532 00000100:00100000:1.0:1746126999.543168:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994196224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.543169:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746126999.543177:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800997d8000/2, rc 0, transno 17179875534 00000100:00100000:1.0:1746126999.543180:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994196736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746126999.543186:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9ce00/2, rc 0, transno 21474842789 00000100:00100000:0.0:1746126999.543186:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994194816 00000100:00100000:0.0:1746126999.543188:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994194816 00000100:00100000:1.0:1746126999.543189:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994195072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.543195:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9dc00/2, rc 0, transno 21474842791 00000100:00100000:1.0:1746126999.543197:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994195584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.543199:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994195328 00000100:00100000:0.0:1746126999.543201:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994195328 00000100:00100000:0.0:1746126999.543208:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21248 00000100:00100000:0.0:1746126999.543212:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3783:x1830945994194816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746126999.543249:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126999.543251:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746126996 -> 1746126996 00002000:00010000:0.0:1746126999.543253:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746126996 -> 1746126996 00002000:00010000:0.0:1746126999.543254:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746126996 -> 1746126996 00002000:00010000:0.0:1746126999.543256:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746126999.543274:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3783:x1830945994194816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (158us total) trans 21474842795 rc 0/0 00000100:00100000:0.0:1746126999.543278:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21248 00000100:00100000:0.0:1746126999.543285:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21249 00000100:00100000:0.0:1746126999.543289:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3783:x1830945994195328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746126999.543329:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3783:x1830945994195328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (159us total) trans 21474842796 rc 0/0 00000100:00100000:0.0:1746126999.543333:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21249 00000004:00080000:0.0:1746126999.543352:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9c700/2, rc 0, transno 21474842795 00000100:00100000:0.0:1746126999.543355:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994194816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746126999.543361:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9d500/2, rc 0, transno 21474842796 00000100:00100000:0.0:1746126999.543363:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994195328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.543377:0:8233:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 9 in progress, 6 in flight, 39 done 00000100:00100000:0.0:1746126999.543385:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746126999.543389:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994196992:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126999.543394:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:1.0:1746126999.543396:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.543398:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.543399:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.543401:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746126999.543404:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746126999.543417:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3784:x1830945994194944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 868us (1200us total) trans 21474842790 rc 0/0 00000100:00100000:0.0:1746126999.543419:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994196992 00000100:00100000:0.0:1746126999.543421:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994196992 00000100:00100000:1.0:1746126999.543422:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21235 00000100:00100000:1.0:1746126999.543430:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21250 00000100:00100000:1.0:1746126999.543434:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3783:x1830945994196992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746126999.543480:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3783:x1830945994196992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (74us total) trans 21474842797 rc 0/0 00000100:00100000:1.0:1746126999.543485:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21250 00000004:00080000:0.0:1746126999.543493:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095ca8e00/2, rc 0, transno 21474842797 00000100:00100000:0.0:1746126999.543497:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994196992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746126999.543500:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9ca80/2, rc 0, transno 21474842790 00000100:00100000:1.0:1746126999.543502:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994194944:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746126999.543521:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746126999.543523:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.543525:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.543526:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.543528:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:0.0:1746126999.543529:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746126999.543530:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126999.543532:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746126999.543533:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746126999.543535:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:1.0:1746126999.543545:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3784:x1830945994196096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 771us (1249us total) trans 17179875533 rc 0/0 00000100:00100000:0.0:1746126999.543550:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3782:x1830945994196480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 552us (745us total) trans 17179875538 rc 0/0 00000100:00100000:1.0:1746126999.543551:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21239 00000100:00100000:0.0:1746126999.543554:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21247 00000004:00080000:1.0:1746126999.543567:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9ed80/2, rc 0, transno 17179875533 00000100:00100000:1.0:1746126999.543570:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994196096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.543657:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3784:x1830945994196608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746126999.543967:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3784:x1830945994196608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1130us (1649us total) trans 17179875539 rc 0/0 00000100:00100000:3.0:1746126999.543974:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21241 00000004:00080000:1.0:1746126999.544019:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9fb80/2, rc 0, transno 17179875539 00000100:00100000:1.0:1746126999.544022:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994196608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126999.544752:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9ea00/2, rc 0, transno 17179875537 00000100:00100000:3.0:1746126999.544757:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994195968:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126999.544764:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9f800/2, rc 0, transno 17179875538 00000100:00100000:3.0:1746126999.544766:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994196480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126999.544773:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9c380/2, rc 0, transno 21474842793 00000100:00100000:3.0:1746126999.544775:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994194688:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126999.544781:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9d180/2, rc 0, transno 21474842794 00000100:00100000:3.0:1746126999.544783:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994195200:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746126999.544788:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9e680/2, rc 0, transno 17179875535 00000100:00100000:3.0:1746126999.544790:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994195840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746126999.544795:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9f480/2, rc 0, transno 17179875536 00000100:00100000:3.0:1746126999.544797:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994196352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746126999.551337:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.551380:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994195712:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.551383:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991513600 00000100:00100000:3.0:1746126999.551390:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991513600 00000100:00100000:2.0:1746126999.551397:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994196864:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.551434:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6532 00000100:00100000:3.0:1746126999.551441:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4112:x1830945991513600:12345-192.168.203.42@tcp:49:lfs.0 00010000:00010000:2.0:1746126999.551465:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeae00/0x34dc807b6ef8ef1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 11 pid: 13448 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746126999.551512:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.551530:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4112:x1830945991513600:12345-192.168.203.42@tcp:49:lfs.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.551536:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6532 00010000:00010000:2.0:1746126999.551541:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caebc00, rc 0) 00000100:00100000:2.0:1746126999.551582:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4121:x1830945991512448:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 22677us (22769us total) trans 8589938124 rc 0/0 00000100:00100000:2.0:1746126999.551591:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17200 00000100:00100000:0.0:1746126999.552301:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.552340:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991513728 00000100:00100000:1.0:1746126999.552345:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991513728 00000100:00100000:1.0:1746126999.552376:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6533 00000100:00100000:1.0:1746126999.552381:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4122:x1830945991513728:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:1.0:1746126999.552445:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4122:x1830945991513728:12345-192.168.203.42@tcp:49:cat.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.552451:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6533 00000100:00100000:2.0:1746126999.552495:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991513088:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15913us (16444us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746126999.552504:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8453 00002000:00100000:2.0:1746126999.552513:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009c749f80 x1830945991513088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.552523:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749f80 with x1830945991513088 ext(2097152->4194303) 00002000:00010000:2.0:1746126999.552528:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c749f80 00000100:00100000:0.0:1746126999.560893:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.560946:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.560977:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991513984 00000100:00100000:0.0:1746126999.560981:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991513856 00000100:00100000:3.0:1746126999.560988:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991513984 00000100:00100000:0.0:1746126999.560988:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991513856 00000100:00100000:0.0:1746126999.561033:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6534 00000100:00100000:0.0:1746126999.561040:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4121:x1830945991513856:12345-192.168.203.42@tcp:49:multiop.0 00000100:00100000:3.0:1746126999.561151:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21251 00000100:00100000:3.0:1746126999.561160:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4112:x1830945991513984:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126999.561174:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126999.561180:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4121:x1830945991513856:12345-192.168.203.42@tcp:49:multiop.0 Request processed in 139us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.561186:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991513344:12345-192.168.203.42@tcp:3:cat.0 Request processed in 24255us (24728us total) trans 0 rc 2097152/2097152 00010000:00010000:3.0:1746126999.561188:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528d2 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.561188:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6534 00000100:00100000:2.0:1746126999.561195:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8454 00002000:00100000:2.0:1746126999.561204:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012cc9c000 x1830945991513344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746126999.561209:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746126999.561213:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c000 with x1830945991513344 ext(2097152->4194303) 00010000:00010000:3.0:1746126999.561218:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 33 pid: 9613 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746126999.561218:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9c000 00010000:00010000:3.0:1746126999.561337:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 40 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.561344:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.561346:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.561349:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 13 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.561374:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 40 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.561384:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 40 pid: 9611 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.561393:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197120:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.561464:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 33 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.561472:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 33 pid: 9613 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.561479:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197248:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.561499:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.561506:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 13 pid: 3148 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.561512:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197376:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.561524:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.562071:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.562213:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991514112 00000100:00100000:2.0:1746126999.562217:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991514112 00000100:00100000:2.0:1746126999.562242:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17203 00000100:00100000:2.0:1746126999.562248:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4119:x1830945991514112:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746126999.562258:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.562272:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528d9 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.562309:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.562322:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.562343:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.562346:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126999.562348:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caea800, rc 0) 00000100:00100000:2.0:1746126999.563018:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4119:x1830945991514112:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 767us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.563024:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17203 00000100:00100000:0.0:1746126999.563059:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.563431:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197120:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.563440:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197248:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.563448:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197376:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.563470:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 13 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.563482:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f560a00, rc 0) 00000100:00100000:2.0:1746126999.563515:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4112:x1830945991513984:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2357us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.563521:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21251 00000100:00100000:2.0:1746126999.563535:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991514240 00000100:00100000:2.0:1746126999.563538:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991514240 00000100:00100000:2.0:1746126999.563555:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21252 00000100:00100000:2.0:1746126999.563560:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+34:4121:x1830945991514240:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746126999.563568:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.563577:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528e0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.563592:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096642e00/0x34dc807b6ef8de0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5283f expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.563599:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 35 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.563605:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef8e03 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52869 expref: 40 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.563610:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.563611:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.563614:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3342336->3444735] (req 3342336->3444735) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 35 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.563635:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef8e03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52869 expref: 40 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.563645:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef8e03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52869 expref: 40 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.563655:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197504:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.563697:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 35 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.563705:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 35 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.563713:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197632:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.564832:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096642e00/0x34dc807b6ef8de0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5283f expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.564842:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096642e00/0x34dc807b6ef8de0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5283f expref: 12 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.564851:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197760:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.564873:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.565086:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.565309:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991514368 00000100:00100000:3.0:1746126999.565314:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991514368 00010000:00010000:3.0:1746126999.565338:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 13 pid: 3148 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.565366:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9913 00000100:00100000:3.0:1746126999.565373:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991514368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.565382:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.565400:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 13 pid: 3148 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.565413:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 13 pid: 3148 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.565431:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef8dd2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52823 expref: 13 pid: 3148 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.565446:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.565479:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991514368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 106us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.565485:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9913 00000100:00100000:0.0:1746126999.567530:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.567588:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991514496 00000100:00100000:3.0:1746126999.567594:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991514496 00010000:00010000:3.0:1746126999.567619:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 41 pid: 9611 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.567642:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9914 00000100:00100000:3.0:1746126999.567649:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991514496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.567658:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.567673:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 41 pid: 9611 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.567683:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 41 pid: 9611 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.567692:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197504:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.567700:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5e00/0x34dc807b6ef8de7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5284d expref: 41 pid: 9611 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.567703:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197632:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.567718:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.567760:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991514496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 111us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.567767:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9914 00000100:00100000:2.0:1746126999.568437:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994197760:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.568500:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3342336->3444735] (req 3342336->3444735) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 35 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.568511:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeba00, rc 0) 00000100:00100000:2.0:1746126999.568546:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+35:4121:x1830945991514240:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4985us (5487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.568553:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21252 00000100:00100000:1.0:1746126999.571707:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.571739:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.571754:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.571932:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991514880 00000100:00100000:3.0:1746126999.571943:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991514880 00000100:00100000:3.0:1746126999.571992:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17204 00000100:00100000:3.0:1746126999.572000:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4115:x1830945991514880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.572017:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.572035:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef8f22 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528e7 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.572118:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.572213:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.572229:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.572248:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.572331:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991514624 00000100:00100000:3.0:1746126999.572335:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991514624 00010000:00010000:3.0:1746126999.572353:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 35 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.572375:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991514752 00000100:00100000:3.0:1746126999.572377:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991514752 00010000:00010000:3.0:1746126999.572385:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096642e00/0x34dc807b6ef8de0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5283f expref: 12 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.572390:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991515008 00000100:00100000:0.0:1746126999.572395:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991515008 00000100:00100000:3.0:1746126999.572398:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9915 00000100:00100000:3.0:1746126999.572403:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2027:x1830945991514624:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.572411:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef8e03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52869 expref: 40 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.572415:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746126999.572422:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9916 00000100:00100000:2.0:1746126999.572431:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991514752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.572433:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 35 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.572437:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9917 00010000:00010000:2.0:1746126999.572438:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746126999.572443:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991515008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.572444:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 35 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.572450:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.572578:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096642e00/0x34dc807b6ef8de0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5283f expref: 12 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.572592:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096642e00/0x34dc807b6ef8de0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5283f expref: 12 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.572594:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8ee3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528af expref: 35 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.572604:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642e00/0x34dc807b6ef8de0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5283f expref: 12 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.572610:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.572657:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991514624:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 254us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.572665:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9915 00000100:00100000:3.0:1746126999.572689:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991515264 00000100:00100000:3.0:1746126999.572692:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991515264 00010000:00010000:0.0:1746126999.572750:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef8e03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52869 expref: 40 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.572755:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746126999.572758:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef8e03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52869 expref: 40 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.572771:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef8e03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52869 expref: 40 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.572783:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.572785:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746126999.572790:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800997d9c00 x1830945991515264/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746126999.572792:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.572798:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746126999.572799:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9c00 with x1830945991515264 ext(0->1048575) 00010000:00010000:3.0:1746126999.572805:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.572816:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00002000:00010000:3.0:1746126999.572821:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800997d9c00 00010000:00010000:0.0:1746126999.572828:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.572835:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991515520 00000100:00100000:3.0:1746126999.572837:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991515520 00000100:00100000:0.0:1746126999.572840:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095caad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994197888:192.168.203.42@tcp:105: 00002000:00100000:3.0:1746126999.572851:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800997d9f80 x1830945991515520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.572863:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9f80 with x1830945991515520 ext(1048576->2097151) 00002000:00010000:3.0:1746126999.572866:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d9f80 00000100:00100000:3.0:1746126999.572875:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991515648 00000100:00100000:3.0:1746126999.572877:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991515648 00002000:00100000:3.0:1746126999.572885:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800997da300 x1830945991515648/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.572891:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997da300 with x1830945991515648 ext(1048576->2097151) 00002000:00010000:3.0:1746126999.572893:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997da300 00000100:00100000:3.0:1746126999.572902:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1847 00000100:00100000:3.0:1746126999.572906:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991515264:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746126999.572921:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991514752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 491us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.572926:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9916 00000100:00100000:2.0:1746126999.572946:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8455 00000100:00100000:2.0:1746126999.572951:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991515520:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.572993:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8456 00000100:00100000:1.0:1746126999.572998:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991515648:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.573035:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.573744:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.573758:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991516032 00000100:00100000:0.0:1746126999.573761:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991516032 00002000:00100000:0.0:1746126999.573777:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880095cab100 x1830945991516032/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.573784:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab100 with x1830945991516032 ext(1048576->2097151) 00002000:00010000:0.0:1746126999.573788:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab100 00000100:00100000:0.0:1746126999.573798:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8457 00000100:00100000:0.0:1746126999.573803:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991516032:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746126999.574550:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef8f22 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e7 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.574565:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef8f22 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e7 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.574583:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.574585:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746126999.574589:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f560600, rc 0) 00000100:00100000:2.0:1746126999.574610:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4115:x1830945991514880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2611us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.574616:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17204 00000100:00100000:0.0:1746126999.578880:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.578946:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095caad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994197888:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126999.578969:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.579010:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991515008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6566us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.579021:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9917 00000100:00100000:3.0:1746126999.579267:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991516288 00000100:00100000:3.0:1746126999.579275:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991516288 00002000:00100000:3.0:1746126999.579313:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (3342336->3346431) req@ffff880095cab480 x1830945991516288/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.579322:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab480 with x1830945991516288 ext(3342336->3346431) 00002000:00010000:3.0:1746126999.579327:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab480 00000100:00100000:3.0:1746126999.579343:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8458 00000100:00100000:3.0:1746126999.579350:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+38:2029:x1830945991516288:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746126999.579464:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+38:2029:x1830945991516288:12345-192.168.203.42@tcp:3:cat.0 Request processed in 114us (595us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746126999.579469:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8458 00002000:00100000:3.0:1746126999.579474:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (3342336->3346431) req@ffff880095cab480 x1830945991516288/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.579486:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab480 with x1830945991516288 ext(3342336->3346431) 00002000:00010000:3.0:1746126999.579489:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab480 00000100:00100000:2.0:1746126999.584346:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.584404:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991516416 00000100:00100000:3.0:1746126999.584414:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991516416 00000100:00100000:3.0:1746126999.584471:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21253 00000100:00100000:3.0:1746126999.584478:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4119:x1830945991516416:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746126999.584496:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746126999.584499:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2026:x1830945991516032:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10695us (10755us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746126999.584513:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528ee expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.584520:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8457 00002000:00100000:0.0:1746126999.584529:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880095cab100 x1830945991516032/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.584538:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab100 with x1830945991516032 ext(1048576->2097151) 00010000:00010000:3.0:1746126999.584541:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 36 pid: 12340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746126999.584542:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab100 00010000:00010000:3.0:1746126999.584548:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126999.584550:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126999.584552:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.584739:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 35 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.584750:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 35 pid: 12340 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.584762:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994198016:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.584815:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.588893:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994198016:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.588926:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991515520:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15967us (16687us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746126999.588929:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.588937:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8455 00002000:00100000:0.0:1746126999.588946:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800997d9f80 x1830945991515520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746126999.588948:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f561600, rc 0) 00002000:00100000:0.0:1746126999.588955:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9f80 with x1830945991515520 ext(1048576->2097151) 00002000:00010000:0.0:1746126999.588960:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d9f80 00000100:00100000:3.0:1746126999.588987:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4119:x1830945991516416:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4508us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.588994:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21253 00000100:00100000:0.0:1746126999.589021:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991515264:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16113us (16806us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126999.589026:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1847 00002000:00100000:0.0:1746126999.589030:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800997d9c00 x1830945991515264/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.589036:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9c00 with x1830945991515264 ext(0->1048575) 00010000:00010000:0.0:1746126999.589042:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.589054:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00002000:00010000:0.0:1746126999.589059:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800997d9c00 00000100:00100000:0.0:1746126999.593312:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.594283:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.594313:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991516800 00000100:00100000:0.0:1746126999.594322:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991516800 00002000:00100000:0.0:1746126999.594368:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff880095cab800 x1830945991516800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.594378:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab800 with x1830945991516800 ext(2097152->3145727) 00002000:00010000:0.0:1746126999.594384:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cab800 00000100:00100000:0.0:1746126999.594405:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8459 00000100:00100000:0.0:1746126999.594412:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991516800:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.594994:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991515648:12345-192.168.203.42@tcp:3:cat.0 Request processed in 21992us (22741us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126999.595005:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8456 00002000:00100000:1.0:1746126999.595012:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800997da300 x1830945991515648/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.595019:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997da300 with x1830945991515648 ext(1048576->2097151) 00002000:00010000:1.0:1746126999.595023:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997da300 00000100:00100000:2.0:1746126999.595270:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991516544 00000100:00100000:2.0:1746126999.595275:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991516544 00000100:00100000:2.0:1746126999.595306:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1011 00000100:00100000:2.0:1746126999.595311:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991516544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.595322:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.595345:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f560600/0x34dc807b6ef8f22 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e7 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.595365:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746126999.595369:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.595387:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991516544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.595394:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1011 00000100:00100000:2.0:1746126999.596809:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.596861:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991517056 00000100:00100000:0.0:1746126999.596867:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991517056 00002000:00100000:0.0:1746126999.596899:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (3440640->3444735) req@ffff880095c06d80 x1830945991517056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.596907:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06d80 with x1830945991517056 ext(3440640->3444735) 00010000:00010000:0.0:1746126999.596916:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.596927:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126999.596933:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c06d80 00000100:00100000:0.0:1746126999.597309:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1848 00000100:00100000:0.0:1746126999.597318:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991517056:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.597459:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991517056:12345-192.168.203.42@tcp:3:cat.0 Request processed in 142us (653us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126999.597468:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1848 00002000:00100000:0.0:1746126999.597474:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (3440640->3444735) req@ffff880095c06d80 x1830945991517056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.597481:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06d80 with x1830945991517056 ext(3440640->3444735) 00010000:00010000:0.0:1746126999.597486:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.597494:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126999.597500:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c06d80 00000100:00100000:0.0:1746126999.602851:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991516800:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8427us (8558us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746126999.602864:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8459 00002000:00100000:0.0:1746126999.602875:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff880095cab800 x1830945991516800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.602885:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab800 with x1830945991516800 ext(2097152->3145727) 00002000:00010000:0.0:1746126999.602890:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cab800 00000100:00100000:0.0:1746126999.609529:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.609581:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.609603:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991517440 00000100:00100000:2.0:1746126999.609613:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991517440 00000100:00100000:0.0:1746126999.609635:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.609642:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991517696 00000100:00100000:3.0:1746126999.609647:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991517696 00010000:00010000:3.0:1746126999.609674:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.609880:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6535 00000100:00100000:2.0:1746126999.609890:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4121:x1830945991517440:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746126999.609902:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9918 00000100:00100000:3.0:1746126999.609908:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991517696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.609920:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.609941:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.609951:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.609972:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef8ec0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52893 expref: 34 pid: 9613 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.610019:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.610021:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.610030:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 10 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.610034:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991517568 00010000:00010000:3.0:1746126999.610038:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 10 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.610038:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991517568 00010000:00010000:3.0:1746126999.610070:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 10 pid: 12340 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746126999.610071:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3342336->3444735) req@ffff880095ca8000 x1830945991517568/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746126999.610089:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994198144:192.168.203.42@tcp:105: 00002000:00100000:1.0:1746126999.610089:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8000 with x1830945991517568 ext(3342336->3444735) 00010000:00010000:1.0:1746126999.610096:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.610164:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746126999.610176:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8000 00000100:00100000:1.0:1746126999.610191:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1849 00000100:00100000:1.0:1746126999.610201:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991517568:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746126999.610339:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4121:x1830945991517440:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 449us (820us total) trans 8589938125 rc 0/0 00000100:00100000:2.0:1746126999.610346:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6535 00000100:00100000:3.0:1746126999.611277:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.612174:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.612354:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991517824 00000100:00100000:3.0:1746126999.612359:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991517824 00000100:00100000:3.0:1746126999.612403:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21254 00000100:00100000:3.0:1746126999.612410:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+36:4122:x1830945991517824:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.612424:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.612439:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528f5 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.612462:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126999.612467:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.612473:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126999.612477:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 37 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.612506:0:12340:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.612517:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 37 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.612527:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f561800, rc 0) 00000100:00100000:3.0:1746126999.613220:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+37:4122:x1830945991517824:12345-192.168.203.42@tcp:101:cat.0 Request processed in 808us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.613226:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21254 00000100:00100000:3.0:1746126999.614267:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994198144:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.614281:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.614888:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2027:x1830945991517696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4978us (5304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.614898:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9918 00000100:00100000:1.0:1746126999.615091:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.615328:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.615575:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991517952 00000100:00100000:1.0:1746126999.615580:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991517952 00000100:00100000:1.0:1746126999.615619:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991518080 00000100:00100000:1.0:1746126999.615621:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991518080 00000100:00100000:1.0:1746126999.615639:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21255 00000100:00100000:1.0:1746126999.615646:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4112:x1830945991517952:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126999.615660:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.615674:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e528fc expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.615700:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.615708:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 7 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.615715:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6ef8df5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52854 expref: 27 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.615721:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.615722:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.615725:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 12 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.615736:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21256 00010000:00010000:1.0:1746126999.615746:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6ef8df5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52854 expref: 27 pid: 9612 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746126999.615749:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4115:x1830945991518080:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.615757:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6ef8df5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52854 expref: 27 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.615766:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126999.615768:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994198400:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.615778:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52903 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.615826:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 7 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.615830:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126999.615833:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126999.615834:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 7 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.615837:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 41 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.615842:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994198528:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.615847:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 41 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.615857:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45600, rc 0) 00010000:00010000:1.0:1746126999.615862:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.615869:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 12 pid: 3148 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.615876:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994198656:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.615893:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.615898:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4115:x1830945991518080:12345-192.168.203.42@tcp:101:cat.0 Request processed in 152us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.615904:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21256 00000100:00100000:0.0:1746126999.616063:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2028:x1830945991517568:12345-192.168.203.42@tcp:4:cat.0 Request processed in 5861us (6427us total) trans 21474842798 rc 0/0 00000100:00100000:0.0:1746126999.616071:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1849 00002000:00100000:0.0:1746126999.616093:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3342336->3444735) req@ffff880095ca8000 x1830945991517568/t21474842798(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/448 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.616101:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8000 with x1830945991517568 ext(3342336->3444735) 00010000:00010000:0.0:1746126999.616106:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 36 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.616115:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 36 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126999.616121:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8000 00000100:00100000:1.0:1746126999.620156:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994198400:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.620168:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994198528:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.620175:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994198656:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.620200:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 12 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.620213:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914a800, rc 0) 00000100:00100000:1.0:1746126999.620246:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4112:x1830945991517952:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4599us (5155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.620253:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21255 00000100:00100000:0.0:1746126999.620480:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.620672:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.620693:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.620854:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991518336 00000100:00100000:3.0:1746126999.620865:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991518336 00010000:00010000:3.0:1746126999.620898:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 12 pid: 3148 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.620927:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991518208 00000100:00100000:3.0:1746126999.620930:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991518208 00010000:00010000:3.0:1746126999.620938:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6ef8df5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52854 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.620956:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991518464 00000100:00100000:1.0:1746126999.620961:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991518464 00010000:00010000:1.0:1746126999.620981:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 36 pid: 12340 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.621004:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9919 00000100:00100000:1.0:1746126999.621010:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991518336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.621019:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.621035:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 12 pid: 3148 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.621044:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 12 pid: 3148 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.621062:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4400/0x34dc807b6ef8dbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5282a expref: 12 pid: 3148 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.621093:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.621113:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991518336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 103us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.621118:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9919 00000100:00100000:1.0:1746126999.621147:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9920 00000100:00100000:1.0:1746126999.621151:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2028:x1830945991518464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.621158:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746126999.621167:0:7247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746126997 -> 1746126998 00002000:00010000:1.0:1746126999.621170:0:7247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746126997 -> 1746126998 00010000:00010000:1.0:1746126999.621174:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 36 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.621181:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 36 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.621192:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeba00/0x34dc807b6ef8f1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3342336->3444735) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528e0 expref: 36 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.621213:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.621214:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.621220:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.621226:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.621248:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.621260:0:7247:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 40 pid: 12340 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.621269:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994198784:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126999.621309:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.621365:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.621379:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991518592 00000100:00100000:3.0:1746126999.621382:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991518592 00010000:00010000:3.0:1746126999.621396:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 8 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:3.0:1746126999.621413:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9921 00000100:00100000:3.0:1746126999.621418:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991518208:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126999.621428:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9922 00010000:00010000:3.0:1746126999.621429:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746126999.621434:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991518592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.621443:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.621444:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6ef8df5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52854 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.621452:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 8 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.621453:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6ef8df5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52854 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.621461:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 8 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.621480:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6ef8df5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52854 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.621485:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9c00/0x34dc807b6ef8ece lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5289a expref: 8 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.621492:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.621494:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.621499:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 10 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.621506:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 10 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.621514:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126999.621531:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 10 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.621540:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994198912:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126999.621543:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2027:x1830945991518592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 108us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.621549:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9922 00000100:00100000:3.0:1746126999.621583:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.623589:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994198784:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126999.623604:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.623637:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991518464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2484us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.623644:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9920 00000100:00100000:3.0:1746126999.623852:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994198912:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.623863:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.623879:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991518208:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2460us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.623884:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9921 00000100:00100000:3.0:1746126999.624492:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.624517:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.624546:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991518848 00000100:00100000:0.0:1746126999.624552:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991518848 00002000:00100000:0.0:1746126999.624579:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2924544->2928639) req@ffff88012238ea00 x1830945991518848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.624587:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238ea00 with x1830945991518848 ext(2924544->2928639) 00010000:00010000:0.0:1746126999.624594:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 41 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.624604:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 41 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126999.624609:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238ea00 00000100:00100000:1.0:1746126999.624722:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991518976 00000100:00100000:1.0:1746126999.624725:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991518976 00000100:00100000:0.0:1746126999.624796:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1850 00000100:00100000:0.0:1746126999.624803:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991518848:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.624894:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991518848:12345-192.168.203.42@tcp:3:cat.0 Request processed in 91us (402us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126999.624899:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1850 00002000:00100000:0.0:1746126999.624904:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2924544->2928639) req@ffff88012238ea00 x1830945991518848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.624917:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238ea00 with x1830945991518848 ext(2924544->2928639) 00010000:00010000:0.0:1746126999.624921:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 41 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.624930:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 41 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126999.624935:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238ea00 00000100:00100000:1.0:1746126999.625094:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21257 00000100:00100000:1.0:1746126999.625100:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4112:x1830945991518976:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746126999.625108:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.625118:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5290a expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.625160:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc000/0x34dc807b6ef8dd9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52831 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.625167:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 6 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.625173:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef8dee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5285b expref: 26 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.625179:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.625180:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.625184:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 12 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.625205:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef8dee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5285b expref: 26 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.625213:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef8dee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5285b expref: 26 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.625221:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994199040:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.625276:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 6 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.625283:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 6 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.625295:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994199168:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.625317:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc000/0x34dc807b6ef8dd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52831 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.625324:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc000/0x34dc807b6ef8dd9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52831 expref: 12 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.625329:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994199296:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.625340:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.630187:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.630219:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.630241:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.630255:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991519104 00000100:00100000:0.0:1746126999.630255:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991519232 00000100:00100000:3.0:1746126999.630261:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991519104 00000100:00100000:0.0:1746126999.630261:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991519232 00010000:00010000:0.0:1746126999.630290:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc000/0x34dc807b6ef8dd9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52831 expref: 13 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.630403:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991519360 00000100:00100000:0.0:1746126999.630405:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991519360 00000100:00100000:1.0:1746126999.630455:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9923 00000100:00100000:1.0:1746126999.630464:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991519232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.630474:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.630488:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc000/0x34dc807b6ef8dd9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52831 expref: 13 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.630499:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc000/0x34dc807b6ef8dd9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52831 expref: 13 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.630517:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.630546:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991519232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.630551:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9923 00000100:00100000:2.0:1746126999.630605:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126999.630697:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef8dee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5285b expref: 27 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.630697:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 7 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.630715:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9924 00000100:00100000:0.0:1746126999.630720:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991519104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.630727:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.630734:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef8dee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5285b expref: 27 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.630741:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef8dee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5285b expref: 27 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746126999.630757:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.630775:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991519104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 55us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.630806:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9925 00000100:00100000:3.0:1746126999.630816:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991519360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.630822:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.630829:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 7 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.630836:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 7 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746126999.630836:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9924 00010000:00010000:3.0:1746126999.630847:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.630848:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.630853:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 12 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.630864:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 12 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.630912:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.630921:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991519616 00000100:00100000:1.0:1746126999.630924:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991519616 00000100:00100000:2.0:1746126999.630935:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991519744 00000100:00100000:2.0:1746126999.630937:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991519744 00002000:00100000:1.0:1746126999.630948:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2924544->3145727) req@ffff88008c5bed80 x1830945991519616/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746126999.630954:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21258 00002000:00100000:1.0:1746126999.630957:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bed80 with x1830945991519616 ext(2924544->3145727) 00000100:00100000:2.0:1746126999.630959:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4119:x1830945991519744:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746126999.630962:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 41 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.630968:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.630971:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 41 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746126999.630976:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c5bed80 00010000:00010000:2.0:1746126999.630977:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52911 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.630985:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1851 00000100:00100000:1.0:1746126999.630989:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991519616:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:2.0:1746126999.630993:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 12 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.630999:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 7 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.631005:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642a00/0x34dc807b6ef8e0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52870 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.631008:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.631009:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.631012:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 28 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.631030:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096642a00/0x34dc807b6ef8e0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52870 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.631038:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096642a00/0x34dc807b6ef8e0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52870 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.631046:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994199424:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.631090:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef8dee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5285b expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.631105:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994199040:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.631189:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 12 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.631196:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994199552:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126999.631420:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8e00/0x34dc807b6ef8ed5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a1 expref: 7 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.631430:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994199168:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.631438:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc000/0x34dc807b6ef8dd9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52831 expref: 12 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.631442:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 6 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746126999.631445:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994199296:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.631449:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 6 pid: 11152 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.631455:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994199680:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.631464:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.631472:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.631472:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914a400, rc 0) 00010000:00010000:2.0:1746126999.631478:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.631485:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994199808:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.631485:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4112:x1830945991518976:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6386us (6967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.631490:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21257 00000100:00100000:2.0:1746126999.631496:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.631567:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4540 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.632676:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994199424:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.632684:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994199680:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.635092:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.635195:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991519872 00000100:00100000:2.0:1746126999.635207:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991519872 00010000:00010000:2.0:1746126999.635247:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 7 pid: 11152 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.635291:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9926 00000100:00100000:2.0:1746126999.635299:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2027:x1830945991519872:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.635311:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.635330:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 7 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.635343:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 7 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.635362:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099158800/0x34dc807b6ef8eea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528b6 expref: 7 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.635463:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.635666:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2027:x1830945991519872:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 366us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.635673:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9926 00000100:00100000:3.0:1746126999.635770:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.635897:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991520000 00000100:00100000:2.0:1746126999.635900:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991520000 00010000:00010000:2.0:1746126999.635911:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096642a00/0x34dc807b6ef8e0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52870 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.635926:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9927 00000100:00100000:2.0:1746126999.635935:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991520000:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.635941:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.635948:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096642a00/0x34dc807b6ef8e0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52870 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.635955:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096642a00/0x34dc807b6ef8e0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52870 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.635966:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096642a00/0x34dc807b6ef8e0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52870 expref: 28 pid: 9612 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.635975:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.635996:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991520000:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.636001:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9927 00000100:00100000:3.0:1746126999.636221:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994199552:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.636236:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.636254:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2028:x1830945991519360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5442us (6012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.636260:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9925 00000100:00100000:2.0:1746126999.636262:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994199808:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.636313:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 26 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.636320:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746126999.636322:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb800, rc 0) 00000100:00100000:2.0:1746126999.636344:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:4119:x1830945991519744:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5385us (5431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.636349:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21258 00000100:00100000:2.0:1746126999.636533:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991520128 00000100:00100000:2.0:1746126999.636536:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991520128 00000100:00100000:1.0:1746126999.636550:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.636554:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21259 00000100:00100000:2.0:1746126999.636559:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4112:x1830945991520128:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:3.0:1746126999.636566:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991520256 00000100:00100000:3.0:1746126999.636568:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991520256 00010000:00010000:2.0:1746126999.636570:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.636579:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.636580:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52918 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.636595:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef8dc4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52838 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126999.636600:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9928 00010000:00010000:2.0:1746126999.636603:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126999.636605:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991520256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.636613:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.636615:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 42 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.636620:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.636620:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.636621:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.636624:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 12 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.636627:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.636636:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944a5a00/0x34dc807b6ef8dcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52846 expref: 11 pid: 12340 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.636647:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 44 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.636649:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.636651:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.636655:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.636656:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 44 pid: 9611 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.636666:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994199936:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.636718:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.636719:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.636725:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 34 pid: 11152 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.636732:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200064:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.636736:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.636743:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994200192:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746126999.636752:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef8dc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52838 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746126999.636757:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69480 going to sleep for 11 seconds 00010000:00010000:2.0:1746126999.636763:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef8dc4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52838 expref: 12 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.636770:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200320:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.636784:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.637599:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991519616:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6606us (6990us total) trans 21474842799 rc 0/0 00000100:00100000:0.0:1746126999.637610:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1851 00002000:00100000:0.0:1746126999.637622:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2924544->3145727) req@ffff88008c5bed80 x1830945991519616/t21474842799(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/448 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.637631:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bed80 with x1830945991519616 ext(2924544->3145727) 00010000:00010000:0.0:1746126999.637639:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 43 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.637651:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 43 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126999.637658:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c5bed80 00000100:00100000:2.0:1746126999.639482:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994199936:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.639495:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200064:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.639530:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200320:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.639558:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 12 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.639571:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8600, rc 0) 00000100:00100000:2.0:1746126999.639641:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4112:x1830945991520128:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3082us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.639649:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21259 00000100:00100000:3.0:1746126999.639675:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994200192:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.639694:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.639722:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991520256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3115us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.639731:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9928 00000100:00100000:1.0:1746126999.639864:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.639923:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.639925:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991520512 00000100:00100000:2.0:1746126999.639931:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991520512 00010000:00010000:2.0:1746126999.639951:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef8dc4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52838 expref: 12 pid: 3542 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.639971:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991520384 00000100:00100000:2.0:1746126999.639974:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991520384 00010000:00010000:2.0:1746126999.639982:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 43 pid: 9611 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746126999.639985:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.640000:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991520640 00000100:00100000:2.0:1746126999.640002:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991520640 00010000:00010000:2.0:1746126999.640011:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 44 pid: 12340 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.640161:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9929 00000100:00100000:1.0:1746126999.640175:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991520512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.640188:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.640211:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef8dc4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52838 expref: 12 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.640222:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef8dc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52838 expref: 12 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.640246:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfda00/0x34dc807b6ef8dc4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52838 expref: 12 pid: 3542 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746126999.640261:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.640280:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991520512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 111us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.640291:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9930 00000100:00100000:3.0:1746126999.640299:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9931 00000100:00100000:0.0:1746126999.640301:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991520384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746126999.640303:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9929 00000100:00100000:3.0:1746126999.640305:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991520640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746126999.640310:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.640312:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746126999.640319:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 44 pid: 9611 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.640323:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 44 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.640331:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 44 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.640335:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 44 pid: 9611 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.640343:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f561600/0x34dc807b6ef8f29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2924544->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528ee expref: 44 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.640346:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c35ca00/0x34dc807b6ef8dfc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52862 expref: 44 pid: 9611 timeout: 994 lvb_type: 1 00010000:00010000:3.0:1746126999.640352:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.640354:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.640360:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746126999.640361:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.640370:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.640379:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746126999.640380:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991520384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (457us total) trans 0 rc 0/0 00010000:00010000:3.0:1746126999.640381:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.640384:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 42 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.640386:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9930 00010000:00010000:3.0:1746126999.640391:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 42 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.640421:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 41 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.640434:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994200448:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.640541:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.640550:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994200576:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.640571:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.640765:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.641271:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991520768 00000100:00100000:2.0:1746126999.641278:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991520768 00010000:00010000:2.0:1746126999.641297:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 35 pid: 11152 timeout: 994 lvb_type: 1 00000100:00100000:2.0:1746126999.641327:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9932 00000100:00100000:2.0:1746126999.641334:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991520768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.641345:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.641367:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 35 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.641377:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 35 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.641396:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6ef8edc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528a8 expref: 35 pid: 11152 timeout: 994 lvb_type: 1 00010000:00010000:2.0:1746126999.641409:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.641410:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.641415:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 10 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.641427:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 10 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.641453:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 10 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.641468:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994200704:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746126999.641545:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.645462:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.646159:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991521024 00000100:00100000:1.0:1746126999.646172:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991521024 00002000:00100000:1.0:1746126999.646230:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2449408->2453503) req@ffff88012cc9df80 x1830945991521024/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.646241:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9df80 with x1830945991521024 ext(2449408->2453503) 00002000:00010000:1.0:1746126999.646246:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9df80 00000100:00100000:1.0:1746126999.646312:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8460 00000100:00100000:1.0:1746126999.646321:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2028:x1830945991521024:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.646590:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2028:x1830945991521024:12345-192.168.203.42@tcp:3:cat.0 Request processed in 269us (1138us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746126999.646597:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8460 00002000:00100000:1.0:1746126999.646603:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2449408->2453503) req@ffff88012cc9df80 x1830945991521024/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.646610:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9df80 with x1830945991521024 ext(2449408->2453503) 00002000:00010000:1.0:1746126999.646613:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9df80 00000100:00100000:2.0:1746126999.648235:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994200704:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746126999.648239:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746126999.648258:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.648327:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994200448:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.648337:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994200576:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.648348:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.648446:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991520768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7111us (7679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.648456:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9932 00000100:00100000:2.0:1746126999.648491:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991521152 00000100:00100000:2.0:1746126999.648496:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991521152 00000100:00100000:3.0:1746126999.648628:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991520640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8322us (8642us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.648635:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9931 00000100:00100000:0.0:1746126999.648676:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.648735:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21260 00000100:00100000:2.0:1746126999.648741:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4112:x1830945991521152:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746126999.648755:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.648772:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5291f expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.648798:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 33 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.648807:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 40 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.648814:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.648816:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.648819:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 12 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.648847:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 40 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.648858:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 40 pid: 9611 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.648869:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200832:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.648923:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 33 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.648931:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 33 pid: 12340 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.648939:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200960:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.648955:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.649113:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991521408 00000100:00100000:3.0:1746126999.649117:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991521408 00002000:00100000:3.0:1746126999.649164:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012d28b800 x1830945991521408/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.649172:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28b800 with x1830945991521408 ext(2097152->3145727) 00010000:00010000:3.0:1746126999.649178:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.649192:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:3.0:1746126999.649198:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d28b800 00000100:00100000:3.0:1746126999.649213:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1852 00000100:00100000:3.0:1746126999.649218:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991521408:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.650947:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.651033:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991521664 00000100:00100000:2.0:1746126999.651041:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991521664 00000100:00100000:2.0:1746126999.651095:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6536 00000100:00100000:2.0:1746126999.651103:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b49dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4119:x1830945991521664:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746126999.651334:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b49dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4119:x1830945991521664:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 231us (392us total) trans 8589938126 rc 0/0 00000100:00100000:2.0:1746126999.651342:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6536 00000100:00100000:2.0:1746126999.651416:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200832:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746126999.651425:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994200960:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746126999.651454:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 12 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.651470:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8000, rc 0) 00000100:00100000:2.0:1746126999.651484:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4112:x1830945991521152:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2744us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.651490:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21260 00000100:00100000:1.0:1746126999.657572:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.657978:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.658067:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522048 00000100:00100000:0.0:1746126999.658086:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522048 00000100:00100000:2.0:1746126999.658314:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522176 00000100:00100000:2.0:1746126999.658319:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522176 00002000:00100000:2.0:1746126999.658352:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800997dad80 x1830945991522176/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.658363:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dad80 with x1830945991522176 ext(3145728->4194303) 00010000:00010000:2.0:1746126999.658373:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 41 pid: 9611 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.658387:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 41 pid: 9611 timeout: 994 lvb_type: 0 00002000:00010000:2.0:1746126999.658452:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800997dad80 00000100:00100000:2.0:1746126999.658478:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1853 00002000:00100000:0.0:1746126999.658478:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800997dbb80 x1830945991522048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.658485:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dbb80 with x1830945991522048 ext(3145728->4194303) 00000100:00100000:2.0:1746126999.658487:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991522176:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:0.0:1746126999.658489:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997dbb80 00000100:00100000:0.0:1746126999.658503:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8461 00000100:00100000:0.0:1746126999.658507:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991522048:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746126999.658861:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991521408:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9641us (10182us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126999.658870:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1852 00002000:00100000:3.0:1746126999.658876:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012d28b800 x1830945991521408/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.658885:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28b800 with x1830945991521408 ext(2097152->3145727) 00010000:00010000:3.0:1746126999.658890:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.658900:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00002000:00010000:3.0:1746126999.658907:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d28b800 00000100:00100000:2.0:1746126999.666940:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991522176:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8444us (8951us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126999.666953:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1853 00002000:00100000:2.0:1746126999.666965:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800997dad80 x1830945991522176/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.666974:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dad80 with x1830945991522176 ext(3145728->4194303) 00010000:00010000:2.0:1746126999.666985:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 41 pid: 9611 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.666997:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 41 pid: 9611 timeout: 994 lvb_type: 0 00002000:00010000:2.0:1746126999.667004:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800997dad80 00000100:00100000:2.0:1746126999.667683:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991522048:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9174us (10121us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126999.667690:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8461 00002000:00100000:2.0:1746126999.667695:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800997dbb80 x1830945991522048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.667702:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dbb80 with x1830945991522048 ext(3145728->4194303) 00002000:00010000:2.0:1746126999.667705:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997dbb80 00000100:00100000:0.0:1746126999.672630:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.672691:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.672792:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522304 00000100:00100000:2.0:1746126999.672803:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522304 00000100:00100000:2.0:1746126999.672863:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21261 00000100:00100000:2.0:1746126999.672876:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+5:4122:x1830945991522304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746126999.672899:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746126999.672960:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522432 00000100:00100000:3.0:1746126999.672964:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522432 00010000:00010000:3.0:1746126999.672988:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.673016:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9933 00000100:00100000:3.0:1746126999.673020:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991522432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.673035:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.673057:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.673066:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.673097:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f561800/0x34dc807b6ef8f30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528f5 expref: 34 pid: 12340 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.673118:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746126999.673977:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52926 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.674003:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.674009:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126999.674011:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746126999.674014:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.674045:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.674055:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 25 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.674067:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994201088:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.674428:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991522432:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1403us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.674437:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9933 00000100:00100000:3.0:1746126999.678157:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.678744:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.678778:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.678795:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522560 00000100:00100000:2.0:1746126999.678804:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522560 00000100:00100000:1.0:1746126999.678804:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.678818:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991523072 00000100:00100000:1.0:1746126999.678821:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991523072 00000100:00100000:3.0:1746126999.678890:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522816 00000100:00100000:3.0:1746126999.678893:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522816 00010000:00010000:3.0:1746126999.678911:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 43 pid: 9611 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.678934:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9934 00000100:00100000:3.0:1746126999.678940:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991522816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.678953:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.678972:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 43 pid: 9611 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.678982:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 43 pid: 9611 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.679005:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef8f3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52903 expref: 43 pid: 9611 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.679020:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.679022:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.679028:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 11 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.679036:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 11 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.679063:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 11 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.679084:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994201216:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.679153:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.679219:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.680041:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.680066:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522688 00000100:00100000:1.0:1746126999.680070:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522688 00000100:00100000:1.0:1746126999.680106:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21262 00000100:00100000:1.0:1746126999.680112:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991523072:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.680125:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.680203:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef8f68 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52942 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.680236:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994201344:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.680268:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.680286:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21263 00000100:00100000:1.0:1746126999.680291:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991522560:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.680297:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.680302:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8f6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5292d expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.680319:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994201472:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.680332:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.681053:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.681099:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991522944 00000100:00100000:3.0:1746126999.681102:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991522944 00000100:00100000:3.0:1746126999.681125:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991523200 00000100:00100000:3.0:1746126999.681144:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991523200 00000100:00100000:3.0:1746126999.681160:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21264 00000100:00100000:3.0:1746126999.681165:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991522688:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.681176:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.681187:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f560600/0x34dc807b6ef8f76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52934 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.681218:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994201600:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746126999.681251:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.681270:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21265 00000100:00100000:3.0:1746126999.681275:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991522944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.681281:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.681288:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef8f7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5293b expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.681311:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994201728:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746126999.681330:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.681569:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21266 00000100:00100000:1.0:1746126999.681576:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991523200:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.681583:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.681591:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6ef8f84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52949 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.681614:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994201856:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.681640:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.683010:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994201088:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.683036:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.683050:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8600, rc 0) 00000100:00100000:3.0:1746126999.683091:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+6:4122:x1830945991522304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 10220us (10472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.683097:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21261 00002000:00010000:1.0:1746126999.683382:0:12333:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746126996 -> 1746126997 00002000:00010000:1.0:1746126999.683386:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746126996 -> 1746126997 00002000:00010000:1.0:1746126999.683388:0:12333:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746126996 -> 1746126998 00000100:00100000:1.0:1746126999.683407:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994201344:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126999.683470:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:0.0:1746126999.683503:0:1964:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746126997 -> 1746126998 00000100:00100000:0.0:1746126999.683512:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994201472:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126999.683530:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8f6f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5292d expref: 46 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.683539:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6ef8f6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5292d expref: 46 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.683569:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef8f68 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52942 expref: 45 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.683577:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef8f68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52942 expref: 45 pid: 12333 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746126999.683682:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994201216:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746126999.683692:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.683715:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991522816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4774us (4936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.683722:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9934 00000100:00100000:3.0:1746126999.684084:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991523328 00000100:00100000:3.0:1746126999.684089:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991523328 00000100:00100000:3.0:1746126999.684313:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21267 00000100:00100000:3.0:1746126999.684321:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4112:x1830945991523328:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746126999.684334:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.684349:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52950 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.684369:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126999.684374:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 5 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.684380:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746126999.684383:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 11 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.684410:0:9613:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 5 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.684421:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 11 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.684428:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7000, rc 0) 00000100:00100000:3.0:1746126999.684448:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4112:x1830945991523328:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 129us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.684454:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21267 00010000:00010000:0.0:1746126999.684619:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7000, rc 0) 00000100:00100000:0.0:1746126999.684639:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991522560:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4347us (5899us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.684644:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21263 00000100:00100000:0.0:1746126999.684684:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.684772:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994201856:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126999.684787:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6ef8f84 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52949 expref: 42 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.684796:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6ef8f84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52949 expref: 42 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.684801:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6e00, rc 0) 00000100:00100000:0.0:1746126999.684816:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991523200:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3241us (3767us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.684821:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21266 00000100:00100000:0.0:1746126999.684853:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991523456 00000100:00100000:0.0:1746126999.684856:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991523456 00002000:00100000:0.0:1746126999.684881:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2453503) req@ffff8800a7c52300 x1830945991523456/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.684890:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52300 with x1830945991523456 ext(2097152->2453503) 00010000:00010000:0.0:1746126999.684895:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 30 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746126999.684905:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 30 pid: 9613 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746126999.684911:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c52300 00000100:00100000:0.0:1746126999.684922:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1854 00000100:00100000:0.0:1746126999.684925:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991523456:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:1.0:1746126999.685048:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6400, rc 0) 00002000:00010000:2.0:1746126999.685121:0:9612:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746126997 -> 1746126998 00000100:00100000:2.0:1746126999.685146:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994201600:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746126999.685162:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f560600/0x34dc807b6ef8f76 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52934 expref: 31 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.685170:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f560600/0x34dc807b6ef8f76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52934 expref: 31 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.685182:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f560600, rc 0) 00000100:00100000:1.0:1746126999.686345:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991523072:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6229us (7536us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126999.686351:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21262 00000100:00100000:2.0:1746126999.686414:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991522688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5247us (7193us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.686420:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21264 00002000:00010000:2.0:1746126999.686453:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746126996 -> 1746126997 00002000:00010000:2.0:1746126999.686456:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime: 1746126997 -> 1746126998 00000100:00100000:2.0:1746126999.686465:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994201728:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746126999.686483:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef8f7d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5293b expref: 29 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.686493:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef8f7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5293b expref: 29 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.686501:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f561400, rc 0) 00000100:00100000:2.0:1746126999.686525:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991522944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5250us (6485us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.686531:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21265 00000100:00100000:2.0:1746126999.689239:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.689313:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991523584 00000100:00100000:3.0:1746126999.689322:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991523584 00000100:00100000:3.0:1746126999.689371:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21268 00000100:00100000:3.0:1746126999.689378:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4115:x1830945991523584:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.689394:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.689412:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52957 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.689439:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 11 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.689446:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126999.689448:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746126999.689451:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.689671:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 11 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.689681:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 11 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.689693:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994202112:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746126999.689959:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ce98000 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.691449:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994202112:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.691476:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.691491:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7e00, rc 0) 00000100:00100000:3.0:1746126999.691525:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4115:x1830945991523584:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2147us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.691532:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21268 00000100:00100000:1.0:1746126999.692204:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991523456:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7269us (7510us total) trans 17179875540 rc 0/0 00000100:00100000:1.0:1746126999.692215:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1854 00002000:00100000:1.0:1746126999.692226:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2453503) req@ffff8800a7c52300 x1830945991523456/t17179875540(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/448 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.692235:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52300 with x1830945991523456 ext(2097152->2453503) 00010000:00010000:1.0:1746126999.692243:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 28 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.692255:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 28 pid: 9613 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746126999.692261:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c52300 00000100:00100000:0.0:1746126999.695692:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.695753:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991523712 00000100:00100000:2.0:1746126999.695763:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991523712 00010000:00010000:2.0:1746126999.695803:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 28 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.695843:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9935 00000100:00100000:2.0:1746126999.695850:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991523712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.695865:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746126999.695885:0:10641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746126997 -> 1746126998 00002000:00010000:2.0:1746126999.695888:0:10641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746126997 -> 1746126998 00002000:00010000:2.0:1746126999.695890:0:10641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746126997 -> 1746126998 00010000:00010000:2.0:1746126999.695896:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 28 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.695906:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 28 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.695930:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb800/0x34dc807b6ef8f4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52911 expref: 28 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.695974:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.695976:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.695983:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 5 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.695992:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 5 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.696027:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 5 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.696036:0:10641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 5 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.696045:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994202240:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746126999.696228:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126999.697466:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994202240:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746126999.697487:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.697535:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991523712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1680us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.697544:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9935 00000100:00100000:0.0:1746126999.699042:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.699097:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991523968 00000100:00100000:1.0:1746126999.699104:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991523968 00002000:00100000:1.0:1746126999.699161:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff8800a7c50700 x1830945991523968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.699168:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50700 with x1830945991523968 ext(2097152->3145727) 00010000:00010000:1.0:1746126999.699175:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.699183:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746126999.699188:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c50700 00000100:00100000:1.0:1746126999.699207:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1855 00000100:00100000:1.0:1746126999.699217:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2027:x1830945991523968:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746126999.704525:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2027:x1830945991523968:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5297us (5476us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746126999.704538:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1855 00002000:00100000:1.0:1746126999.704549:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff8800a7c50700 x1830945991523968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.704557:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50700 with x1830945991523968 ext(2097152->3145727) 00010000:00010000:1.0:1746126999.704567:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.704578:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746126999.704585:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c50700 00000100:00100000:0.0:1746126999.708642:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.708782:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524224 00000100:00100000:2.0:1746126999.708792:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524224 00010000:00010000:2.0:1746126999.708836:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.708881:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9936 00000100:00100000:2.0:1746126999.708890:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2028:x1830945991524224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.708903:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.708922:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.708933:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.708941:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746126999.708963:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6ef8f61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52926 expref: 6 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.708979:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524096 00010000:00010000:2.0:1746126999.708981:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746126999.708982:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524096 00010000:00010000:2.0:1746126999.708983:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.708989:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 10 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.708997:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 10 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746126999.709004:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21269 00000100:00100000:0.0:1746126999.709009:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4122:x1830945991524096:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746126999.709024:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.709036:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5295e expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.709038:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 10 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.709049:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994202368:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126999.709051:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126999.709053:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126999.709056:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.709065:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.709071:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44a00, rc 0) 00000100:00100000:0.0:1746126999.709123:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:4122:x1830945991524096:12345-192.168.203.42@tcp:101:cat.0 Request processed in 112us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.709153:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21269 00000100:00100000:2.0:1746126999.709536:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1746126999.711689:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994202368:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746126999.711711:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.711751:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2028:x1830945991524224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2862us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.711761:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9936 00000100:00100000:0.0:1746126999.712683:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.712715:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.712743:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.712758:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.712768:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524352 00000100:00100000:0.0:1746126999.712771:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.712776:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524352 00000100:00100000:1.0:1746126999.712808:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524608 00000100:00100000:0.0:1746126999.712809:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.712810:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524608 00000100:00100000:1.0:1746126999.712821:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524864 00000100:00100000:1.0:1746126999.712823:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524864 00000100:00100000:0.0:1746126999.712824:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524480 00000100:00100000:0.0:1746126999.712827:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524480 00000100:00100000:1.0:1746126999.712831:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524736 00000100:00100000:1.0:1746126999.712833:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524736 00000100:00100000:1.0:1746126999.712842:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991524992 00000100:00100000:1.0:1746126999.712844:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991524992 00000100:00100000:0.0:1746126999.712865:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21270 00000100:00100000:1.0:1746126999.712890:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21271 00000100:00100000:0.0:1746126999.712893:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991524352:12345-192.168.203.42@tcp:2:lfs.0 00000100:00100000:1.0:1746126999.712895:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991524608:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:1.0:1746126999.713014:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746126999.713014:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746126999.713016:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:0.0:1746126999.713017:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.713018:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:0.0:1746126999.713019:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.713020:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126998 -> 1746126998 00002000:00010000:0.0:1746126999.713021:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746126998 -> 1746126998 00002000:00010000:1.0:1746126999.713022:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746126999.713023:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:1.0:1746126999.713047:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991524608:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 151us (331us total) trans 17179875541 rc 0/0 00000100:00100000:0.0:1746126999.713051:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991524352:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 155us (367us total) trans 21474842800 rc 0/0 00000100:00100000:1.0:1746126999.713052:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21271 00000100:00100000:0.0:1746126999.713057:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21270 00000100:00100000:1.0:1746126999.713061:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21272 00000100:00100000:1.0:1746126999.713065:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991524864:12345-192.168.203.42@tcp:2:lfs.0 00000100:00100000:0.0:1746126999.713069:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21273 00000100:00100000:3.0:1746126999.713100:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21274 00000100:00100000:0.0:1746126999.713106:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991524736:12345-192.168.203.42@tcp:2:lfs.0 00000100:00100000:3.0:1746126999.713108:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991524480:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:1.0:1746126999.713114:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:1.0:1746126999.713116:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746126998 -> 1746126997 00002000:00010000:1.0:1746126999.713117:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:1.0:1746126999.713119:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746126998 -> 1746126998 00002000:00010000:1.0:1746126999.713121:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:1.0:1746126999.713152:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991524864:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 86us (408us total) trans 21474842801 rc 0/0 00000100:00100000:1.0:1746126999.713157:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21272 00002000:00010000:0.0:1746126999.713163:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746126999.713164:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746126999.713165:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21275 00002000:00010000:0.0:1746126999.713166:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:3.0:1746126999.713167:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746126997 -> 1746126997 00002000:00010000:3.0:1746126999.713168:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00000100:00100000:1.0:1746126999.713168:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991524992:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746126999.713168:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746126997 -> 1746126997 00002000:00010000:3.0:1746126999.713170:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746126998 -> 1746126998 00002000:00010000:0.0:1746126999.713170:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746126998 -> 1746126998 00002000:00010000:3.0:1746126999.713172:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746126999.713172:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746126999.713200:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746126999.713202:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746126998 -> 1746126997 00002000:00010000:1.0:1746126999.713204:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746126998 -> 1746126997 00002000:00010000:1.0:1746126999.713205:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746126998 -> 1746126998 00002000:00010000:1.0:1746126999.713207:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746126999.713221:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991524480:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 114us (461us total) trans 17179875542 rc 0/0 00000100:00100000:1.0:1746126999.713221:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991524992:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 52us (412us total) trans 17179875543 rc 0/0 00000100:00100000:1.0:1746126999.713225:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21275 00000100:00100000:3.0:1746126999.713228:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21274 00000100:00100000:0.0:1746126999.713417:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991524736:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 114us (416us total) trans 21474842802 rc 0/0 00000100:00100000:0.0:1746126999.713423:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21273 00000100:00100000:0.0:1746126999.715907:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.715996:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991525248 00000100:00100000:1.0:1746126999.716004:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991525248 00000100:00100000:1.0:1746126999.716058:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6537 00000100:00100000:1.0:1746126999.716065:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4112:x1830945991525248:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1746126999.716209:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.716312:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4112:x1830945991525248:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 245us (408us total) trans 8589938127 rc 0/0 00000100:00100000:1.0:1746126999.716318:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6537 00000100:00100000:3.0:1746126999.716362:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991525376 00000100:00100000:3.0:1746126999.716366:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991525376 00010000:00010000:3.0:1746126999.716387:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 15 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:3.0:1746126999.716410:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9937 00000100:00100000:3.0:1746126999.716415:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991525376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746126999.716425:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746126999.716440:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 15 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.716452:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 15 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.716479:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef8f5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5291f expref: 15 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.716495:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.716497:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.716504:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 40 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.716511:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 40 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.716519:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.716520:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746126999.716524:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.716530:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.716556:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.716567:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994202496:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.716617:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 40 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.716628:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994202624:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.716641:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ce98000 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.718386:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.718481:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994202496:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746126999.718492:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994202624:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746126999.718509:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746126999.718553:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991525376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2136us (2343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.718563:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9937 00000100:00100000:1.0:1746126999.718641:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991525632 00000100:00100000:1.0:1746126999.718645:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991525632 00000100:00100000:1.0:1746126999.718686:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6538 00000100:00100000:1.0:1746126999.718693:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4112:x1830945991525632:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1746126999.718842:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4112:x1830945991525632:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 149us (463us total) trans 8589938128 rc 0/0 00000100:00100000:1.0:1746126999.718848:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6538 00000100:00100000:0.0:1746126999.720604:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.721313:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991525888 00000100:00100000:1.0:1746126999.721321:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991525888 00002000:00100000:1.0:1746126999.721361:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009c4cdf80 x1830945991525888/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.721371:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cdf80 with x1830945991525888 ext(4194304->4829183) 00002000:00010000:1.0:1746126999.721377:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cdf80 00000100:00100000:1.0:1746126999.721410:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8462 00000100:00100000:1.0:1746126999.721418:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991525888:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.722428:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.722483:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991526144 00000100:00100000:3.0:1746126999.722489:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991526144 00002000:00100000:3.0:1746126999.722513:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cf100 x1830945991526144/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.722520:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cf100 with x1830945991526144 ext(3145728->4194303) 00002000:00010000:3.0:1746126999.722525:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cf100 00000100:00100000:3.0:1746126999.722551:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8463 00000100:00100000:3.0:1746126999.722557:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2029:x1830945991526144:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746126999.737319:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2029:x1830945991526144:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14754us (14890us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746126999.737343:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8463 00002000:00100000:3.0:1746126999.737354:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cf100 x1830945991526144/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746126999.737363:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cf100 with x1830945991526144 ext(3145728->4194303) 00002000:00010000:3.0:1746126999.737367:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cf100 00000100:00100000:1.0:1746126999.737827:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991525888:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16408us (17224us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746126999.737834:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8462 00002000:00100000:1.0:1746126999.737840:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009c4cdf80 x1830945991525888/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746126999.737847:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cdf80 with x1830945991525888 ext(4194304->4829183) 00002000:00010000:1.0:1746126999.737851:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cdf80 00000100:00100000:1.0:1746126999.743524:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.743560:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.743571:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991527168 00000100:00100000:1.0:1746126999.743584:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.743589:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991527168 00000100:00100000:1.0:1746126999.743597:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991526272 00000100:00100000:1.0:1746126999.743600:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991526272 00000100:00100000:1.0:1746126999.743622:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991526528 00000100:00100000:1.0:1746126999.743623:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991526528 00000100:00100000:3.0:1746126999.743627:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17205 00000100:00100000:3.0:1746126999.743634:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4127:x1830945991527168:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:1.0:1746126999.743635:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21276 00000100:00100000:1.0:1746126999.743640:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+5:4122:x1830945991526272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.743652:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.743666:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5296c expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.743673:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.743683:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6ef8fa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5298f expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.743694:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 13 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.743700:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126999.743702:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746126999.743705:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 6 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.743728:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 13 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.743738:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 13 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:3.0:1746126999.743747:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.743748:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994202752:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746126999.743758:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.743769:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.743779:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.743785:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.743790:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.743796:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.743815:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21277 00000100:00100000:1.0:1746126999.743820:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991526528:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.743826:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.743831:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967be600/0x34dc807b6ef8fbc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52973 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.743853:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994202880:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.743871:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.743889:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.743902:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991526784 00000100:00100000:1.0:1746126999.743904:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991526784 00010000:00010000:3.0:1746126999.743913:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.743920:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21278 00010000:00010000:3.0:1746126999.743922:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.743924:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991526784:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.743928:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746126999.743930:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1746126999.743935:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126999.743938:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967bfc00/0x34dc807b6ef8fca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52981 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.743960:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994203008:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.743977:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00010000:00010000:3.0:1746126999.744002:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.744008:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.744013:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.744014:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746126999.744016:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746126999.744019:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.744024:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.744027:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991526400 00000100:00100000:1.0:1746126999.744029:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991526400 00010000:00010000:3.0:1746126999.744032:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746126999.744034:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126999.744038:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.744042:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6800/0x34dc807b6ef8fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.744056:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.744060:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.744062:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21279 00010000:00010000:3.0:1746126999.744063:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.744067:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991526400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.744069:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd7400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746126999.744071:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746126999.744082:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.744085:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746126999.744089:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6ef8fd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52965 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.744090:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cc2ae00) 00010000:00010000:3.0:1746126999.744092:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746126999.744094:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746126999.744097:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef8fb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746126999.744109:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994203136:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126999.744126:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6ef8fa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.744126:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746126999.744153:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.744158:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746126999.744160:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746126999.744162:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd6a00, rc 0) 00000100:00100000:3.0:1746126999.744184:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4127:x1830945991527168:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 550us (666us total) trans 8589938129 rc 0/0 00000100:00100000:3.0:1746126999.744190:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17205 00000100:00100000:2.0:1746126999.745050:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.745146:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.746646:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991526656 00000100:00100000:1.0:1746126999.746655:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991526656 00000100:00100000:1.0:1746126999.746685:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991526912 00000100:00100000:1.0:1746126999.746687:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991526912 00000100:00100000:1.0:1746126999.746700:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21280 00000100:00100000:1.0:1746126999.746707:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991526656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.746719:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.746732:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9400/0x34dc807b6ef8fdf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5297a expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.746801:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994203264:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.746844:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.746864:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21281 00000100:00100000:1.0:1746126999.746869:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991526912:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.746875:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.746880:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6ef8fe6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52988 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.746896:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994203392:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.746912:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.750805:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994203264:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126999.750832:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9400/0x34dc807b6ef8fdf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5297a expref: 32 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.750845:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9400/0x34dc807b6ef8fdf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5297a expref: 32 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.750857:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9400, rc 0) 00000100:00100000:0.0:1746126999.750890:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991526656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4183us (5841us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.750897:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21280 00000100:00100000:2.0:1746126999.750927:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994202880:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746126999.750943:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967be600/0x34dc807b6ef8fbc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52973 expref: 30 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.750953:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967be600/0x34dc807b6ef8fbc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52973 expref: 30 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.750976:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967be600, rc 0) 00000100:00100000:2.0:1746126999.750994:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991526528:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7173us (7408us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.750999:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21277 00000100:00100000:0.0:1746126999.751050:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994203136:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746126999.751052:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994203392:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746126999.751064:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6ef8fe6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52988 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.751064:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6ef8fd8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52965 expref: 44 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.751081:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6ef8fd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52965 expref: 44 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.751082:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6ef8fe6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52988 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.751090:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9600, rc 0) 00010000:00010000:0.0:1746126999.751090:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9c00, rc 0) 00000100:00100000:2.0:1746126999.751110:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991526912:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4241us (5964us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.751115:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21281 00000100:00100000:2.0:1746126999.751171:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994203008:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746126999.751185:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967bfc00/0x34dc807b6ef8fca lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52981 expref: 43 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.751193:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967bfc00/0x34dc807b6ef8fca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52981 expref: 43 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.751204:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967bfc00, rc 0) 00000100:00100000:2.0:1746126999.751219:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991526784:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7294us (7329us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.751224:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21278 00000100:00100000:1.0:1746126999.751274:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994202752:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.751288:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 6 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.751300:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967bea00, rc 0) 00000100:00100000:1.0:1746126999.751319:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+6:4122:x1830945991526272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7679us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.751325:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21276 00000100:00100000:0.0:1746126999.751786:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991526400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7717us (7769us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.751792:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21279 00000100:00100000:0.0:1746126999.758615:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.758895:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991527296 00000100:00100000:0.0:1746126999.758899:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.758904:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991527296 00010000:00010000:3.0:1746126999.758941:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.759037:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.759052:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.759228:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9938 00000100:00100000:2.0:1746126999.759238:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991527296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746126999.759244:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746126999.759249:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.759523:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.759537:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.759555:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6ef8f8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52950 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.759567:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746126999.759575:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.759576:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.759606:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 5 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.759615:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 5 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.759643:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 5 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.759653:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994203520:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746126999.759707:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.759719:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991527424 00000100:00100000:2.0:1746126999.759722:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991527680 00000100:00100000:2.0:1746126999.759723:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991527680 00000100:00100000:1.0:1746126999.759724:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991527424 00000100:00100000:2.0:1746126999.759740:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991527936 00000100:00100000:2.0:1746126999.759742:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991527936 00000100:00100000:1.0:1746126999.759747:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991527552 00000100:00100000:1.0:1746126999.759748:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991527552 00000100:00100000:2.0:1746126999.759753:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21282 00000100:00100000:2.0:1746126999.759757:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991527680:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746126999.759761:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21283 00000100:00100000:1.0:1746126999.759765:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991527424:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746126999.759768:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.759771:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.759778:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099190800/0x34dc807b6ef8fed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529a4 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.759778:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc34600/0x34dc807b6ef8ff4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52996 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.759801:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994203648:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.759822:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.759840:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21284 00000100:00100000:1.0:1746126999.759845:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991527936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.759851:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.759856:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529b2 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.759865:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.759866:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.759870:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 31 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.759880:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 31 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.759887:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc35600, rc 0) 00000100:00100000:1.0:1746126999.759903:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991527936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 58us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.759911:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21284 00000100:00100000:1.0:1746126999.759922:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21285 00000100:00100000:1.0:1746126999.759926:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991527552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.759931:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.759936:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc34200/0x34dc807b6ef9002 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5299d expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.759952:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994203776:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.759966:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.760587:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991527808 00000100:00100000:3.0:1746126999.760592:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991527808 00000100:00100000:3.0:1746126999.760614:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21286 00000100:00100000:3.0:1746126999.760620:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991527808:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.760678:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.760688:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6e00/0x34dc807b6ef9009 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529ab expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.760711:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994203904:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746126999.760741:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746126999.761297:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994204032:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746126999.761343:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.763696:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.763854:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994203776:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126999.763878:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc34200/0x34dc807b6ef9002 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5299d expref: 31 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.763890:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc34200/0x34dc807b6ef9002 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5299d expref: 31 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.763902:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc34200, rc 0) 00000100:00100000:0.0:1746126999.763938:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991527552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4009us (4691us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.763945:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21285 00000100:00100000:0.0:1746126999.763964:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991528064 00000100:00100000:0.0:1746126999.763968:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991528064 00000100:00100000:0.0:1746126999.763991:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21287 00000100:00100000:0.0:1746126999.763996:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:4127:x1830945991528064:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126999.764005:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.764015:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529b9 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.764033:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 13 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.764039:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126999.764041:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746126999.764044:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1474560->1662975] (req 1474560->1662975) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 35 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.764064:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 13 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.764082:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 13 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.764091:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012153f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994204160:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746126999.764145:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.764177:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994203648:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126999.764189:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc34600/0x34dc807b6ef8ff4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52996 expref: 44 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.764197:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc34600/0x34dc807b6ef8ff4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52996 expref: 44 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.764202:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc34600, rc 0) 00000100:00100000:0.0:1746126999.764215:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991527424:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4449us (5317us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.764219:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21283 00000100:00100000:0.0:1746126999.764243:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994203520:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746126999.764252:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746126999.764263:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991527296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5028us (5656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746126999.764269:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9938 00000100:00100000:0.0:1746126999.764295:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994203904:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126999.764306:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6e00/0x34dc807b6ef9009 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ab expref: 42 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.764313:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6e00/0x34dc807b6ef9009 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ab expref: 42 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.764319:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd6e00, rc 0) 00000100:00100000:0.0:1746126999.764329:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991527808:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3710us (4763us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.764336:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21286 00000100:00100000:2.0:1746126999.769883:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.770689:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991528320 00000100:00100000:1.0:1746126999.770698:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991528320 00002000:00100000:1.0:1746126999.770742:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800997d9180 x1830945991528320/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746126999.770814:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994204032:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746126999.770815:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012153f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994204160:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746126999.770837:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1474560->1662975] (req 1474560->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 35 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746126999.770838:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099190800/0x34dc807b6ef8fed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529a4 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.770849:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099190800/0x34dc807b6ef8fed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529a4 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.770851:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6400, rc 0) 00010000:00010000:3.0:1746126999.770861:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099190800, rc 0) 00000100:00100000:0.0:1746126999.770887:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:4127:x1830945991528064:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6889us (7196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746126999.770892:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991527680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 11133us (11855us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.770895:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21287 00000100:00100000:3.0:1746126999.770899:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21282 00002000:00100000:1.0:1746126999.771213:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9180 with x1830945991528320 ext(3145728->4194303) 00002000:00010000:1.0:1746126999.771218:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d9180 00000100:00100000:1.0:1746126999.771462:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8464 00000100:00100000:1.0:1746126999.771469:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2028:x1830945991528320:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746126999.773163:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.773681:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991528448 00000100:00100000:1.0:1746126999.773689:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991528448 00010000:00010000:1.0:1746126999.773717:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.773755:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9939 00000100:00100000:1.0:1746126999.773761:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991528448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.773775:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.775178:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.775191:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.775209:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef8f53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52918 expref: 14 pid: 9613 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.775237:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.775239:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746126999.775245:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.775252:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.775280:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.775291:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994204288:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746126999.775375:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.782487:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994204288:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746126999.782505:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.782550:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991528448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8789us (9390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.782560:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9939 00000100:00100000:0.0:1746126999.782624:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.782656:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991528704 00000100:00100000:0.0:1746126999.782663:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991528704 00002000:00100000:0.0:1746126999.782693:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1474560->1478655) req@ffff88012153f100 x1830945991528704/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.782701:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f100 with x1830945991528704 ext(1474560->1478655) 00002000:00010000:0.0:1746126999.782705:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153f100 00000100:00100000:0.0:1746126999.782720:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8465 00000100:00100000:0.0:1746126999.782726:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991528704:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746126999.782732:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2028:x1830945991528320:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11262us (12859us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746126999.782739:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8464 00002000:00100000:2.0:1746126999.782745:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800997d9180 x1830945991528320/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.782752:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9180 with x1830945991528320 ext(3145728->4194303) 00002000:00010000:2.0:1746126999.782756:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d9180 00000100:00100000:0.0:1746126999.782816:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991528704:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 90us (192us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126999.782821:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8465 00002000:00100000:0.0:1746126999.782826:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1474560->1478655) req@ffff88012153f100 x1830945991528704/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.782837:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f100 with x1830945991528704 ext(1474560->1478655) 00002000:00010000:0.0:1746126999.782840:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153f100 00000100:00100000:0.0:1746126999.788951:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.788985:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.789015:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746126999.789020:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991528960 00000100:00100000:3.0:1746126999.789028:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991528960 00000100:00100000:0.0:1746126999.789039:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991528832 00000100:00100000:0.0:1746126999.789042:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991528832 00000100:00100000:3.0:1746126999.789105:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991529088 00000100:00100000:3.0:1746126999.789108:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991529088 00000100:00100000:3.0:1746126999.789452:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21288 00000100:00100000:3.0:1746126999.789459:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2029:x1830945991528832:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.789474:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.789486:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2400/0x34dc807b6ef9017 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529c0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.789525:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994204416:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746126999.789587:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.789605:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21289 00000100:00100000:3.0:1746126999.789610:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991528960:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.789623:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.789631:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3c00/0x34dc807b6ef901e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529c7 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.789657:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994204544:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746126999.789675:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.790364:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21290 00000100:00100000:1.0:1746126999.790373:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991529088:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.790381:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746126999.790389:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc35e00/0x34dc807b6ef9025 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529ce expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746126999.790414:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994204672:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.790437:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.790688:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.790728:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991529344 00000100:00100000:0.0:1746126999.790733:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991529344 00002000:00100000:0.0:1746126999.790759:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1658880->1662975) req@ffff880099197b80 x1830945991529344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.790768:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197b80 with x1830945991529344 ext(1658880->1662975) 00002000:00010000:0.0:1746126999.790772:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099197b80 00000100:00100000:0.0:1746126999.790785:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8466 00000100:00100000:0.0:1746126999.790791:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+37:2027:x1830945991529344:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746126999.790892:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+37:2027:x1830945991529344:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 100us (203us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746126999.790898:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8466 00002000:00100000:0.0:1746126999.790903:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1658880->1662975) req@ffff880099197b80 x1830945991529344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746126999.790909:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197b80 with x1830945991529344 ext(1658880->1662975) 00002000:00010000:0.0:1746126999.790912:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099197b80 00000100:00100000:3.0:1746126999.793892:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994204416:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126999.793921:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2400/0x34dc807b6ef9017 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529c0 expref: 36 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.793932:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2400/0x34dc807b6ef9017 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529c0 expref: 36 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.793944:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2400, rc 0) 00000100:00100000:3.0:1746126999.793979:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2029:x1830945991528832:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4520us (4992us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126999.793987:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21288 00000100:00100000:2.0:1746126999.794071:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994204544:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746126999.794100:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3c00/0x34dc807b6ef901e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529c7 expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.794109:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3c00/0x34dc807b6ef901e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529c7 expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.794120:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3c00, rc 0) 00000100:00100000:2.0:1746126999.794169:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991528960:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4558us (5234us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.794174:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21289 00000100:00100000:1.0:1746126999.794390:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994204672:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746126999.794405:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc35e00/0x34dc807b6ef9025 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ce expref: 7 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.794412:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc35e00/0x34dc807b6ef9025 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ce expref: 7 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746126999.794422:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc35e00, rc 0) 00000100:00100000:1.0:1746126999.794439:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2029:x1830945991529088:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4069us (5423us total) trans 0 rc 301/301 00000100:00100000:1.0:1746126999.794444:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21290 00000100:00100000:2.0:1746126999.794736:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.794790:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991529600 00000100:00100000:0.0:1746126999.794795:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991529600 00000100:00100000:0.0:1746126999.794829:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6539 00000100:00100000:0.0:1746126999.794835:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4127:x1830945991529600:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746126999.794979:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4127:x1830945991529600:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 144us (243us total) trans 8589938130 rc 0/0 00000100:00100000:0.0:1746126999.794985:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6539 00000100:00100000:0.0:1746126999.803810:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.805179:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991529856 00000100:00100000:2.0:1746126999.805188:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991529856 00002000:00100000:2.0:1746126999.805225:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009c5e2680 x1830945991529856/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.805235:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2680 with x1830945991529856 ext(4194304->4829183) 00002000:00010000:2.0:1746126999.805239:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e2680 00000100:00100000:3.0:1746126999.805250:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.805261:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8467 00000100:00100000:2.0:1746126999.805267:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991529856:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746126999.805671:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991530112 00000100:00100000:0.0:1746126999.805675:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991530112 00000100:00100000:0.0:1746126999.806049:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17206 00000100:00100000:0.0:1746126999.806056:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4130:x1830945991530112:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126999.806069:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.806091:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6ef902c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529d5 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.808753:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808768:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808778:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808791:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808796:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808801:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808892:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808901:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808906:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746126999.808914:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746126999.808970:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808976:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808980:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808985:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.808991:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc34800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126999.808995:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809000:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809008:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746126999.809011:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126999.809014:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809018:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34800/0x34dc807b6ef9033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809041:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809045:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809048:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809051:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc35a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746126999.809053:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809057:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809062:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a000) 00010000:00010000:1.0:1746126999.809064:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746126999.809066:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809081:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35a00/0x34dc807b6ef903a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746126999.809121:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6ef902c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 32 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.809147:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 31 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.809153:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746126999.809154:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746126999.809157:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc35200, rc 0) 00000100:00100000:1.0:1746126999.809212:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4130:x1830945991530112:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3156us (3962us total) trans 8589938131 rc 0/0 00000100:00100000:1.0:1746126999.809219:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17206 00000100:00100000:2.0:1746126999.813540:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991529856:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8265us (9729us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746126999.813551:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8467 00002000:00100000:2.0:1746126999.813560:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009c5e2680 x1830945991529856/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:5/0 lens 488/440 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.813569:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2680 with x1830945991529856 ext(4194304->4829183) 00002000:00010000:2.0:1746126999.813574:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e2680 00000100:00100000:0.0:1746126999.818537:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.818652:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991530240 00000100:00100000:1.0:1746126999.818661:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991530240 00000100:00100000:0.0:1746126999.819035:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.819872:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991530496 00000100:00100000:1.0:1746126999.819877:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991530496 00000100:00100000:3.0:1746126999.819881:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21291 00000100:00100000:3.0:1746126999.819892:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2029:x1830945991530240:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746126999.819902:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21292 00010000:00010000:3.0:1746126999.819905:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746126999.819907:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2029:x1830945991530496:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746126999.819913:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.819918:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3600/0x34dc807b6ef904f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529dc expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.819923:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef9056 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529ea expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.819954:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994204800:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746126999.819954:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994204928:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746126999.820010:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.821636:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.821884:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.822253:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991530368 00000100:00100000:2.0:1746126999.822260:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991530368 00000100:00100000:2.0:1746126999.822301:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21293 00000100:00100000:2.0:1746126999.822307:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991530368:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746126999.822319:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.822331:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099191400/0x34dc807b6ef905d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529e3 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.822365:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994205056:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746126999.822424:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1746126999.829253:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994204928:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746126999.829287:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef9056 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ea expref: 9 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.829301:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc34800/0x34dc807b6ef9056 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ea expref: 9 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746126999.829329:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc34800, rc 0) 00000100:00100000:0.0:1746126999.829372:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991530496:12345-192.168.203.42@tcp:101:cat.0 Request processed in 9464us (10336us total) trans 0 rc 301/301 00000100:00100000:0.0:1746126999.829381:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21292 00000100:00100000:2.0:1746126999.829672:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994205056:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746126999.829690:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099191400/0x34dc807b6ef905d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529e3 expref: 7 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.829699:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099191400/0x34dc807b6ef905d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529e3 expref: 7 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.829725:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191400, rc 0) 00000100:00100000:2.0:1746126999.829752:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2029:x1830945991530368:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7444us (7869us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.829757:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21293 00000100:00100000:3.0:1746126999.830000:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994204800:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126999.830019:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3600/0x34dc807b6ef904f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529dc expref: 36 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.830027:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3600/0x34dc807b6ef904f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529dc expref: 36 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.830053:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3600, rc 0) 00000100:00100000:3.0:1746126999.830100:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2029:x1830945991530240:12345-192.168.203.42@tcp:101:cat.0 Request processed in 10210us (11568us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126999.830106:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21291 00000100:00100000:2.0:1746126999.835810:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.835842:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.835860:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991530624 00000100:00100000:2.0:1746126999.835867:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991530624 00000100:00100000:2.0:1746126999.835910:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991530880 00000100:00100000:2.0:1746126999.835912:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991530880 00000100:00100000:2.0:1746126999.835926:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21294 00000100:00100000:2.0:1746126999.835932:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991530624:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746126999.835946:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.835959:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099190000/0x34dc807b6ef9064 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529f1 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.835999:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cbb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994205184:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746126999.836059:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1746126999.836104:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.836212:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991530752 00000100:00100000:2.0:1746126999.836215:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991530752 00000100:00100000:2.0:1746126999.836231:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21295 00000100:00100000:2.0:1746126999.836235:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991530880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746126999.836243:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746126999.836256:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef906b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529ff expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.836291:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994205312:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746126999.836336:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.836337:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21296 00000100:00100000:3.0:1746126999.836344:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991530752:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746126999.836374:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746126999.836381:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3400/0x34dc807b6ef9072 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e529f8 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746126999.836402:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994205440:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746126999.836422:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746126999.836616:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746126999.836785:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991531008 00000100:00100000:0.0:1746126999.836789:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991531008 00000100:00100000:0.0:1746126999.836816:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21297 00000100:00100000:0.0:1746126999.836822:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4130:x1830945991531008:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746126999.836828:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746126999.836835:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a06 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.836849:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.836857:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.836862:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.836864:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746126999.836867:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2424832->2822143] (req 2424832->2822143) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.836890:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746126999.837119:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 36 pid: 1507 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746126999.837242:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994205568:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.837580:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.837587:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 42 pid: 1507 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.837595:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994205696:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.837616:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746126999.838327:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cbb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994205184:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746126999.838328:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994205312:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126999.838346:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099190000/0x34dc807b6ef9064 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529f1 expref: 36 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.838346:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef906b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ff expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.838356:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099190000/0x34dc807b6ef9064 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529f1 expref: 36 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746126999.838356:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef906b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529ff expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.838378:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099190000, rc 0) 00010000:00010000:2.0:1746126999.838378:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191000, rc 0) 00000100:00100000:2.0:1746126999.838409:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991530880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2173us (2566us total) trans 0 rc 301/301 00000100:00100000:2.0:1746126999.838415:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21295 00000100:00100000:3.0:1746126999.838614:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991530624:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2681us (2809us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126999.838619:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21294 00000100:00100000:3.0:1746126999.839270:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994205440:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746126999.839287:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3400/0x34dc807b6ef9072 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529f8 expref: 7 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.839296:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3400/0x34dc807b6ef9072 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529f8 expref: 7 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746126999.839304:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3400, rc 0) 00000100:00100000:3.0:1746126999.839337:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2028:x1830945991530752:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2993us (3232us total) trans 0 rc 301/301 00000100:00100000:3.0:1746126999.839345:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21296 00000100:00100000:1.0:1746126999.840451:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994205568:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746126999.840459:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994205696:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746126999.840476:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2424832->2822143] (req 2424832->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746126999.840487:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6600, rc 0) 00000100:00100000:1.0:1746126999.840507:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4130:x1830945991531008:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3685us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.840513:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21297 00000100:00100000:2.0:1746126999.841753:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.841827:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991531136 00000100:00100000:1.0:1746126999.841832:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991531136 00010000:00010000:1.0:1746126999.841855:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 42 pid: 1507 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746126999.841880:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9940 00000100:00100000:1.0:1746126999.841884:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991531136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746126999.841892:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746126999.841902:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 42 pid: 1507 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.841908:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 42 pid: 1507 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.841919:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6ef8f92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52957 expref: 42 pid: 1507 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746126999.841936:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746126999.841967:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991531136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746126999.841972:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9940 00000100:00100000:0.0:1746126999.848919:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.849113:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991531264 00000100:00100000:2.0:1746126999.849120:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991531264 00010000:00010000:2.0:1746126999.849169:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 35 pid: 1507 timeout: 994 lvb_type: 0 00000100:00100000:2.0:1746126999.849769:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9941 00000100:00100000:2.0:1746126999.849776:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2027:x1830945991531264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746126999.849787:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746126999.849801:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 35 pid: 1507 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.849811:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 35 pid: 1507 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.849829:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6ef8f99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5295e expref: 35 pid: 1507 timeout: 994 lvb_type: 0 00010000:00010000:2.0:1746126999.849956:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.849958:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746126999.849964:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 40 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.849976:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 40 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746126999.850002:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 40 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746126999.850012:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994205824:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746126999.850071:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746126999.853049:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994205824:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746126999.853071:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746126999.853116:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991531264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3339us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746126999.853124:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9941 00000100:00100000:0.0:1746126999.854383:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.854518:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991531520 00000100:00100000:2.0:1746126999.854523:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991531520 00002000:00100000:2.0:1746126999.854549:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2424832->2428927) req@ffff8801303d0700 x1830945991531520/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.854556:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0700 with x1830945991531520 ext(2424832->2428927) 00002000:00010000:2.0:1746126999.854560:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0700 00000100:00100000:2.0:1746126999.854579:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8468 00000100:00100000:2.0:1746126999.854585:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991531520:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746126999.854690:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991531520:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 105us (375us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126999.854698:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8468 00002000:00100000:2.0:1746126999.854702:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2424832->2428927) req@ffff8801303d0700 x1830945991531520/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.854708:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0700 with x1830945991531520 ext(2424832->2428927) 00002000:00010000:2.0:1746126999.854710:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0700 00000100:00100000:0.0:1746126999.860051:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746126999.861114:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991531776 00000100:00100000:2.0:1746126999.861123:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991531776 00002000:00100000:2.0:1746126999.861171:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2818048->2822143) req@ffff8801303d0a80 x1830945991531776/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/0 e 0 to 0 dl 1746127010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.861180:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0a80 with x1830945991531776 ext(2818048->2822143) 00002000:00010000:2.0:1746126999.861185:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0a80 00000100:00100000:2.0:1746126999.861218:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8469 00000100:00100000:2.0:1746126999.861225:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991531776:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746126999.861332:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991531776:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 106us (1287us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746126999.861338:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8469 00002000:00100000:2.0:1746126999.861343:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2818048->2822143) req@ffff8801303d0a80 x1830945991531776/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:5/0 lens 488/4536 e 0 to 0 dl 1746127010 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746126999.861349:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0a80 with x1830945991531776 ext(2818048->2822143) 00002000:00010000:2.0:1746126999.861352:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0a80 00000100:00100000:0.0:1746126999.863095:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746126999.863171:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991532032 00000100:00100000:1.0:1746126999.863177:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991532032 00000100:00100000:1.0:1746126999.863207:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6540 00000100:00100000:1.0:1746126999.863213:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4130:x1830945991532032:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746126999.863605:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4130:x1830945991532032:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 390us (512us total) trans 8589938132 rc 0/0 00000100:00100000:1.0:1746126999.863612:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6540 00010000:00010000:2.0:1746126999.877618:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127000.018349:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.018775:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991532288 00000100:00100000:1.0:1746127000.018785:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991532288 00000100:00100000:1.0:1746127000.018998:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17207 00000100:00100000:1.0:1746127000.019006:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4135:x1830945991532288:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127000.019033:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.019052:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dde00/0x34dc807b6ef9080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a0d expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.019570:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.019585:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.019592:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 33 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.019599:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.019630:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 33 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.019641:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 33 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.019653:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994205952:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.019770:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.019778:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 13 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.019785:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994206080:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.019802:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.021427:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.021462:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.021486:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.021515:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.021579:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991532544 00000100:00100000:3.0:1746127000.021584:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991532544 00000100:00100000:0.0:1746127000.021597:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994205952:192.168.203.42@tcp:104: 00000100:00080000:0.0:1746127000.021610:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746127000.021624:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991532800 00000100:00100000:0.0:1746127000.021624:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991532416 00000100:00100000:3.0:1746127000.021626:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991532800 00000100:00100000:0.0:1746127000.021626:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991532416 00000100:00100000:3.0:1746127000.021639:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991532672 00000100:00100000:3.0:1746127000.021641:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991532672 00000100:00100000:0.0:1746127000.021731:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21298 00000100:00100000:0.0:1746127000.021738:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991532544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.021751:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.021765:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7200/0x34dc807b6ef908e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a1b expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.021799:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994206208:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.021842:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00080000:0.0:1746127000.021849:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746127000.021887:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21299 00000100:00100000:0.0:1746127000.021891:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991532800:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.021898:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.021907:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099190000/0x34dc807b6ef9095 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a29 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.021927:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994206336:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.021945:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.022016:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21300 00000100:00100000:3.0:1746127000.022021:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991532416:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.022027:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.022033:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef909c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a14 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.022056:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994206464:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127000.022090:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.022105:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21301 00000100:00100000:3.0:1746127000.022110:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991532672:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.022116:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.022123:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3000/0x34dc807b6ef90a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a22 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.022167:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994206592:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127000.022195:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.024289:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.024344:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.024465:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994206208:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.024592:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991532928 00000100:00100000:1.0:1746127000.024598:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991532928 00010000:00010000:1.0:1746127000.024623:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 34 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.024642:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991533056 00000100:00100000:1.0:1746127000.024644:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991533056 00010000:00010000:1.0:1746127000.024652:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.024663:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9942 00000100:00100000:1.0:1746127000.024669:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991532928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.024678:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.024683:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 34 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.024691:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 34 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.024709:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc35200/0x34dc807b6ef9041 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529d5 expref: 34 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.024739:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.024744:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.024751:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.024756:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.024784:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991532928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 115us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.024791:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9942 00000100:00100000:1.0:1746127000.024803:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9943 00000100:00100000:1.0:1746127000.024807:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991533056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.024814:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.024817:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.024825:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.024835:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.024837:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.024844:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.024850:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.024862:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.024875:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991533056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 67us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.024880:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9943 00010000:00010000:1.0:1746127000.024907:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6a00/0x34dc807b6ef8fc3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5298f expref: 13 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.024916:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994206080:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.024929:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.024935:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.024940:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127000.024956:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127000.025082:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dde00/0x34dc807b6ef9080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 34 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.025094:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 33 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.025098:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.025101:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746127000.025103:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dc400, rc 0) 00000100:00100000:1.0:1746127000.025126:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4135:x1830945991532288:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6121us (6788us total) trans 8589938133 rc 0/0 00000100:00100000:1.0:1746127000.025153:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17207 00002000:00010000:1.0:1746127000.025248:0:9611:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746126997 -> 1746126998 00002000:00010000:1.0:1746127000.025251:0:9611:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746126997 -> 1746126998 00000100:00100000:1.0:1746127000.025262:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994206336:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.025276:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099190000/0x34dc807b6ef9095 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a29 expref: 44 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.025283:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099190000/0x34dc807b6ef9095 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a29 expref: 44 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.025290:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099190000, rc 0) 00000100:00100000:1.0:1746127000.025311:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991532800:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3419us (3848us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.025317:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21299 00010000:00010000:2.0:1746127000.028684:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7200/0x34dc807b6ef908e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a1b expref: 31 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.028712:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7200/0x34dc807b6ef908e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a1b expref: 31 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.029263:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7200, rc 0) 00000100:00100000:2.0:1746127000.029333:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991532544:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7592us (7907us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.029343:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21298 00000100:00100000:2.0:1746127000.030095:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994206464:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.030126:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef909c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a14 expref: 42 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.030153:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef909c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a14 expref: 42 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.030161:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2600, rc 0) 00000100:00100000:3.0:1746127000.030579:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994206592:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.030601:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3000/0x34dc807b6ef90a3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a22 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127000.030702:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991532416:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8679us (9212us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.030708:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21300 00000100:00100000:0.0:1746127000.030748:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127000.030755:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3000/0x34dc807b6ef90a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a22 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127000.030768:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991533312 00000100:00100000:1.0:1746127000.030776:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991533312 00010000:00010000:3.0:1746127000.030789:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3000, rc 0) 00000100:00100000:1.0:1746127000.030821:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17208 00000100:00100000:1.0:1746127000.030827:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4140:x1830945991533312:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:3.0:1746127000.030842:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991532672:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8729us (9324us total) trans 0 rc 301/301 00010000:00010000:1.0:1746127000.030848:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127000.030850:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21301 00010000:00010000:1.0:1746127000.030862:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc600/0x34dc807b6ef90b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a30 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.030930:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.030946:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.030956:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.030967:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.030972:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.030976:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031069:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031088:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031093:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127000.031101:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127000.031193:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031199:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031204:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031210:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031215:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8dcc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127000.031219:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031225:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031234:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127000.031237:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127000.031241:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031248:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dcc00/0x34dc807b6ef90b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031256:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031260:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031264:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031267:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8dd600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127000.031270:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031274:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031279:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a400) 00010000:00010000:1.0:1746127000.031281:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127000.031283:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031287:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef90bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.031316:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc600/0x34dc807b6ef90b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 16 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.031325:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 15 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.031334:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.031336:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127000.031338:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dce00, rc 0) 00000100:00100000:1.0:1746127000.032543:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4140:x1830945991533312:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1709us (1790us total) trans 8589938134 rc 0/0 00000100:00100000:1.0:1746127000.032551:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17208 00000100:00100000:0.0:1746127000.035249:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.035336:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991533440 00000100:00100000:3.0:1746127000.035348:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991533440 00000100:00100000:3.0:1746127000.035404:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21302 00000100:00100000:3.0:1746127000.035412:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4138:x1830945991533440:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.035427:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.035441:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a37 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.035465:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.035472:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.035473:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.035475:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 42 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.035500:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.035513:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 12 pid: 12340 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.035523:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994206720:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.035599:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.037119:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994206720:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.037176:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 42 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.037190:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3a00, rc 0) 00000100:00100000:3.0:1746127000.037221:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4138:x1830945991533440:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1810us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.037228:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21302 00000100:00100000:1.0:1746127000.038945:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.039096:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991533568 00000100:00100000:0.0:1746127000.039105:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991533568 00010000:00010000:0.0:1746127000.039186:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 13 pid: 12340 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.039217:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9944 00000100:00100000:0.0:1746127000.039224:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991533568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.039237:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.039258:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 13 pid: 12340 timeout: 995 lvb_type: 0 00000100:00080000:2.0:1746127000.039268:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746127000.039269:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 13 pid: 12340 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.039294:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f560a00/0x34dc807b6ef8f0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d2 expref: 13 pid: 12340 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.039321:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.039323:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.039330:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.039344:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.039378:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.039390:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994206848:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127000.039547:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.040811:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994206848:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127000.040831:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127000.041732:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991533568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2504us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.041743:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9944 00000100:00100000:0.0:1746127000.042523:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.043461:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991533696 00000100:00100000:1.0:1746127000.043470:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991533696 00000100:00100000:0.0:1746127000.043531:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.043702:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17209 00000100:00100000:2.0:1746127000.043706:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991533952 00000100:00100000:2.0:1746127000.043710:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991533952 00000100:00100000:1.0:1746127000.043710:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4141:x1830945991533696:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.043731:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746127000.043742:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8801303d3800 x1830945991533952/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746127000.043748:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef90db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a3e expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746127000.043752:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d3800 with x1830945991533952 ext(0->1048575) 00002000:00010000:2.0:1746127000.043757:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d3800 00000100:00100000:2.0:1746127000.043770:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8470 00000100:00100000:2.0:1746127000.043775:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991533952:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:1.0:1746127000.043805:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043818:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043827:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043838:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043842:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043850:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043914:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043923:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 32 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.043930:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.043956:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 32 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.043967:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 32 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.043978:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994206976:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.044054:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.049371:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.049436:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991534080 00000100:00100000:2.0:1746127000.049445:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991534080 00010000:00010000:2.0:1746127000.049481:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 33 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.049505:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9945 00000100:00100000:2.0:1746127000.049510:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991534080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127000.049522:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127000.049526:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 33 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.049535:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 33 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.049553:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127000.049556:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.049566:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.049571:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.049584:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127000.049618:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991534080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.049622:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9945 00010000:00010000:1.0:1746127000.050381:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc400/0x34dc807b6ef9087 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a0d expref: 32 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.050409:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994206976:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.050429:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.050437:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.050445:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127000.050946:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127000.050952:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127000.050970:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.050981:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.050992:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.050997:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051002:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051007:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051012:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127000.051015:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051020:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051029:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127000.051031:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127000.051034:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051039:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6ef90e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051048:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051052:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051056:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051060:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127000.051061:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051065:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051069:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a000) 00010000:00010000:1.0:1746127000.051079:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127000.051081:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051084:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982400/0x34dc807b6ef90e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.051113:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef90db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.051123:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.051159:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.051161:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127000.051163:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983800, rc 0) 00000100:00100000:1.0:1746127000.051206:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4141:x1830945991533696:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7496us (8685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.051212:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17209 00000100:00100000:2.0:1746127000.052738:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991533952:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8958us (9203us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127000.052749:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8470 00002000:00100000:2.0:1746127000.052758:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8801303d3800 x1830945991533952/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.052767:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d3800 with x1830945991533952 ext(0->1048575) 00002000:00010000:2.0:1746127000.052773:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d3800 00000100:00100000:0.0:1746127000.054236:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.054287:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.054334:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.054377:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.054494:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991534208 00000100:00100000:1.0:1746127000.054504:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991534208 00000100:00100000:1.0:1746127000.054544:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991534464 00000100:00100000:1.0:1746127000.054549:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991534464 00000100:00100000:1.0:1746127000.054562:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991534336 00000100:00100000:1.0:1746127000.054565:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991534336 00000100:00100000:1.0:1746127000.054575:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991534592 00000100:00100000:1.0:1746127000.054576:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991534592 00000100:00100000:1.0:1746127000.054590:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21303 00000100:00100000:1.0:1746127000.054598:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991534208:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.054615:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.054632:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a45 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.054653:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.054655:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.054663:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.054679:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.054696:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3b600, rc 0) 00000100:00100000:1.0:1746127000.054729:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991534208:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 132us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.054735:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21303 00000100:00100000:1.0:1746127000.054746:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21304 00000100:00100000:1.0:1746127000.054751:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991534464:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.054756:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.054763:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6ef90fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a53 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.054801:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994207104:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.054856:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.054874:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21305 00000100:00100000:1.0:1746127000.054880:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991534336:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.054886:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.054893:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e983a00/0x34dc807b6ef9105 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a4c expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.054915:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994207232:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.054935:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.054952:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21306 00000100:00100000:1.0:1746127000.054956:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991534592:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.054963:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.054974:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a5a expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.054984:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.054985:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.054990:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.055001:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.055008:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983600, rc 0) 00000100:00100000:1.0:1746127000.055022:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991534592:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 65us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.055027:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21306 00002000:00010000:1.0:1746127000.057120:0:9611:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746126997 -> 1746126998 00002000:00010000:1.0:1746127000.057149:0:9611:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746126997 -> 1746126998 00000100:00100000:1.0:1746127000.057174:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994207104:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.057205:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6ef90fe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a53 expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.057217:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6ef90fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a53 expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.057226:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3a000, rc 0) 00000100:00100000:1.0:1746127000.057271:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991534464:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2519us (2985us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.057281:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21304 00000100:00100000:2.0:1746127000.057512:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994207232:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.057528:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e983a00/0x34dc807b6ef9105 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a4c expref: 14 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.057537:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e983a00/0x34dc807b6ef9105 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a4c expref: 14 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.057555:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983a00, rc 0) 00000100:00100000:2.0:1746127000.057576:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991534336:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2696us (3243us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.057582:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21305 00000100:00100000:0.0:1746127000.065253:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.065521:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.065600:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991534976 00000100:00100000:1.0:1746127000.065609:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991534976 00000100:00100000:1.0:1746127000.065657:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17210 00000100:00100000:1.0:1746127000.065665:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4141:x1830945991534976:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.065684:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.065703:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6ef9113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a68 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.065874:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991534720 00000100:00100000:3.0:1746127000.065878:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991534720 00010000:00010000:1.0:1746127000.065915:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00000100:00100000:3.0:1746127000.065919:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21307 00000100:00100000:3.0:1746127000.065924:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4138:x1830945991534720:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127000.065930:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.065936:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.065938:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.065947:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a61 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.065965:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 13 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.065967:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.065975:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127000.065977:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 11 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.065978:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.065980:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.065989:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994207360:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.066068:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00010000:00010000:3.0:1746127000.066246:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 13 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.066254:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 13 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.066261:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994207488:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.066307:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.067608:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994207360:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.067632:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127000.076200:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.076255:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.076388:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994207488:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.076393:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991535488 00000100:00100000:3.0:1746127000.076400:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991535488 00010000:00010000:0.0:1746127000.076419:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.076444:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17211 00000100:00100000:3.0:1746127000.076451:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4144:x1830945991535488:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.076476:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.076492:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6ef9128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a6f expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.076565:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076578:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127000.076668:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991535104 00000100:00100000:1.0:1746127000.076672:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991535104 00010000:00010000:1.0:1746127000.076693:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 12 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.076713:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9946 00010000:00010000:3.0:1746127000.076714:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127000.076718:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991535104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.076726:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.076730:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 12 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.076738:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.076739:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 12 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.076747:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076752:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.076756:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983800/0x34dc807b6ef90f0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a3e expref: 12 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.076774:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.076779:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.076787:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.076792:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.076809:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127000.076842:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2e00/0x34dc807b6ef913d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127000.076847:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991535104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 129us (657us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127000.076850:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2e00/0x34dc807b6ef913d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127000.076853:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9946 00010000:00010000:3.0:1746127000.076856:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2e00/0x34dc807b6ef913d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127000.076865:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127000.076911:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.076916:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.076921:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076927:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127000.076929:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127000.076932:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076937:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d2c3e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127000.076940:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076946:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076955:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127000.076958:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127000.076961:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076965:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef912f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076988:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076992:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.076997:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.077001:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d2c3200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127000.077003:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.077007:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.077012:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cc2a300) 00010000:00010000:3.0:1746127000.077013:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127000.077013:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6ef9113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 12 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.077015:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.077019:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6ef9136 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.077024:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.077029:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.077031:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746127000.077033:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e982800, rc 0) 00000100:00100000:1.0:1746127000.077055:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4141:x1830945991534976:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 11391us (11534us total) trans 8589938136 rc 0/0 00010000:00010000:3.0:1746127000.077061:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6ef9128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a6f expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.077061:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17210 00010000:00010000:3.0:1746127000.077085:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2e00/0x34dc807b6ef913d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a6f expref: 17 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.077091:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127000.077093:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127000.077095:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2e00, rc 0) 00000100:00100000:3.0:1746127000.077172:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4144:x1830945991535488:12345-192.168.203.42@tcp:101:cat.0 Request processed in 720us (915us total) trans 8589938135 rc 0/0 00000100:00100000:3.0:1746127000.077180:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17211 00010000:00010000:0.0:1746127000.077423:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2400, rc 0) 00000100:00100000:0.0:1746127000.077462:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4138:x1830945991534720:12345-192.168.203.42@tcp:101:cat.0 Request processed in 11536us (12220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.077472:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21307 00000100:00100000:0.0:1746127000.079665:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.079843:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991535232 00000100:00100000:2.0:1746127000.079851:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991535232 00010000:00010000:2.0:1746127000.079886:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.079922:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9947 00000100:00100000:2.0:1746127000.079930:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991535232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127000.079944:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127000.079963:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.079975:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.079998:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef8f37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528fc expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.080015:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.080016:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.080023:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.080030:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.080063:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.080084:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994207616:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127000.080178:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.084854:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.084952:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991535616 00000100:00100000:1.0:1746127000.084963:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991535616 00000100:00100000:3.0:1746127000.085259:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17212 00000100:00100000:3.0:1746127000.085270:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4141:x1830945991535616:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127000.085289:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.085304:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9152 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a76 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.085373:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.085385:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 12 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.085391:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.085416:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 12 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.085424:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 12 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.085431:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994207744:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.085501:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.087539:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994207616:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127000.087564:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.087612:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991535232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7682us (7953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.087624:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9947 00000100:00100000:3.0:1746127000.087963:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994207744:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.087981:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127000.089043:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.089162:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991536128 00000100:00100000:1.0:1746127000.089169:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991536128 00000100:00100000:1.0:1746127000.089207:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6541 00000100:00100000:1.0:1746127000.089214:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4144:x1830945991536128:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127000.090512:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4144:x1830945991536128:12345-192.168.203.42@tcp:35:cat.0 Request processed in 1293us (1466us total) trans 8589938137 rc 0/0 00000100:00100000:1.0:1746127000.090525:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6541 00000100:00100000:2.0:1746127000.091784:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.092567:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.092588:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991535872 00000100:00100000:3.0:1746127000.092596:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991535872 00010000:00010000:3.0:1746127000.092631:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 13 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.092664:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9948 00000100:00100000:3.0:1746127000.092671:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991535872:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127000.092683:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127000.092688:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 13 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.092703:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 13 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.092723:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6ef911a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a68 expref: 13 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.092740:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127000.092744:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.092753:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.092759:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.092778:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.092822:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991535872:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 151us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.092828:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9948 00010000:00010000:3.0:1746127000.092852:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.092857:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127000.092900:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127000.092904:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127000.092920:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.092948:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9152 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.092960:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.092965:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127000.092967:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127000.092969:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2600, rc 0) 00000100:00100000:3.0:1746127000.092994:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4141:x1830945991535616:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7727us (8151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.093000:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17212 00000100:00100000:2.0:1746127000.094924:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.095022:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991535744 00000100:00100000:0.0:1746127000.095030:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991535744 00000100:00100000:0.0:1746127000.095068:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1012 00000100:00100000:0.0:1746127000.095085:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991535744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.095096:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.095117:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2e00/0x34dc807b6ef913d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a6f expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.095150:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127000.095154:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127000.095183:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991535744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.095189:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1012 00000100:00100000:0.0:1746127000.095499:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.095668:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.095688:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991536640 00000100:00100000:0.0:1746127000.095691:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991536640 00000100:00100000:0.0:1746127000.095711:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991536512 00000100:00100000:0.0:1746127000.095713:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991536512 00000100:00100000:0.0:1746127000.095727:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21308 00000100:00100000:0.0:1746127000.095732:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991536640:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127000.095747:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.095763:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099191400/0x34dc807b6ef9160 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a84 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.095808:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994207872:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.095855:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.095873:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21309 00000100:00100000:0.0:1746127000.095878:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991536512:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127000.095885:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.095894:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a7d expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.095905:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.095907:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.095914:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.095926:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.095934:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191000, rc 0) 00000100:00100000:0.0:1746127000.095955:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991536512:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.095960:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21309 00000100:00100000:0.0:1746127000.095992:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.096004:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991536768 00000100:00100000:0.0:1746127000.096006:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991536768 00000100:00100000:0.0:1746127000.096020:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21310 00000100:00100000:0.0:1746127000.096024:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991536768:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127000.096030:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.096036:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099190400/0x34dc807b6ef916e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a8b expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.096058:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994208000:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.096088:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.096532:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991536384 00000100:00100000:2.0:1746127000.096536:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991536384 00002000:00100000:2.0:1746127000.096562:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880122385500 x1830945991536384/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.096570:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385500 with x1830945991536384 ext(1048576->2097151) 00002000:00010000:2.0:1746127000.096574:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122385500 00000100:00100000:2.0:1746127000.096586:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8471 00000100:00100000:2.0:1746127000.096590:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991536384:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127000.099740:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.100726:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.100772:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.101479:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991536896 00000100:00100000:0.0:1746127000.101488:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991536896 00000100:00100000:0.0:1746127000.101527:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991537152 00000100:00100000:0.0:1746127000.101529:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991537152 00000100:00100000:0.0:1746127000.101542:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991537024 00000100:00100000:0.0:1746127000.101543:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991537024 00000100:00100000:0.0:1746127000.101557:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21311 00000100:00100000:0.0:1746127000.101565:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991536896:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.101584:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.101603:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a92 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.101629:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.101631:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.101641:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.101655:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.101668:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dd200, rc 0) 00000100:00100000:0.0:1746127000.101710:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991536896:12345-192.168.203.42@tcp:101:cat.0 Request processed in 147us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.101717:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21311 00000100:00100000:0.0:1746127000.101731:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21312 00000100:00100000:0.0:1746127000.101735:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991537152:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.101744:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.101753:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8dc400/0x34dc807b6ef917c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52aa0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.101792:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994208128:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.101840:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.102829:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21313 00000100:00100000:3.0:1746127000.102841:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991537024:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.102853:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.102864:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52a99 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.102878:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.102880:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.102885:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.102896:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.102903:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2e00, rc 0) 00000100:00100000:3.0:1746127000.102933:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991537024:12345-192.168.203.42@tcp:101:cat.0 Request processed in 95us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.102937:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21313 00000100:00100000:0.0:1746127000.108934:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.110448:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991537280 00000100:00100000:1.0:1746127000.110462:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991537280 00000100:00100000:1.0:1746127000.110533:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21314 00000100:00100000:1.0:1746127000.110543:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991537280:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127000.110566:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.110587:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd00e00/0x34dc807b6ef918a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52aa7 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.110653:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994208256:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.110755:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.112738:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994207872:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.112773:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099191400/0x34dc807b6ef9160 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a84 expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.112785:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099191400/0x34dc807b6ef9160 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a84 expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.112806:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191400, rc 0) 00000100:00100000:2.0:1746127000.112845:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991536640:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 17111us (17345us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.112853:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21308 00000100:00100000:1.0:1746127000.113187:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994208000:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.113205:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099190400/0x34dc807b6ef916e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a8b expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.113213:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099190400/0x34dc807b6ef916e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a8b expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.113224:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099190400, rc 0) 00000100:00100000:1.0:1746127000.113549:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991536768:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 17522us (17554us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.113555:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21310 00002000:00010000:1.0:1746127000.114124:0:12333:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime: 1746126997 -> 1746126998 00002000:00010000:1.0:1746127000.114142:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746126997 -> 1746126998 00000100:00100000:1.0:1746127000.114154:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994208128:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.114172:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dc400/0x34dc807b6ef917c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aa0 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.114181:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dc400/0x34dc807b6ef917c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aa0 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.114188:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dc400, rc 0) 00000100:00100000:1.0:1746127000.114202:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991537152:12345-192.168.203.42@tcp:101:cat.0 Request processed in 12466us (13479us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.114203:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991536384:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17612us (19288us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127000.114207:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21312 00000100:00100000:3.0:1746127000.114211:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8471 00002000:00100000:3.0:1746127000.114219:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880122385500 x1830945991536384/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.114227:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385500 with x1830945991536384 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.114232:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122385500 00000100:00100000:1.0:1746127000.116475:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994208256:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.116502:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd00e00/0x34dc807b6ef918a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aa7 expref: 36 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.116512:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd00e00/0x34dc807b6ef918a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aa7 expref: 36 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.116521:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00e00, rc 0) 00000100:00100000:1.0:1746127000.116556:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991537280:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6016us (7635us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.116562:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21314 00000100:00100000:0.0:1746127000.116896:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.116936:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991537536 00000100:00100000:3.0:1746127000.116943:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991537536 00000100:00100000:3.0:1746127000.116984:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17213 00000100:00100000:3.0:1746127000.116990:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4141:x1830945991537536:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127000.117006:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.117022:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef9191 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52aae expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.117122:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117155:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117166:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117177:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117184:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117189:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117195:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d2c3000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127000.117198:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117205:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117214:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127000.117216:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127000.117220:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117224:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3000/0x34dc807b6ef9198 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.117256:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef9191 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aae expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.117263:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6ef9191 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aae expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.117270:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3e00, rc 0) 00000100:00100000:3.0:1746127000.117300:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4141:x1830945991537536:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 310us (404us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.117306:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17213 00000100:00100000:0.0:1746127000.129553:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.129982:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.130433:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991537920 00000100:00100000:2.0:1746127000.130443:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991537920 00000100:00100000:2.0:1746127000.130492:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6542 00000100:00100000:2.0:1746127000.130499:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4141:x1830945991537920:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1746127000.131084:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4141:x1830945991537920:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 573us (1091us total) trans 8589938138 rc 0/0 00000100:00100000:2.0:1746127000.131092:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6542 00000100:00100000:1.0:1746127000.131453:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991537664 00000100:00100000:1.0:1746127000.131458:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991537664 00000100:00100000:1.0:1746127000.131496:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21315 00000100:00100000:1.0:1746127000.131501:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4138:x1830945991537664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127000.131512:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.131531:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ab5 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.131558:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 13 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.131565:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127000.131567:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127000.131570:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 30 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.131599:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 13 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.131609:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 13 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.131621:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208384:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.132304:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.138603:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208384:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.138637:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 30 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.138656:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00200, rc 0) 00000100:00100000:1.0:1746127000.139646:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4138:x1830945991537664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8140us (10098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.139656:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21315 00000100:00100000:0.0:1746127000.141117:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.143016:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.143200:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991538048 00000100:00100000:2.0:1746127000.143211:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991538048 00010000:00010000:2.0:1746127000.143255:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.143674:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991538432 00000100:00100000:3.0:1746127000.143679:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991538432 00002000:00100000:3.0:1746127000.143715:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009c5e3b80 x1830945991538432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.143723:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3b80 with x1830945991538432 ext(0->1048575) 00002000:00010000:3.0:1746127000.143729:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e3b80 00000100:00100000:3.0:1746127000.143747:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8472 00000100:00100000:3.0:1746127000.143755:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2027:x1830945991538432:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127000.144418:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9949 00000100:00100000:2.0:1746127000.144425:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991538048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127000.144436:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127000.144455:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.144467:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.144490:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009914a400/0x34dc807b6ef8f45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5290a expref: 14 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.144513:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.144516:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.144522:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 29 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.144531:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 29 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.144562:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 29 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.144574:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994208512:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127000.144658:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.147868:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.148419:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994208512:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127000.148441:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.148486:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991538048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4061us (5475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.148498:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9949 00000100:00100000:0.0:1746127000.148644:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991538560 00000100:00100000:0.0:1746127000.148651:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991538560 00002000:00100000:0.0:1746127000.148687:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880099197800 x1830945991538560/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.148697:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197800 with x1830945991538560 ext(1048576->2097151) 00002000:00010000:0.0:1746127000.148701:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099197800 00000100:00100000:0.0:1746127000.148718:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8473 00000100:00100000:0.0:1746127000.148724:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991538560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127000.156542:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.156709:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2027:x1830945991538432:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12953us (15598us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127000.156720:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8472 00002000:00100000:0.0:1746127000.156732:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009c5e3b80 x1830945991538432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.156741:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3b80 with x1830945991538432 ext(0->1048575) 00002000:00010000:0.0:1746127000.156747:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e3b80 00000100:00100000:0.0:1746127000.156770:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991538816 00000100:00100000:0.0:1746127000.156777:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991538816 00002000:00100000:0.0:1746127000.156805:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8801220f0700 x1830945991538816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.156811:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0700 with x1830945991538816 ext(1048576->2097151) 00002000:00010000:0.0:1746127000.156814:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801220f0700 00000100:00100000:0.0:1746127000.156829:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8474 00000100:00100000:0.0:1746127000.156835:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991538816:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127000.165533:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991538560:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16797us (17664us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127000.165545:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8473 00002000:00100000:1.0:1746127000.165556:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880099197800 x1830945991538560/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.165565:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197800 with x1830945991538560 ext(1048576->2097151) 00002000:00010000:1.0:1746127000.165571:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099197800 00000100:00100000:0.0:1746127000.169772:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.171590:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991538944 00000100:00100000:1.0:1746127000.171604:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991538944 00000100:00100000:1.0:1746127000.171654:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21316 00000100:00100000:1.0:1746127000.171662:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4140:x1830945991538944:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127000.171681:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.171699:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52abc expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.171734:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 31 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.171742:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 8 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.171750:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.171757:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.171759:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.171762:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1613824->2097151] (req 1613824->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 8 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.171794:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.171805:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 12 pid: 1964 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746127000.171818:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208640:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.171916:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 8 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.171925:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 8 pid: 9612 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746127000.171933:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208768:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.171959:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 31 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.171967:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 31 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.171979:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208896:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.171993:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.172803:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991538816:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15965us (16267us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127000.172814:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8474 00002000:00100000:1.0:1746127000.172824:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8801220f0700 x1830945991538816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.172834:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0700 with x1830945991538816 ext(1048576->2097151) 00002000:00010000:1.0:1746127000.172838:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801220f0700 00000100:00100000:0.0:1746127000.180566:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.180615:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.180660:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991539200 00000100:00100000:0.0:1746127000.180667:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991539200 00010000:00010000:0.0:1746127000.180702:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 30 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.180728:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991539072 00000100:00100000:0.0:1746127000.180730:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991539072 00010000:00010000:0.0:1746127000.180739:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 13 pid: 1964 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746127000.180758:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9950 00000100:00100000:0.0:1746127000.180764:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991539200:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.180777:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.180798:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 30 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.180809:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 30 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.180834:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127000.180876:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991539200:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.180881:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9950 00000100:00100000:0.0:1746127000.180895:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9951 00000100:00100000:0.0:1746127000.180900:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991539072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.180906:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.180912:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 13 pid: 1964 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746127000.180920:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 13 pid: 1964 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746127000.180931:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127000.180943:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991539072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.180948:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9951 00010000:00010000:1.0:1746127000.181683:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099191000/0x34dc807b6ef9167 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a7d expref: 12 pid: 1964 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746127000.181715:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208640:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.181727:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208768:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.181735:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef9121 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a61 expref: 29 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.181743:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994208896:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.181772:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1613824->2097151] (req 1613824->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 8 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.181782:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01000, rc 0) 00000100:00100000:1.0:1746127000.181811:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4140:x1830945991538944:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10150us (12050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.181818:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21316 00000100:00100000:0.0:1746127000.195459:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.195507:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.195552:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.195632:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991539328 00000100:00100000:3.0:1746127000.195642:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991539328 00010000:00010000:3.0:1746127000.195678:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 8 pid: 9612 timeout: 995 lvb_type: 1 00000100:00100000:3.0:1746127000.195712:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9952 00000100:00100000:3.0:1746127000.195719:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991539328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127000.195732:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127000.195751:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 8 pid: 9612 timeout: 995 lvb_type: 1 00010000:00010000:3.0:1746127000.195762:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 8 pid: 9612 timeout: 995 lvb_type: 1 00010000:00010000:3.0:1746127000.195790:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2e00/0x34dc807b6ef9183 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a99 expref: 8 pid: 9612 timeout: 995 lvb_type: 1 00010000:00010000:3.0:1746127000.195808:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.195810:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.195817:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 7 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.195825:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 7 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.195852:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 7 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.195862:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994209024:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127000.195935:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.196099:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991539456 00000100:00100000:2.0:1746127000.196103:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991539456 00000100:00100000:2.0:1746127000.196126:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991539584 00000100:00100000:2.0:1746127000.196150:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991539584 00000100:00100000:2.0:1746127000.196176:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21317 00000100:00100000:2.0:1746127000.196181:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4144:x1830945991539456:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.196195:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.196206:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ac3 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.196220:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.196221:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.196224:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.196240:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.196248:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11a00, rc 0) 00000100:00100000:2.0:1746127000.196349:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4144:x1830945991539456:12345-192.168.203.42@tcp:101:cat.0 Request processed in 165us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.196355:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21317 00000100:00100000:2.0:1746127000.196369:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21318 00000100:00100000:2.0:1746127000.196374:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4138:x1830945991539584:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.196381:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.196389:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52aca expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.196405:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.196410:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.196412:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.196414:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 43 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.196430:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.196439:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 34 pid: 1507 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.196448:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994209152:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.196485:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.200914:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994209152:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.200946:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 43 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.200964:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11000, rc 0) 00000100:00100000:2.0:1746127000.201019:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4138:x1830945991539584:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4643us (5465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.201028:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21318 00000100:00100000:3.0:1746127000.201463:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994209024:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127000.201481:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.201509:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991539328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5790us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.201519:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9952 00000100:00100000:0.0:1746127000.203503:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.204409:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991539840 00000100:00100000:1.0:1746127000.204419:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991539840 00002000:00100000:1.0:1746127000.204464:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1613824->1617919) req@ffff880123476a00 x1830945991539840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.204474:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476a00 with x1830945991539840 ext(1613824->1617919) 00002000:00010000:1.0:1746127000.204479:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123476a00 00000100:00100000:1.0:1746127000.204513:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8475 00000100:00100000:1.0:1746127000.204520:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991539840:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127000.204676:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991539840:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 155us (1181us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127000.204682:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8475 00002000:00100000:1.0:1746127000.204688:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1613824->1617919) req@ffff880123476a00 x1830945991539840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.204695:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476a00 with x1830945991539840 ext(1613824->1617919) 00002000:00010000:1.0:1746127000.204697:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123476a00 00000100:00100000:0.0:1746127000.205104:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.205869:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991539968 00000100:00100000:2.0:1746127000.205875:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991539968 00002000:00100000:2.0:1746127000.205905:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1474560->1662975) req@ffff880123476300 x1830945991539968/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.205912:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476300 with x1830945991539968 ext(1474560->1662975) 00010000:00010000:2.0:1746127000.205919:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 35 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.205932:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 35 pid: 1507 timeout: 995 lvb_type: 0 00002000:00010000:2.0:1746127000.205939:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880123476300 00000100:00100000:2.0:1746127000.205961:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1856 00000100:00100000:2.0:1746127000.205967:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991539968:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127000.209252:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.210749:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991540224 00000100:00100000:1.0:1746127000.210761:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991540224 00002000:00100000:1.0:1746127000.210804:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123477b80 x1830945991540224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.210814:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477b80 with x1830945991540224 ext(1048576->2097151) 00002000:00010000:1.0:1746127000.210820:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123477b80 00000100:00100000:1.0:1746127000.210853:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8476 00000100:00100000:1.0:1746127000.210862:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991540224:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127000.217237:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+37:2026:x1830945991539968:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 11257us (12122us total) trans 21474842803 rc 0/0 00000100:00100000:3.0:1746127000.217251:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1856 00002000:00100000:3.0:1746127000.217264:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1474560->1662975) req@ffff880123476300 x1830945991539968/t21474842803(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.217276:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476300 with x1830945991539968 ext(1474560->1662975) 00010000:00010000:3.0:1746127000.217287:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 37 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.217303:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 37 pid: 1507 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.217309:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880123476300 00000001:00080000:0.0:1746127000.220839:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842803 is committed 00000001:00080000:0.0:1746127000.220856:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842802 is committed 00000001:00080000:0.0:1746127000.220864:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842799 is committed 00000001:00080000:0.0:1746127000.220872:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842797 is committed 00000100:00100000:1.0:1746127000.222692:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991540224:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11819us (13440us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127000.222705:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8476 00002000:00100000:1.0:1746127000.222718:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123477b80 x1830945991540224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.222728:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477b80 with x1830945991540224 ext(1048576->2097151) 00002000:00010000:1.0:1746127000.222734:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123477b80 00000100:00100000:2.0:1746127000.224940:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.225095:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991540352 00000100:00100000:3.0:1746127000.225104:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991540352 00010000:00010000:3.0:1746127000.225185:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 7 pid: 1507 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.225217:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9953 00000100:00100000:3.0:1746127000.225225:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991540352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127000.225239:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127000.225260:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 7 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.225273:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 7 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.225296:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6400/0x34dc807b6ef9010 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b9 expref: 7 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.225322:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.225324:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.225332:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.225340:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.225375:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.225387:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994209280:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127000.225451:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.228960:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994209280:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127000.228982:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.229039:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2026:x1830945991540352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3814us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.229051:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9953 00000100:00100000:0.0:1746127000.231536:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.231704:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991540480 00000100:00100000:2.0:1746127000.231713:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991540480 00000100:00100000:0.0:1746127000.232662:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.232759:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991540608 00000100:00100000:2.0:1746127000.232764:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991540608 00000100:00100000:2.0:1746127000.232788:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21319 00000100:00100000:2.0:1746127000.232794:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+6:4144:x1830945991540480:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.232812:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.232830:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ad1 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.232854:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.232855:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.232862:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.232875:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.232885:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11e00, rc 0) 00000100:00100000:2.0:1746127000.232925:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4144:x1830945991540480:12345-192.168.203.42@tcp:101:cat.0 Request processed in 131us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.232930:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21319 00000100:00100000:2.0:1746127000.232942:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21320 00000100:00100000:2.0:1746127000.232946:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4140:x1830945991540608:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127000.232952:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.232961:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ad8 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.232975:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.232982:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.232986:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.232987:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.232989:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 9 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.233014:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.233024:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.233035:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209408:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.233122:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.233146:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 28 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.233154:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209536:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.233180:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.234528:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.235921:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991540864 00000100:00100000:1.0:1746127000.235932:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991540864 00002000:00100000:1.0:1746127000.235982:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cbb3800 x1830945991540864/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.235992:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb3800 with x1830945991540864 ext(1048576->2097151) 00002000:00010000:1.0:1746127000.235998:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb3800 00000100:00100000:1.0:1746127000.236049:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8477 00000100:00100000:1.0:1746127000.236059:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2028:x1830945991540864:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127000.238289:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.238423:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991540992 00000100:00100000:3.0:1746127000.238432:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991540992 00000100:00100000:2.0:1746127000.238452:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209408:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.238465:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209536:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.238470:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 29 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.238493:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 9 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.238504:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9954 00000100:00100000:3.0:1746127000.238511:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991540992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127000.238511:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10600, rc 0) 00010000:00010000:3.0:1746127000.238523:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127000.238543:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 29 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.238551:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4140:x1830945991540608:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5603us (5890us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127000.238558:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 29 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.238562:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21320 00010000:00010000:3.0:1746127000.238583:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef919f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ab5 expref: 29 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.238602:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.238629:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991540992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 118us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.238636:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9954 00000100:00100000:0.0:1746127000.246103:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.246287:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991541120 00000100:00100000:3.0:1746127000.246296:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991541120 00010000:00010000:3.0:1746127000.246337:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.247086:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9955 00000100:00100000:3.0:1746127000.247095:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991541120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127000.247109:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127000.247147:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.247162:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.247543:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef91ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ac3 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.247572:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.247575:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.247582:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 8 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.247590:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 8 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.247624:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 8 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.247637:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994209664:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127000.247730:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.248331:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2028:x1830945991540864:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12273us (13805us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127000.248341:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8477 00002000:00100000:2.0:1746127000.248349:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cbb3800 x1830945991540864/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.248358:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb3800 with x1830945991540864 ext(1048576->2097151) 00002000:00010000:2.0:1746127000.248363:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb3800 00000100:00100000:0.0:1746127000.253410:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.253478:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991541376 00000100:00100000:2.0:1746127000.253489:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991541376 00000100:00100000:3.0:1746127000.253574:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994209664:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127000.253595:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.253638:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991541120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6544us (7546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.253648:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9955 00002000:00100000:2.0:1746127000.253726:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1245184->1249279) req@ffff880096631f80 x1830945991541376/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.253735:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631f80 with x1830945991541376 ext(1245184->1249279) 00002000:00010000:2.0:1746127000.253740:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096631f80 00000100:00100000:2.0:1746127000.253755:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8478 00000100:00100000:2.0:1746127000.253761:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991541376:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127000.253875:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991541376:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 113us (474us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127000.253881:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8478 00002000:00100000:2.0:1746127000.253885:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1245184->1249279) req@ffff880096631f80 x1830945991541376/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.253892:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631f80 with x1830945991541376 ext(1245184->1249279) 00002000:00010000:2.0:1746127000.253895:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096631f80 00000100:00100000:0.0:1746127000.256406:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.256466:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991541632 00000100:00100000:3.0:1746127000.256475:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991541632 00002000:00100000:3.0:1746127000.256508:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880096631180 x1830945991541632/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.256517:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631180 with x1830945991541632 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.256522:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096631180 00000100:00100000:3.0:1746127000.256549:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8479 00000100:00100000:3.0:1746127000.256556:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991541632:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127000.257275:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.257314:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991541888 00000100:00100000:2.0:1746127000.257319:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991541888 00000100:00100000:2.0:1746127000.257346:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6543 00000100:00100000:2.0:1746127000.257350:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4140:x1830945991541888:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127000.258160:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4140:x1830945991541888:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 807us (882us total) trans 8589938139 rc 0/0 00000100:00100000:2.0:1746127000.258168:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6543 00000100:00100000:0.0:1746127000.266825:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.266872:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.266902:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.266924:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.266963:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991542400 00000100:00100000:0.0:1746127000.266971:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991542400 00000100:00100000:3.0:1746127000.266997:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991542016 00000100:00100000:3.0:1746127000.267002:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991542016 00000100:00100000:0.0:1746127000.267017:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21321 00000100:00100000:0.0:1746127000.267023:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4135:x1830945991542400:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:3.0:1746127000.267043:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17214 00010000:00010000:0.0:1746127000.267043:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127000.267049:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4147:x1830945991542016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127000.267061:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ae6 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.267063:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.267090:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6ef91d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52adf expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.267105:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.267113:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127000.267114:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127000.267118:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.267167:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.267174:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.267177:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.267186:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 7 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.267187:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.267198:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127000.267199:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209792:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.267203:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.267208:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127000.267272:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.267357:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991542272 00000100:00100000:0.0:1746127000.267360:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991542272 00002000:00100000:0.0:1746127000.267386:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880095ca9180 x1830945991542272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 504/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.267395:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9180 with x1830945991542272 ext(2097152->4194303) 00002000:00010000:0.0:1746127000.267399:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca9180 00000100:00100000:0.0:1746127000.267411:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991542656 00000100:00100000:0.0:1746127000.267414:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991542656 00002000:00100000:0.0:1746127000.267424:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880095caa680 x1830945991542656/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.267430:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caa680 with x1830945991542656 ext(2097152->4194303) 00002000:00010000:0.0:1746127000.267433:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caa680 00000100:00100000:0.0:1746127000.267445:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8480 00000100:00100000:0.0:1746127000.267451:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2028:x1830945991542272:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127000.267693:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8481 00000100:00100000:2.0:1746127000.267900:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991542656:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:3.0:1746127000.268154:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6ef91e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268164:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6ef91e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268174:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6ef91e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127000.268214:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127000.268218:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127000.268233:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6ef91e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268242:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6ef91e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268248:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268253:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268258:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268263:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098672600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127000.268266:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268271:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268280:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127000.268283:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127000.268287:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268291:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef91d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268320:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268325:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268329:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268333:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098673000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127000.268334:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268338:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268343:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c81b300) 00010000:00010000:3.0:1746127000.268344:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127000.268346:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268350:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673000/0x34dc807b6ef91de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.268375:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6ef91d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52adf expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.268383:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6ef91e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52adf expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.268389:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127000.268391:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127000.268394:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673400, rc 0) 00000100:00100000:3.0:1746127000.268429:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4147:x1830945991542016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1380us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.268436:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17214 00000100:00100000:0.0:1746127000.276684:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.276764:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209792:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.276778:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991542784 00000100:00100000:2.0:1746127000.276784:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991542784 00010000:00010000:1.0:1746127000.276795:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 31 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.276812:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2400, rc 0) 00002000:00100000:2.0:1746127000.276822:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1249279) req@ffff880095ca9500 x1830945991542784/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746127000.276829:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991541632:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 20270us (20427us total) trans 0 rc 1048576/1048576 00002000:00100000:2.0:1746127000.276831:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9500 with x1830945991542784 ext(1048576->1249279) 00000100:00100000:1.0:1746127000.276832:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4135:x1830945991542400:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 9809us (9928us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127000.276837:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 8 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.276839:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21321 00000100:00100000:3.0:1746127000.276840:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8479 00002000:00100000:3.0:1746127000.276846:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880096631180 x1830945991541632/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746127000.276852:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 8 pid: 12333 timeout: 995 lvb_type: 0 00002000:00100000:3.0:1746127000.276854:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631180 with x1830945991541632 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.276858:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096631180 00002000:00010000:2.0:1746127000.276858:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca9500 00000100:00100000:3.0:1746127000.276871:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1857 00000100:00100000:3.0:1746127000.276879:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991542784:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127000.282426:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.282493:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.282612:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.282708:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.282751:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991542912 00000100:00100000:1.0:1746127000.282758:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991542912 00000100:00100000:1.0:1746127000.282955:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21322 00000100:00100000:1.0:1746127000.282963:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991542912:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.282976:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.283100:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc400/0x34dc807b6ef91ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52aed expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.283168:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209920:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.283224:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.283600:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543040 00000100:00100000:1.0:1746127000.283600:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543168 00000100:00100000:3.0:1746127000.283604:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543296 00000100:00100000:2.0:1746127000.283604:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543040 00000100:00100000:1.0:1746127000.283604:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543168 00000100:00100000:3.0:1746127000.283614:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543296 00000100:00100000:1.0:1746127000.283626:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21323 00000100:00100000:1.0:1746127000.283630:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991543168:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:2.0:1746127000.283631:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21324 00000100:00100000:2.0:1746127000.283635:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991543040:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.283637:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.283639:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.283646:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6ef91f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52af4 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.283646:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52afb expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.283656:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.283658:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127000.283664:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21325 00000100:00100000:2.0:1746127000.283665:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994210048:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.283665:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127000.283672:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991543296:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.283677:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127000.283684:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00010000:00010000:3.0:1746127000.283686:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.283686:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfcc00, rc 0) 00000100:00100000:1.0:1746127000.283703:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991543168:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 72us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.283709:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21323 00000100:00100000:2.0:1746127000.283970:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.284111:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2028:x1830945991542272:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16660us (17238us total) trans 0 rc 1699840/1699840 00000100:00100000:2.0:1746127000.284118:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8480 00002000:00100000:2.0:1746127000.284124:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880095ca9180 x1830945991542272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 504/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1699840/1699840 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.284147:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9180 with x1830945991542272 ext(2097152->4194303) 00002000:00010000:2.0:1746127000.284150:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca9180 00000100:00100000:0.0:1746127000.284218:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543424 00000100:00100000:0.0:1746127000.284221:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543424 00000100:00100000:0.0:1746127000.284256:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1013 00000100:00100000:0.0:1746127000.284261:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991543424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.284269:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.285037:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6ef91e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52adf expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.285053:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127000.285056:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127000.285086:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991543424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 825us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.285092:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1013 00000100:00100000:0.0:1746127000.285229:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991542656:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 17529us (18303us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746127000.285235:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8481 00002000:00100000:0.0:1746127000.285240:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880095caa680 x1830945991542656/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.285247:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caa680 with x1830945991542656 ext(2097152->4194303) 00002000:00010000:0.0:1746127000.285251:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caa680 00010000:00010000:3.0:1746127000.285807:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9201 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b02 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.285871:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994210176:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127000.285943:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.286325:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994210048:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.286346:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6ef91f3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52af4 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.286356:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6ef91f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52af4 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.286366:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11600, rc 0) 00000100:00100000:3.0:1746127000.286398:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991543040:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2761us (3904us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.286403:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21324 00002000:00010000:2.0:1746127000.286553:0:12333:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746126997 -> 1746126998 00002000:00010000:2.0:1746127000.286556:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746126997 -> 1746126998 00000100:00100000:2.0:1746127000.286564:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994209920:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.286579:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc400/0x34dc807b6ef91ec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aed expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.286586:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc400/0x34dc807b6ef91ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aed expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.286596:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfc400, rc 0) 00000100:00100000:2.0:1746127000.286624:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991542912:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3663us (4205us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.286628:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21322 00000100:00100000:2.0:1746127000.287395:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991542784:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 10516us (10721us total) trans 17179875544 rc 0/0 00000100:00100000:2.0:1746127000.287403:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1857 00002000:00100000:2.0:1746127000.287409:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1249279) req@ffff880095ca9500 x1830945991542784/t17179875544(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.287417:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9500 with x1830945991542784 ext(1048576->1249279) 00010000:00010000:2.0:1746127000.287422:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 10 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.287432:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 10 pid: 12333 timeout: 995 lvb_type: 0 00002000:00010000:2.0:1746127000.287438:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca9500 00000100:00100000:0.0:1746127000.287442:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.287481:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543552 00000100:00100000:3.0:1746127000.287486:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543552 00000100:00100000:3.0:1746127000.287514:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21326 00000100:00100000:3.0:1746127000.287519:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4144:x1830945991543552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.287529:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.287540:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b09 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.287557:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.287563:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.287564:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.287567:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 8 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.287680:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.287689:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 20 pid: 1507 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.287699:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994210304:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.287991:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.290531:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.290609:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.290637:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543808 00000100:00100000:0.0:1746127000.290642:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543808 00002000:00100000:0.0:1746127000.290670:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2424832->2822143) req@ffff880095ca8700 x1830945991543808/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.290678:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8700 with x1830945991543808 ext(2424832->2822143) 00010000:00010000:0.0:1746127000.290685:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 21 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.290694:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 21 pid: 1507 timeout: 995 lvb_type: 0 00002000:00010000:0.0:1746127000.290700:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8700 00000100:00100000:0.0:1746127000.290714:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1858 00000100:00100000:0.0:1746127000.290720:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2028:x1830945991543808:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127000.290774:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994210176:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.290794:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9201 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b02 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.290802:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9201 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b02 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.290811:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098672000, rc 0) 00000100:00100000:3.0:1746127000.290828:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991543296:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7158us (8120us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.290834:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21325 00000100:00100000:2.0:1746127000.291045:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994210304:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.291060:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 8 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.291068:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e88f800, rc 0) 00000100:00100000:2.0:1746127000.291096:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4144:x1830945991543552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3577us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.291100:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21326 00000100:00100000:1.0:1746127000.291254:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543680 00000100:00100000:1.0:1746127000.291258:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543680 00010000:00010000:1.0:1746127000.291273:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 10 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.291290:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9956 00000100:00100000:1.0:1746127000.291295:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991543680:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.291302:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.291311:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 10 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.291318:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 10 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.291332:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6ef91c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad8 expref: 10 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.291342:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.291344:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.291349:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.291355:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.291375:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.291384:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994210432:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.291427:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.294663:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.294904:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991543936 00000100:00100000:3.0:1746127000.294914:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991543936 00000100:00100000:3.0:1746127000.294950:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21327 00000100:00100000:3.0:1746127000.294957:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991543936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.294969:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.294981:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e88e000/0x34dc807b6ef920f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b10 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.294985:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.295008:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991544064 00000100:00100000:2.0:1746127000.295014:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991544064 00000100:00100000:3.0:1746127000.295024:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994210560:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.295044:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21328 00000100:00100000:2.0:1746127000.295050:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991544064:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.295063:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.295089:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664c600/0x34dc807b6ef9216 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b17 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.295097:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.295143:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994210688:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.295194:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.295874:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.296023:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991544192 00000100:00100000:3.0:1746127000.296027:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991544192 00000100:00100000:3.0:1746127000.296048:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21329 00000100:00100000:3.0:1746127000.296052:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991544192:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.296061:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.296081:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e88fa00/0x34dc807b6ef921d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b1e expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.296107:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994210816:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127000.296143:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.296189:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.296203:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991544576 00000100:00100000:3.0:1746127000.296205:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991544576 00000100:00100000:1.0:1746127000.296353:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994210432:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.296367:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127000.296388:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.296389:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991543680:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5093us (5861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.296397:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9956 00000100:00100000:2.0:1746127000.296419:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991544704 00000100:00100000:2.0:1746127000.296422:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991544704 00002000:00100000:2.0:1746127000.296446:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (2007040->2011135) req@ffff880122387100 x1830945991544704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.296454:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387100 with x1830945991544704 ext(2007040->2011135) 00002000:00010000:2.0:1746127000.296458:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122387100 00000100:00100000:2.0:1746127000.296472:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8482 00000100:00100000:2.0:1746127000.296477:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991544704:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127000.296565:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991544704:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 87us (176us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127000.296570:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8482 00002000:00100000:2.0:1746127000.296575:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (2007040->2011135) req@ffff880122387100 x1830945991544704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.296580:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387100 with x1830945991544704 ext(2007040->2011135) 00002000:00010000:2.0:1746127000.296582:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122387100 00000100:00100000:3.0:1746127000.296694:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17215 00000100:00100000:3.0:1746127000.296700:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4147:x1830945991544576:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127000.296708:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.296719:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d20ec00/0x34dc807b6ef9224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b25 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.296795:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.296807:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.296819:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127000.296838:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.296846:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 13 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.296855:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994210944:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.296898:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.297710:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991543808:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 6988us (7098us total) trans 21474842804 rc 0/0 00000100:00100000:0.0:1746127000.297718:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1858 00002000:00100000:0.0:1746127000.297724:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2424832->2822143) req@ffff880095ca8700 x1830945991543808/t21474842804(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.297731:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8700 with x1830945991543808 ext(2424832->2822143) 00010000:00010000:0.0:1746127000.297737:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.297747:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00002000:00010000:0.0:1746127000.297753:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8700 00000100:00100000:3.0:1746127000.298775:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994210944:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.298792:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127000.298878:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994210560:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127000.298901:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e88e000/0x34dc807b6ef920f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b10 expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.298913:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e88e000/0x34dc807b6ef920f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b10 expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.298939:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e88e000, rc 0) 00000100:00100000:0.0:1746127000.298975:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991543936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4018us (4321us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127000.298982:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21327 00000100:00100000:0.0:1746127000.299305:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.299413:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994210816:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.299428:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e88fa00/0x34dc807b6ef921d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b1e expref: 24 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.299437:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e88fa00/0x34dc807b6ef921d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b1e expref: 24 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.299447:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e88fa00, rc 0) 00000100:00100000:3.0:1746127000.299476:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991544192:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3423us (3603us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.299482:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21329 00000100:00100000:3.0:1746127000.299519:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994210688:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.299534:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664c600/0x34dc807b6ef9216 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b17 expref: 30 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.299543:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664c600/0x34dc807b6ef9216 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b17 expref: 30 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.299551:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c600, rc 0) 00000100:00100000:3.0:1746127000.299567:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991544064:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4517us (4583us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.299572:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21328 00000100:00100000:1.0:1746127000.299629:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991544832 00000100:00100000:1.0:1746127000.299635:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991544832 00010000:00010000:1.0:1746127000.299657:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.299674:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9957 00000100:00100000:1.0:1746127000.299679:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991544832:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.299689:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.299694:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.299702:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.299717:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6ef9159 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a76 expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.299728:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.299732:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.299740:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.299746:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.299760:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.299773:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991544832:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 94us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.299777:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9957 00010000:00010000:1.0:1746127000.299788:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.299793:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127000.299807:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127000.299905:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d20ec00/0x34dc807b6ef9224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.299914:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.299920:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.299922:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746127000.299923:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129690200, rc 0) 00000100:00100000:1.0:1746127000.299940:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4147:x1830945991544576:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3241us (3751us total) trans 8589938140 rc 0/0 00000100:00100000:1.0:1746127000.299948:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17215 00000100:00100000:0.0:1746127000.300740:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.300821:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991544960 00000100:00100000:3.0:1746127000.300825:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991544960 00000100:00100000:3.0:1746127000.300908:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21330 00000100:00100000:3.0:1746127000.300915:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:4135:x1830945991544960:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127000.300927:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.300939:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b2c expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.301241:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 24 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.301250:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.301257:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.301267:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.301269:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.301272:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->1859583] (req 1048576->1859583) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 24 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.301298:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.301309:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 7 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.301320:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994211072:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.301534:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127000.301832:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.301841:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 9 pid: 3148 timeout: 995 lvb_type: 1 00000100:00100000:3.0:1746127000.301849:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994211200:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.301892:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 24 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.301899:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 24 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.301911:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994211328:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.301929:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.301946:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991545088 00000100:00100000:3.0:1746127000.301949:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991545088 00010000:00010000:3.0:1746127000.301965:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.301999:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9958 00000100:00100000:3.0:1746127000.302005:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991545088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127000.302013:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127000.302029:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.302037:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.302054:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6ef9079 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2822143) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a06 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.302064:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.302066:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.302081:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.302089:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.302109:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.302117:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994211456:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127000.302554:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.302757:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.302772:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991545216 00000100:00100000:0.0:1746127000.302775:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991545216 00000100:00100000:0.0:1746127000.302795:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21331 00000100:00100000:0.0:1746127000.302801:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:4138:x1830945991545216:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.302810:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.302819:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b33 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.302832:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.302834:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.302838:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.302849:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.302857:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb800, rc 0) 00000100:00100000:0.0:1746127000.302880:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:4138:x1830945991545216:12345-192.168.203.42@tcp:101:cat.0 Request processed in 79us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.302885:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21331 00000100:00100000:3.0:1746127000.302989:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.303030:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991545344 00000100:00100000:1.0:1746127000.303033:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991545344 00000100:00100000:1.0:1746127000.303057:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17216 00000100:00100000:1.0:1746127000.303061:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4147:x1830945991545344:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127000.303084:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.303095:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef9247 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b3a expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.303184:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.303196:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.303201:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.303218:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.303224:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.303232:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994211584:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.303377:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994211072:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.303684:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.305238:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.305313:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.305334:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991545472 00000100:00100000:0.0:1746127000.305339:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991545472 00010000:00010000:0.0:1746127000.305370:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 8 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.305389:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991545728 00000100:00100000:1.0:1746127000.305393:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991545728 00000100:00100000:0.0:1746127000.305397:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9959 00000100:00100000:0.0:1746127000.305403:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991545472:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.305410:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 15 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.305415:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127000.305428:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9960 00000100:00100000:1.0:1746127000.305432:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991545728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.305434:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 8 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.305440:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.305443:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 8 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.305445:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 15 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.305452:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 15 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.305465:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127000.305467:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6ef91bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ad1 expref: 8 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.305469:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.305478:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.305480:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127000.305484:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.305497:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127000.305509:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991545472:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.305513:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991545728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.305515:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9959 00000100:00100000:1.0:1746127000.305518:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9960 00010000:00010000:1.0:1746127000.305546:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6ef922b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b25 expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.305560:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994211584:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.305705:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.305713:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.305718:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127000.305758:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127000.305762:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127000.305775:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.305799:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef9247 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.305809:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.305815:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.305817:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127000.305819:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfd800, rc 0) 00000100:00100000:1.0:1746127000.305842:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4147:x1830945991545344:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2780us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.305847:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17216 00000100:00100000:0.0:1746127000.305849:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.305866:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991545600 00000100:00100000:0.0:1746127000.305869:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991545600 00000100:00100000:1.0:1746127000.305880:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127000.305881:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746127000.305903:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991545856 00000100:00100000:0.0:1746127000.305905:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991545856 00010000:00010000:0.0:1746127000.305914:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 26 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.305931:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9961 00000100:00100000:0.0:1746127000.305936:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991545600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127000.305940:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9962 00010000:00010000:0.0:1746127000.305943:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127000.305946:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991545856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.305949:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00010000:00010000:2.0:1746127000.305952:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.305957:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00000100:00100000:3.0:1746127000.306014:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994211456:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127000.306026:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.306044:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991545088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4040us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.306051:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9958 00000100:00100000:3.0:1746127000.306112:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994211200:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.306120:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994211328:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.307223:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 25 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.307240:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 25 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.307257:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6ef91b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52aca expref: 25 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.307276:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127000.307303:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945991545856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1356us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.307311:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9962 00010000:00010000:0.0:1746127000.307511:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfcc00/0x34dc807b6ef91fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52afb expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00010000:00010000:3.0:1746127000.307517:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->1859583] (req 1048576->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 23 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.307522:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.307524:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.307529:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 23 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.307535:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 23 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.307543:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129691800, rc 0) 00000100:00100000:3.0:1746127000.307563:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:4135:x1830945991544960:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6649us (6825us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127000.307563:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 23 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.307569:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21330 00000100:00100000:0.0:1746127000.307573:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994211712:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127000.307631:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.307861:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.307929:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991546112 00000100:00100000:2.0:1746127000.307940:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991546112 00002000:00100000:2.0:1746127000.307983:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880099195500 x1830945991546112/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.307999:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099195500 with x1830945991546112 ext(4194304->4829183) 00002000:00010000:2.0:1746127000.308004:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099195500 00000100:00100000:2.0:1746127000.308038:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8483 00000100:00100000:2.0:1746127000.308045:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991546112:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127000.310888:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.310919:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.310938:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991546240 00000100:00100000:0.0:1746127000.310945:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991546240 00000100:00100000:3.0:1746127000.310974:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991546368 00000100:00100000:0.0:1746127000.310977:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21332 00000100:00100000:3.0:1746127000.310983:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991546368 00000100:00100000:0.0:1746127000.310984:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991546240:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127000.310998:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.311012:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995eac00/0x34dc807b6ef9255 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b41 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.311026:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21333 00000100:00100000:3.0:1746127000.311033:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991546368:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127000.311050:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127000.311053:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994211840:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.311064:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011ea87000/0x34dc807b6ef925c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b48 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.311117:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994211968:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127000.313242:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.313371:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.313415:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.313440:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.313479:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991546496 00000100:00100000:3.0:1746127000.313484:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991546496 00000100:00100000:0.0:1746127000.313504:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994211712:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127000.313524:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991546624 00010000:00010000:0.0:1746127000.313524:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.313527:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991546624 00000100:00100000:3.0:1746127000.313540:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21334 00000100:00100000:3.0:1746127000.313546:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991546496:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:0.0:1746127000.313549:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991545600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7611us (7700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.313559:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9961 00010000:00010000:3.0:1746127000.313561:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.313576:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011ea86800/0x34dc807b6ef9263 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b4f expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.313598:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.313614:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994212096:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.313623:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.313628:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991547008 00000100:00100000:3.0:1746127000.313631:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991547008 00002000:00100000:3.0:1746127000.313653:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012ba55880 x1830945991547008/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.313660:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba55880 with x1830945991547008 ext(2097152->4194303) 00002000:00010000:3.0:1746127000.313664:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba55880 00000100:00100000:1.0:1746127000.313669:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21335 00000100:00100000:1.0:1746127000.313679:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991546624:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:3.0:1746127000.313683:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991547136 00000100:00100000:3.0:1746127000.313686:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991547136 00010000:00010000:1.0:1746127000.313692:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127000.313693:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8484 00002000:00100000:3.0:1746127000.313699:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012ba56a00 x1830945991547136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746127000.313700:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2027:x1830945991547008:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:1.0:1746127000.313705:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b56 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746127000.313710:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba56a00 with x1830945991547136 ext(2097152->3145727) 00002000:00010000:3.0:1746127000.313714:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba56a00 00010000:00010000:1.0:1746127000.313721:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.313723:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127000.313726:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8485 00010000:00010000:1.0:1746127000.313729:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127000.313731:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991547136:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:1.0:1746127000.313741:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.313749:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096629600, rc 0) 00000100:00100000:1.0:1746127000.313781:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991546624:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 104us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.313787:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21335 00000100:00100000:2.0:1746127000.314032:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991546112:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5986us (6329us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127000.314038:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8483 00002000:00100000:2.0:1746127000.314045:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880099195500 x1830945991546112/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.314053:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099195500 with x1830945991546112 ext(4194304->4829183) 00002000:00010000:2.0:1746127000.314057:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099195500 00000100:00100000:3.0:1746127000.314579:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.315394:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.315522:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991547392 00000100:00100000:3.0:1746127000.315528:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991547392 00002000:00100000:3.0:1746127000.315556:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1855488->1859583) req@ffff88012ba55500 x1830945991547392/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.315564:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba55500 with x1830945991547392 ext(1855488->1859583) 00002000:00010000:3.0:1746127000.315569:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba55500 00000100:00100000:3.0:1746127000.315592:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8486 00000100:00100000:3.0:1746127000.315598:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991547392:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127000.315676:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991547392:12345-192.168.203.42@tcp:3:cat.0 Request processed in 78us (284us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127000.315682:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8486 00002000:00100000:3.0:1746127000.315687:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1855488->1859583) req@ffff88012ba55500 x1830945991547392/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.315694:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba55500 with x1830945991547392 ext(1855488->1859583) 00002000:00010000:3.0:1746127000.315697:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba55500 00000100:00100000:3.0:1746127000.317540:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994211968:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.317582:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011ea87000/0x34dc807b6ef925c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b48 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.317597:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011ea87000/0x34dc807b6ef925c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b48 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.317609:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea87000, rc 0) 00000100:00100000:3.0:1746127000.317653:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991546368:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6620us (6732us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.317662:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21333 00000100:00100000:2.0:1746127000.318692:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994211840:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.318720:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995eac00/0x34dc807b6ef9255 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b41 expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.318732:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995eac00/0x34dc807b6ef9255 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b41 expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.318745:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eac00, rc 0) 00000100:00100000:2.0:1746127000.318796:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991546240:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7811us (7914us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.318802:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21332 00000100:00100000:0.0:1746127000.319237:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.319433:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991547520 00000100:00100000:2.0:1746127000.319438:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991547520 00000100:00100000:2.0:1746127000.319463:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21336 00000100:00100000:2.0:1746127000.319468:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991547520:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.319479:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.319488:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664c400/0x34dc807b6ef9271 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b5d expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.319521:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994212224:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.319568:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.319643:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994212096:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.319659:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011ea86800/0x34dc807b6ef9263 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b4f expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.319666:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011ea86800/0x34dc807b6ef9263 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b4f expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.319674:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea86800, rc 0) 00000100:00100000:3.0:1746127000.319691:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991546496:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6145us (6323us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.319695:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21334 00000100:00100000:1.0:1746127000.327633:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.327744:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994212224:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.327769:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664c400/0x34dc807b6ef9271 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b5d expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.327783:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664c400/0x34dc807b6ef9271 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b5d expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.327791:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c400, rc 0) 00000100:00100000:2.0:1746127000.327826:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991547520:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8357us (8590us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.327836:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21336 00000100:00100000:3.0:1746127000.328025:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991547136:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14293us (14401us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.328032:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8485 00002000:00100000:3.0:1746127000.328040:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012ba56a00 x1830945991547136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.328052:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba56a00 with x1830945991547136 ext(2097152->3145727) 00002000:00010000:3.0:1746127000.328056:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba56a00 00000100:00100000:3.0:1746127000.328168:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2027:x1830945991547008:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14468us (14568us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127000.328173:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8484 00002000:00100000:3.0:1746127000.328178:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012ba55880 x1830945991547008/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.328183:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba55880 with x1830945991547008 ext(2097152->4194303) 00002000:00010000:3.0:1746127000.328187:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba55880 00000100:00100000:0.0:1746127000.328273:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991547776 00000100:00100000:0.0:1746127000.328279:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991547776 00000100:00100000:0.0:1746127000.328309:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17217 00000100:00100000:0.0:1746127000.328315:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4147:x1830945991547776:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127000.328326:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.328337:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb000/0x34dc807b6ef9278 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b64 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.328406:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328423:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328432:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328440:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328445:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328450:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328454:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995ea600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127000.328457:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328462:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328470:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127000.328473:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746127000.328476:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328480:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef927f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127000.328497:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb000/0x34dc807b6ef9278 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b64 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.328504:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb000/0x34dc807b6ef9278 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b64 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.328521:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb000, rc 0) 00000100:00100000:0.0:1746127000.328542:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4147:x1830945991547776:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 227us (916us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127000.328547:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17217 00000100:00100000:0.0:1746127000.328999:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.330000:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991548032 00000100:00100000:2.0:1746127000.330005:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991548032 00000100:00100000:2.0:1746127000.330038:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6544 00000100:00100000:2.0:1746127000.330047:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4135:x1830945991548032:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127000.330232:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4135:x1830945991548032:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 184us (1232us total) trans 8589938141 rc 0/0 00000100:00100000:2.0:1746127000.330238:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6544 00000100:00100000:0.0:1746127000.331890:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.331942:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991548160 00000100:00100000:2.0:1746127000.331946:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991548160 00000100:00100000:2.0:1746127000.332029:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21337 00000100:00100000:2.0:1746127000.332033:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991548160:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.332042:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.332053:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6ef9286 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b6b expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.332097:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994212352:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.332221:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.333223:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994212352:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.333240:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6ef9286 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b6b expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.333273:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6ef9286 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b6b expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.333287:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664dc00, rc 0) 00000100:00100000:2.0:1746127000.333369:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991548160:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1333us (1479us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.333375:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21337 00000100:00100000:0.0:1746127000.334654:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.334824:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991548416 00000100:00100000:2.0:1746127000.334829:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991548416 00000100:00100000:2.0:1746127000.334857:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6545 00000100:00100000:2.0:1746127000.334862:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4147:x1830945991548416:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1746127000.334991:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4147:x1830945991548416:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 128us (339us total) trans 8589938142 rc 0/0 00000100:00100000:2.0:1746127000.334996:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6545 00000100:00100000:0.0:1746127000.337806:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.337845:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.337893:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991548544 00000100:00100000:3.0:1746127000.337900:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991548544 00000100:00100000:3.0:1746127000.337934:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991548672 00000100:00100000:3.0:1746127000.337937:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991548672 00000100:00100000:0.0:1746127000.337945:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21338 00000100:00100000:0.0:1746127000.337952:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991548544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.337966:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.337978:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6ef928d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b72 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.337997:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21339 00000100:00100000:3.0:1746127000.338002:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991548672:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.338007:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.338015:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9294 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b79 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.338018:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994212480:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127000.338034:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994212608:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.338094:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.338300:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.339630:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994212480:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.339654:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6ef928d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b72 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.339664:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6ef928d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b72 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.339672:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ea800, rc 0) 00000100:00100000:2.0:1746127000.339695:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991548544:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1743us (1893us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.339701:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21338 00000100:00100000:3.0:1746127000.343307:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994212608:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.343330:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9294 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b79 expref: 8 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.343348:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9294 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b79 expref: 8 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.343677:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad000, rc 0) 00000100:00100000:3.0:1746127000.343729:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991548672:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5725us (5881us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.343736:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21339 00000100:00100000:0.0:1746127000.350526:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.350670:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991548928 00000100:00100000:3.0:1746127000.350677:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991548928 00002000:00100000:3.0:1746127000.350708:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012ced4380 x1830945991548928/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.350714:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4380 with x1830945991548928 ext(4194304->4829183) 00002000:00010000:3.0:1746127000.350718:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced4380 00000100:00100000:3.0:1746127000.350743:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8487 00000100:00100000:3.0:1746127000.350749:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991548928:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127000.357899:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991548928:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7142us (7370us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127000.357910:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8487 00002000:00100000:3.0:1746127000.357921:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012ced4380 x1830945991548928/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.357933:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4380 with x1830945991548928 ext(4194304->4829183) 00002000:00010000:3.0:1746127000.357938:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced4380 00000100:00100000:0.0:1746127000.363515:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.365862:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.365897:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991549056 00000100:00100000:1.0:1746127000.365905:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991549056 00000100:00100000:1.0:1746127000.365935:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991549184 00000100:00100000:1.0:1746127000.365936:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991549184 00000100:00100000:1.0:1746127000.365955:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21340 00000100:00100000:1.0:1746127000.365961:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991549056:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127000.365976:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.365990:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef929b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b80 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.366031:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994212736:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.366472:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21341 00000100:00100000:2.0:1746127000.366484:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991549184:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.366495:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.366503:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6ef92a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b87 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.366512:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.366526:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994212864:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.366549:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.369232:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994212736:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.369283:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef929b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b80 expref: 10 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.369297:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef929b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b80 expref: 10 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.369310:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de200, rc 0) 00000100:00100000:2.0:1746127000.369319:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994212864:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.369338:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6ef92a2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b87 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.369347:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6ef92a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b87 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127000.369352:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991549056:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3391us (5844us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.369366:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21340 00010000:00010000:2.0:1746127000.369520:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664dc00, rc 0) 00000100:00100000:2.0:1746127000.369542:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991549184:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3063us (3684us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.369548:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21341 00000100:00100000:0.0:1746127000.373572:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.373613:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.373669:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991549440 00000100:00100000:2.0:1746127000.373675:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991549440 00000100:00100000:2.0:1746127000.373711:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991549312 00000100:00100000:2.0:1746127000.373713:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991549312 00000100:00100000:2.0:1746127000.373726:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21342 00000100:00100000:2.0:1746127000.373732:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991549440:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.373747:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.373759:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664d000/0x34dc807b6ef92a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b95 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.373803:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994212992:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.373874:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.373890:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21343 00000100:00100000:1.0:1746127000.373897:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991549312:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127000.373906:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.373915:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfe00/0x34dc807b6ef92b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b8e expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.373940:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994213120:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.374432:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.376981:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994213120:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.377010:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfe00/0x34dc807b6ef92b0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b8e expref: 10 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.377022:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfe00/0x34dc807b6ef92b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b8e expref: 10 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.377034:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dfe00, rc 0) 00000100:00100000:1.0:1746127000.377067:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991549312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3171us (3453us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.377089:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21343 00000100:00100000:2.0:1746127000.377527:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994212992:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.377544:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664d000/0x34dc807b6ef92a9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b95 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.377553:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664d000/0x34dc807b6ef92a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b95 expref: 8 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.377570:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d000, rc 0) 00000100:00100000:2.0:1746127000.377600:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991549440:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3868us (4034us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.377605:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21342 00000100:00100000:0.0:1746127000.469908:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.470803:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991549696 00000100:00100000:2.0:1746127000.470810:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991549696 00000100:00100000:2.0:1746127000.470863:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17218 00000100:00100000:2.0:1746127000.470870:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4155:x1830945991549696:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.470889:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.470903:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6ef92b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52b9c expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.470956:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.470967:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.470976:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.470986:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.470990:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.470995:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471061:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471098:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471104:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127000.471112:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127000.471189:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471195:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471199:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471204:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471209:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009664c600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127000.471213:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471218:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471227:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127000.471229:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127000.471232:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471237:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c600/0x34dc807b6ef92be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471261:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471266:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471270:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471273:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009664d000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127000.471275:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471279:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471284:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619000) 00010000:00010000:2.0:1746127000.471286:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127000.471288:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471295:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6ef92c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.471324:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6ef92b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.471334:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 35 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.471339:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127000.471340:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127000.471342:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c400, rc 0) 00000100:00100000:2.0:1746127000.471381:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4155:x1830945991549696:12345-192.168.203.42@tcp:101:cat.0 Request processed in 511us (1480us total) trans 8589938143 rc 0/0 00000100:00100000:2.0:1746127000.471387:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17218 00000100:00100000:0.0:1746127000.474224:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.474300:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991549952 00000100:00100000:2.0:1746127000.474308:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991549952 00000100:00100000:2.0:1746127000.474386:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6546 00000100:00100000:2.0:1746127000.474396:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4155:x1830945991549952:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127000.475683:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4155:x1830945991549952:12345-192.168.203.42@tcp:35:cat.0 Request processed in 1287us (1463us total) trans 8589938144 rc 0/0 00000100:00100000:2.0:1746127000.475691:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6546 00000100:00100000:0.0:1746127000.480045:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.480758:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991550080 00000100:00100000:2.0:1746127000.480766:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991550080 00000100:00100000:2.0:1746127000.480809:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21344 00000100:00100000:2.0:1746127000.480818:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991550080:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.480838:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.480851:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef92da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ba3 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.480934:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994213248:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.481398:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00002000:00010000:2.0:1746127000.487010:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746126998 -> 1746126999 00000100:00100000:2.0:1746127000.487031:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994213248:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.487057:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef92da lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ba3 expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.487081:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dadc00/0x34dc807b6ef92da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ba3 expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.487549:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dadc00, rc 0) 00000100:00100000:2.0:1746127000.487598:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991550080:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6782us (8087us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.487607:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21344 00000100:00100000:0.0:1746127000.492773:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.492969:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991550208 00000100:00100000:2.0:1746127000.492978:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991550208 00000100:00100000:2.0:1746127000.493203:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21345 00000100:00100000:2.0:1746127000.493210:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4155:x1830945991550208:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.493226:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.493240:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52baa expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.493268:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 8 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.493274:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.493276:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.493279:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 30 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.493301:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 8 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.493310:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 8 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.493720:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994213376:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.494047:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.497440:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.497596:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991550336 00000100:00100000:3.0:1746127000.497604:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991550336 00002000:00100000:3.0:1746127000.497643:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1613824->2097151) req@ffff88009c428000 x1830945991550336/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127000.497706:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994213376:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.497729:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 30 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.497744:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d000, rc 0) 00000100:00100000:2.0:1746127000.497780:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4155:x1830945991550208:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4570us (5014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.497787:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21345 00002000:00100000:3.0:1746127000.498305:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428000 with x1830945991550336 ext(1613824->2097151) 00010000:00010000:3.0:1746127000.498312:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 9 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.498323:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 9 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.498329:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c428000 00000100:00100000:3.0:1746127000.498358:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1859 00000100:00100000:3.0:1746127000.498365:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991550336:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127000.513431:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991550336:12345-192.168.203.42@tcp:4:cat.0 Request processed in 15059us (15988us total) trans 17179875545 rc 0/0 00000100:00100000:3.0:1746127000.513442:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1859 00002000:00100000:3.0:1746127000.513452:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1613824->2097151) req@ffff88009c428000 x1830945991550336/t17179875545(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.513460:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428000 with x1830945991550336 ext(1613824->2097151) 00010000:00010000:3.0:1746127000.513469:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 11 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.513482:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 11 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.513488:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c428000 00000100:00100000:1.0:1746127000.520420:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.520463:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.520496:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991550720 00000100:00100000:1.0:1746127000.520503:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991550720 00010000:00010000:1.0:1746127000.520530:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 11 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.520556:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9963 00000100:00100000:1.0:1746127000.520563:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991550720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.520574:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.520588:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 11 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.520596:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 11 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.520615:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef91a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52abc expref: 11 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.520633:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.520634:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.520640:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.520646:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.520670:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.520678:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994213504:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.520731:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.520740:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991550592 00000100:00100000:0.0:1746127000.520744:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991550592 00000100:00100000:0.0:1746127000.520768:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17219 00000100:00100000:0.0:1746127000.520773:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4157:x1830945991550592:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127000.520787:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.521292:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dfa00/0x34dc807b6ef92e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bb1 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.521345:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521354:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521367:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521376:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521382:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521387:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521528:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521537:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521542:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127000.521551:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127000.521600:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521606:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521610:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521614:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8df400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127000.521617:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521621:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521627:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127000.521630:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127000.521632:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521639:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df400/0x34dc807b6ef92ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521646:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521650:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521700:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521706:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8de200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127000.521709:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521713:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521720:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662ef00) 00010000:00010000:1.0:1746127000.521722:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127000.521724:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521728:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6ef92f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127000.521802:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dfa00/0x34dc807b6ef92e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 21 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.521812:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.521822:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.521824:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127000.521826:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dec00, rc 0) 00000100:00100000:1.0:1746127000.522317:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4157:x1830945991550592:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1542us (1903us total) trans 8589938145 rc 0/0 00000100:00100000:1.0:1746127000.522324:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17219 00000100:00100000:1.0:1746127000.526782:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994213504:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.526799:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.526846:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991550720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6282us (6380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.526855:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9963 00000100:00100000:0.0:1746127000.531511:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.531548:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.531588:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.531648:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991550848 00000100:00100000:3.0:1746127000.531656:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991550848 00000100:00100000:1.0:1746127000.531660:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991550976 00000100:00100000:1.0:1746127000.531663:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991550976 00000100:00100000:3.0:1746127000.531690:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991551104 00000100:00100000:3.0:1746127000.531692:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991551104 00000100:00100000:1.0:1746127000.531752:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21346 00000100:00100000:1.0:1746127000.531760:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991550848:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127000.531776:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.531789:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bb8 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.531808:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.531810:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.531821:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 12 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127000.531832:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21347 00010000:00010000:1.0:1746127000.531834:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 12 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127000.531838:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991551104:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.531845:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.531848:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de200, rc 0) 00010000:00010000:3.0:1746127000.531852:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011ea86000/0x34dc807b6ef9312 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bc6 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.531882:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994213632:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.531900:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21348 00000100:00100000:0.0:1746127000.531906:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991550976:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.531916:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.531923:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995ea400/0x34dc807b6ef9319 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bbf expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.531946:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994213760:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.531987:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991550848:12345-192.168.203.42@tcp:101:cat.0 Request processed in 227us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.531992:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21346 00000100:00100000:3.0:1746127000.532487:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.532499:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.536122:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:1.0:1746127000.536160:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746126998 -> 1746126999 00000100:00100000:0.0:1746127000.536164:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.536177:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994213760:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127000.536188:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127000.536200:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995ea400/0x34dc807b6ef9319 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bbf expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.536211:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995ea400/0x34dc807b6ef9319 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bbf expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127000.536213:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991551360 00000100:00100000:0.0:1746127000.536218:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991551360 00010000:00010000:1.0:1746127000.536222:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ea400, rc 0) 00002000:00100000:0.0:1746127000.536247:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c748e00 x1830945991551360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.536255:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748e00 with x1830945991551360 ext(1048576->2097151) 00000100:00100000:1.0:1746127000.536256:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991550976:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4350us (4708us total) trans 0 rc 301/301 00002000:00010000:0.0:1746127000.536259:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c748e00 00000100:00100000:1.0:1746127000.536264:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21348 00000100:00100000:0.0:1746127000.536270:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991551616 00000100:00100000:0.0:1746127000.536272:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991551616 00002000:00100000:0.0:1746127000.536280:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2007039) req@ffff88009c749500 x1830945991551616/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.536285:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749500 with x1830945991551616 ext(1048576->2007039) 00002000:00010000:0.0:1746127000.536288:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c749500 00000100:00100000:0.0:1746127000.536294:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991551872 00000100:00100000:0.0:1746127000.536296:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991551872 00002000:00100000:0.0:1746127000.536305:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1859584->2097151) req@ffff88009c749180 x1830945991551872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.536310:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749180 with x1830945991551872 ext(1859584->2097151) 00002000:00010000:0.0:1746127000.536313:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c749180 00000100:00100000:0.0:1746127000.536321:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8488 00000100:00100000:0.0:1746127000.536326:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991551360:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:3.0:1746127000.536591:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746126998 -> 1746126999 00000100:00100000:3.0:1746127000.536603:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994213632:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.536619:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011ea86000/0x34dc807b6ef9312 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bc6 expref: 8 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.536626:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011ea86000/0x34dc807b6ef9312 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bc6 expref: 8 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127000.537057:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8489 00000100:00100000:1.0:1746127000.537064:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991551616:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127000.537583:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8490 00000100:00100000:1.0:1746127000.537589:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991551872:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:3.0:1746127000.538384:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea86000, rc 0) 00000100:00100000:3.0:1746127000.538415:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991551104:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6577us (6826us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.538421:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21347 00000100:00100000:0.0:1746127000.550829:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.550914:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991552128 00000100:00100000:2.0:1746127000.550923:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991552128 00002000:00100000:2.0:1746127000.550959:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c748700 x1830945991552128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.550969:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748700 with x1830945991552128 ext(1048576->2097151) 00002000:00010000:2.0:1746127000.550973:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c748700 00000100:00100000:2.0:1746127000.551005:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8491 00000100:00100000:2.0:1746127000.551013:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991552128:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127000.556572:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.561881:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991552256 00000100:00100000:2.0:1746127000.561891:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991552256 00000100:00100000:2.0:1746127000.561938:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17220 00000100:00100000:2.0:1746127000.561946:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4161:x1830945991552256:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127000.561963:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.561976:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6ef9320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bcd expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.562020:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562029:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562037:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562046:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562051:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562058:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562124:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562143:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562148:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127000.562174:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127000.562178:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127000.562188:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562194:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562199:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562204:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562209:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562213:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096643000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127000.562216:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562221:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562229:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127000.562231:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127000.562235:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562239:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643000/0x34dc807b6ef9327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562255:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562261:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562265:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562268:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096643800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127000.562270:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562274:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562280:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619000) 00010000:00010000:2.0:1746127000.562282:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127000.562283:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562287:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef932e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127000.562314:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6ef9320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 16 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.562328:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.562334:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127000.562336:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127000.562338:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642e00, rc 0) 00000100:00100000:2.0:1746127000.562407:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4161:x1830945991552256:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 460us (5840us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.562413:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17220 00000100:00100000:2.0:1746127000.562626:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991551872:12345-192.168.203.42@tcp:3:cat.0 Request processed in 25036us (26436us total) trans 0 rc 237568/237568 00000100:00100000:2.0:1746127000.562632:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8490 00002000:00100000:2.0:1746127000.562639:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1859584->2097151) req@ffff88009c749180 x1830945991551872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 237568/237568 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.562647:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749180 with x1830945991551872 ext(1859584->2097151) 00002000:00010000:2.0:1746127000.562651:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c749180 00000100:00100000:1.0:1746127000.564401:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991551616:12345-192.168.203.42@tcp:3:cat.0 Request processed in 27334us (28232us total) trans 0 rc 958464/958464 00000100:00100000:1.0:1746127000.564413:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8489 00002000:00100000:1.0:1746127000.564421:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2007039) req@ffff88009c749500 x1830945991551616/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.564429:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749500 with x1830945991551616 ext(1048576->2007039) 00002000:00010000:1.0:1746127000.564434:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c749500 00000100:00100000:3.0:1746127000.570182:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991552128:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19163us (19354us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.570195:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8491 00002000:00100000:3.0:1746127000.570205:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c748700 x1830945991552128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.570213:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748700 with x1830945991552128 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.570217:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c748700 00000100:00100000:2.0:1746127000.570321:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991551360:12345-192.168.203.42@tcp:3:cat.0 Request processed in 33994us (34206us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127000.570328:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8488 00002000:00100000:2.0:1746127000.570333:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c748e00 x1830945991551360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.570339:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748e00 with x1830945991551360 ext(1048576->2097151) 00002000:00010000:2.0:1746127000.570342:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c748e00 00000100:00100000:0.0:1746127000.572377:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.572406:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.572409:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.572433:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991552896 00000100:00100000:2.0:1746127000.572440:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991552896 00000100:00100000:2.0:1746127000.572477:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17221 00000100:00100000:2.0:1746127000.572484:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4163:x1830945991552896:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127000.572503:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.572519:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6ef933c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52be9 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572593:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.572605:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572612:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 37 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572618:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572623:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572632:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 7/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.572657:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572667:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.572677:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994213888:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.572737:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572743:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 19 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.572749:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214016:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.572765:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 37 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572770:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 37 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.572776:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214144:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.572788:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.572793:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.572798:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214272:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.572808:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.574811:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991552384 00000100:00100000:1.0:1746127000.574820:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991552384 00000100:00100000:0.0:1746127000.574870:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.574901:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991552512 00000100:00100000:1.0:1746127000.574904:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991552512 00000100:00100000:1.0:1746127000.574924:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991552640 00000100:00100000:1.0:1746127000.574926:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991552640 00000100:00100000:0.0:1746127000.574934:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21349 00000100:00100000:0.0:1746127000.574942:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991552384:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127000.574955:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.574967:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bd4 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.574986:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.574988:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.574994:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.575005:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127000.575014:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ebc00, rc 0) 00000100:00100000:0.0:1746127000.575042:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991552384:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 101us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.575286:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21350 00000100:00100000:1.0:1746127000.575293:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991552512:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127000.575299:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.575306:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9351 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bdb expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.575337:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994214400:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.575372:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.575387:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21351 00000100:00100000:1.0:1746127000.575392:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991552640:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127000.575398:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.575406:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc200/0x34dc807b6ef9358 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52be2 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.575426:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994214528:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.575446:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.577607:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21349 00000100:00100000:2.0:1746127000.577716:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.577794:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991553024 00000100:00100000:1.0:1746127000.577800:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991553024 00010000:00010000:1.0:1746127000.577823:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 15 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.577852:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9964 00000100:00100000:1.0:1746127000.577858:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991553024:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.577868:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.577873:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 15 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.577882:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 15 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.577897:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.577900:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.577907:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.577911:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.577945:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991553024:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.577950:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9964 00010000:00010000:2.0:1746127000.578890:0:7258:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from blocking AST (req@ffff880122386a00 x1830945994213888) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.578902:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9335 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bcd expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.578930:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994213888:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.578940:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214016:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.578947:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214144:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.578952:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214272:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.578968:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127000.578971:0:7258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.578977:0:7258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.578984:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127000.579227:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.579289:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.579309:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991553152 00000100:00100000:0.0:1746127000.579312:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991553152 00010000:00010000:0.0:1746127000.579331:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 20 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.579414:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994214400:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127000.579429:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9351 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bdb expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.579439:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9351 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bdb expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127000.579450:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfc800, rc 0) 00000100:00100000:1.0:1746127000.579472:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991552512:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 4180us (7064us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.579477:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21350 00000100:00100000:2.0:1746127000.580271:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991553408 00000100:00100000:2.0:1746127000.580276:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991553408 00000100:00100000:1.0:1746127000.580288:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9965 00010000:00010000:2.0:1746127000.580291:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.580295:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991553152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.580306:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127000.580309:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9966 00010000:00010000:1.0:1746127000.580312:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 20 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.580314:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991553408:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127000.580320:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.580320:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 20 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.580324:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.580333:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dec00/0x34dc807b6ef92fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb1 expref: 20 pid: 13448 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.580958:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127000.581054:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.581075:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd800/0x34dc807b6ef924e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b3a expref: 14 pid: 13448 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.581084:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127000.581088:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.581094:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.581098:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127000.581171:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991553408:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 856us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.581177:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9966 00010000:00010000:1.0:1746127000.581258:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127000.581262:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.581269:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127000.581276:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.581294:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991553152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 999us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.581300:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9965 00000100:00100000:2.0:1746127000.581335:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991553280 00000100:00100000:2.0:1746127000.581338:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991553280 00010000:00010000:2.0:1746127000.581351:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 38 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.581388:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9967 00000100:00100000:3.0:1746127000.581395:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991553280:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127000.581404:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127000.581408:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 38 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.581415:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 38 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.581427:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6ef92cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b9c expref: 38 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.581437:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127000.581441:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.581447:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.581452:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.581467:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127000.581562:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.581572:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:0.0:1746127000.581651:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:3.0:1746127000.581746:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991553280:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 351us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.581752:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9967 00000100:00100000:3.0:1746127000.581800:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994214528:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127000.581809:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127000.581818:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc200/0x34dc807b6ef9358 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be2 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127000.581827:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991553536 00010000:00010000:3.0:1746127000.581828:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc200/0x34dc807b6ef9358 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be2 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127000.581830:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991553536 00010000:00010000:3.0:1746127000.581835:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfc200, rc 0) 00000100:00100000:1.0:1746127000.581850:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21352 00000100:00100000:3.0:1746127000.581852:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991552640:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 6459us (6984us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127000.581855:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4160:x1830945991553536:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:3.0:1746127000.581857:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21351 00010000:00010000:1.0:1746127000.581865:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.581875:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bf0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.581892:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.581898:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127000.581900:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127000.581903:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.581919:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.581923:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6ef933c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 38 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.581928:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 29 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.581942:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994214656:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127000.581946:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 37 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.581955:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127000.581958:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746127000.581959:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643400, rc 0) 00000100:00100000:0.0:1746127000.581981:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4163:x1830945991552896:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 9498us (9570us total) trans 8589938146 rc 0/0 00000100:00100000:1.0:1746127000.581982:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.581986:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17221 00000100:00100000:1.0:1746127000.584539:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.584552:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994214656:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.584575:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.584587:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfd200, rc 0) 00000100:00100000:2.0:1746127000.584632:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4160:x1830945991553536:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2776us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.584640:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21352 00000100:00100000:3.0:1746127000.584780:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991553664 00000100:00100000:3.0:1746127000.584785:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991553664 00002000:00100000:3.0:1746127000.584813:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (2007040->2097151) req@ffff880099195880 x1830945991553664/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.584820:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099195880 with x1830945991553664 ext(2007040->2097151) 00010000:00010000:3.0:1746127000.584825:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 30 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.584835:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 30 pid: 12333 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.584840:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099195880 00000100:00100000:3.0:1746127000.584853:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1860 00000100:00100000:3.0:1746127000.584857:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991553664:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127000.585220:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.585239:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991553920 00000100:00100000:0.0:1746127000.585242:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991553920 00000100:00100000:0.0:1746127000.585273:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17222 00000100:00100000:0.0:1746127000.585279:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4161:x1830945991553920:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127000.585291:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.585302:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb000/0x34dc807b6ef936d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bf7 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.585332:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.585348:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991554048 00010000:00010000:0.0:1746127000.585351:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00000100:00100000:2.0:1746127000.585352:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991554048 00010000:00010000:0.0:1746127000.585364:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585372:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:2.0:1746127000.585378:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21353 00010000:00010000:0.0:1746127000.585381:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00000100:00100000:2.0:1746127000.585384:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4155:x1830945991554048:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127000.585386:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.585391:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.585391:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.585399:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52bfe expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.585413:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.585417:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.585425:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.585433:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a4c00, rc 0) 00000100:00100000:2.0:1746127000.585449:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4155:x1830945991554048:12345-192.168.203.42@tcp:101:cat.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.585454:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21353 00010000:00010000:0.0:1746127000.585683:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb200/0x34dc807b6ef9389 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585691:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb200/0x34dc807b6ef9389 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585697:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb200/0x34dc807b6ef9389 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:0.0:1746127000.585704:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127000.585757:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585762:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585767:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585772:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585778:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995ea800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127000.585781:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585786:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585795:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127000.585797:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127000.585800:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585804:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6ef9374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585813:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585817:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585821:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585825:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995ea400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127000.585827:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585831:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585837:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f800) 00010000:00010000:0.0:1746127000.585839:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127000.585842:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585846:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea400/0x34dc807b6ef937b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.585874:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb000/0x34dc807b6ef936d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf7 expref: 16 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.585882:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb200/0x34dc807b6ef9389 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf7 expref: 15 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.585887:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127000.585889:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746127000.585891:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb200, rc 0) 00000100:00100000:0.0:1746127000.585926:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4161:x1830945991553920:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 647us (705us total) trans 8589938147 rc 0/0 00000100:00100000:0.0:1746127000.585932:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17222 00000100:00100000:1.0:1746127000.592018:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.592179:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991553664:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7320us (7645us total) trans 17179875546 rc 0/0 00000100:00100000:3.0:1746127000.592189:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1860 00002000:00100000:3.0:1746127000.592200:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (2007040->2097151) req@ffff880099195880 x1830945991553664/t17179875546(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.592208:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099195880 with x1830945991553664 ext(2007040->2097151) 00010000:00010000:3.0:1746127000.592218:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 33 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.592231:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 33 pid: 12333 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.592237:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099195880 00000100:00100000:0.0:1746127000.592731:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991554304 00000100:00100000:0.0:1746127000.592738:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991554304 00000100:00100000:0.0:1746127000.592768:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17223 00000100:00100000:0.0:1746127000.592774:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4161:x1830945991554304:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127000.592790:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127000.592803:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef9397 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c05 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.592880:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.592893:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.592900:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127000.592923:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.592931:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 36 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.592940:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214784:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127000.592979:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.597059:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.597235:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994214784:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.597256:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127000.597485:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991554432 00000100:00100000:1.0:1746127000.597491:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991554432 00010000:00010000:1.0:1746127000.597519:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 33 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.597553:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9968 00000100:00100000:1.0:1746127000.597559:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991554432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.597570:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.597584:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 33 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.597592:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 33 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.597610:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c2400/0x34dc807b6ef91c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ae6 expref: 33 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.597620:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.597622:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.597627:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 11 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.597635:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 11 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.597642:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.597643:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.597646:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 32 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.597652:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 32 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.597675:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 32 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.597686:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994214912:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.597746:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 11 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.597754:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994215040:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.597769:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.600485:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.600514:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991554560 00000100:00100000:3.0:1746127000.600520:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991554560 00010000:00010000:3.0:1746127000.600549:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 37 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.600714:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994214912:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127000.600722:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994215040:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127000.600734:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.600749:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9969 00000100:00100000:3.0:1746127000.600755:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991554560:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127000.600765:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127000.600769:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991554432:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3210us (3718us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127000.600770:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 37 pid: 7258 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.600778:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9968 00010000:00010000:3.0:1746127000.600784:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 37 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.600801:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9343 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52be9 expref: 37 pid: 7258 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.600842:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127000.600846:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.600853:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.600859:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127000.600882:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127000.600900:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:3.0:1746127000.600902:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991554560:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 147us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.600907:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9969 00010000:00010000:2.0:1746127000.600908:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600922:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600928:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600932:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600937:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995eae00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127000.600940:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600944:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600951:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127000.600954:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127000.600956:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600960:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6ef939e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.600989:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef9397 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c05 expref: 16 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.600995:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6ef9397 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c05 expref: 16 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.601005:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ea600, rc 0) 00000100:00100000:2.0:1746127000.601060:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4161:x1830945991554304:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 8286us (9048us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.601066:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17223 00000100:00100000:0.0:1746127000.601947:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.601984:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.602018:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991554816 00000100:00100000:1.0:1746127000.602023:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991554816 00002000:00100000:1.0:1746127000.602046:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8801303d0e00 x1830945991554816/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.602055:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0e00 with x1830945991554816 ext(1048576->2097151) 00002000:00010000:1.0:1746127000.602059:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801303d0e00 00000100:00100000:1.0:1746127000.602078:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991555072 00000100:00100000:1.0:1746127000.602080:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991555072 00002000:00100000:1.0:1746127000.602089:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8801303d1180 x1830945991555072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.602094:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d1180 with x1830945991555072 ext(1048576->2097151) 00002000:00010000:1.0:1746127000.602097:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801303d1180 00000100:00100000:1.0:1746127000.602113:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8492 00000100:00100000:1.0:1746127000.602117:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991554816:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127000.602155:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8493 00000100:00100000:3.0:1746127000.602175:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991555072:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127000.602744:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.602788:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991555328 00000100:00100000:2.0:1746127000.602795:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991555328 00000100:00100000:2.0:1746127000.602824:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6547 00000100:00100000:2.0:1746127000.602829:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4161:x1830945991555328:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:2.0:1746127000.602952:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:4161:x1830945991555328:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 122us (209us total) trans 8589938148 rc 0/0 00000100:00100000:2.0:1746127000.602957:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6547 00000100:00100000:3.0:1746127000.617210:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991555072:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15040us (15218us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.617221:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8493 00002000:00100000:3.0:1746127000.617230:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8801303d1180 x1830945991555072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.617244:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d1180 with x1830945991555072 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.617249:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801303d1180 00000100:00100000:2.0:1746127000.619822:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991554816:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17696us (17869us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127000.619831:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8492 00002000:00100000:2.0:1746127000.619840:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8801303d0e00 x1830945991554816/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.619848:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0e00 with x1830945991554816 ext(1048576->2097151) 00002000:00010000:2.0:1746127000.619853:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801303d0e00 00000100:00100000:0.0:1746127000.626016:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.626273:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991555456 00000100:00100000:2.0:1746127000.626281:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991555456 00000100:00100000:1.0:1746127000.627501:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21354 00000100:00100000:1.0:1746127000.627513:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4160:x1830945991555456:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127000.627529:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127000.627545:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c0c expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.627569:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 22 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.627575:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127000.627577:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127000.627580:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 8 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.627604:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 22 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.627614:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 22 pid: 9611 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.627958:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994215168:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.628028:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.628435:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.628491:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991555584 00000100:00100000:3.0:1746127000.628498:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991555584 00000100:00100000:3.0:1746127000.628539:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21355 00000100:00100000:3.0:1746127000.628547:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4163:x1830945991555584:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127000.628558:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.628569:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c13 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.628589:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.628597:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 12 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.628624:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.628631:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.628632:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.628635:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3928064->4194303] (req 3928064->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.628657:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.628671:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 33 pid: 1507 timeout: 995 lvb_type: 1 00000100:00100000:3.0:1746127000.628680:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994215296:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.628777:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 12 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.628787:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 12 pid: 1507 timeout: 995 lvb_type: 1 00000100:00100000:3.0:1746127000.628795:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994215424:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.628825:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.628832:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 11 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.628838:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994215552:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.628858:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.631155:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.631454:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991555840 00000100:00100000:0.0:1746127000.631460:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991555840 00002000:00100000:0.0:1746127000.631493:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880122387b80 x1830945991555840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.631502:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387b80 with x1830945991555840 ext(2097152->4194303) 00002000:00010000:0.0:1746127000.631507:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122387b80 00000100:00100000:2.0:1746127000.631584:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.631692:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8494 00000100:00100000:0.0:1746127000.631700:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991555840:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127000.631713:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994215296:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.631722:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994215424:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.631789:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994215168:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.631809:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 8 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.631822:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfd400, rc 0) 00000100:00100000:1.0:1746127000.631855:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4160:x1830945991555456:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4345us (5846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.631861:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21354 00000100:00100000:2.0:1746127000.631968:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.632013:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991555968 00000100:00100000:2.0:1746127000.632017:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991555968 00010000:00010000:2.0:1746127000.632033:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 13 pid: 1507 timeout: 995 lvb_type: 1 00000100:00100000:2.0:1746127000.632051:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9970 00000100:00100000:2.0:1746127000.632055:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991555968:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127000.632063:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127000.632089:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 13 pid: 1507 timeout: 995 lvb_type: 1 00010000:00010000:2.0:1746127000.632098:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 13 pid: 1507 timeout: 995 lvb_type: 1 00010000:00010000:2.0:1746127000.632116:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e983600/0x34dc807b6ef910c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a5a expref: 13 pid: 1507 timeout: 995 lvb_type: 1 00010000:00010000:2.0:1746127000.632149:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127000.632167:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991555968:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 111us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.632172:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9970 00000100:00100000:3.0:1746127000.633192:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994215552:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.633213:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3928064->4194303] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.633223:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfec00, rc 0) 00000100:00100000:3.0:1746127000.633253:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4163:x1830945991555584:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4708us (4819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.633259:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21355 00000100:00100000:3.0:1746127000.633279:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991556096 00000100:00100000:3.0:1746127000.633282:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991556096 00000100:00100000:0.0:1746127000.633289:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127000.633299:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1859583) req@ffff880122387480 x1830945991556096/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.633307:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387480 with x1830945991556096 ext(1048576->1859583) 00010000:00010000:3.0:1746127000.633312:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.633322:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.633327:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122387480 00000100:00100000:3.0:1746127000.633345:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1861 00000100:00100000:3.0:1746127000.633351:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2029:x1830945991556096:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127000.633515:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.633587:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991556224 00000100:00100000:1.0:1746127000.633590:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991556224 00010000:00010000:1.0:1746127000.633604:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 33 pid: 1507 timeout: 995 lvb_type: 1 00000100:00100000:1.0:1746127000.633620:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991556352 00000100:00100000:1.0:1746127000.633621:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991556352 00010000:00010000:1.0:1746127000.633628:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 12 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.633646:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9971 00000100:00100000:1.0:1746127000.633650:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991556224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.633658:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.633666:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 33 pid: 1507 timeout: 995 lvb_type: 1 00000100:00100000:0.0:1746127000.633673:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9972 00000100:00100000:0.0:1746127000.633679:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991556352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.633685:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 33 pid: 1507 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746127000.633686:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.633704:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc35600/0x34dc807b6ef8ffb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e529b2 expref: 33 pid: 1507 timeout: 995 lvb_type: 1 00010000:00010000:0.0:1746127000.633705:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 12 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.633713:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 12 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.633720:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127000.633725:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967bea00/0x34dc807b6ef8fa0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5296c expref: 12 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.633736:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746127000.633738:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945991556224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 88us (449us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127000.633738:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127000.633742:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 32 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.633744:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9971 00010000:00010000:0.0:1746127000.633750:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 31 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127000.633774:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 31 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.633782:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994215680:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127000.633820:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.645701:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.645847:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991555840:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 14147us (14695us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746127000.645856:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8494 00002000:00100000:0.0:1746127000.645867:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880122387b80 x1830945991555840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.645875:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387b80 with x1830945991555840 ext(2097152->4194303) 00002000:00010000:0.0:1746127000.645879:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122387b80 00000100:00100000:0.0:1746127000.645898:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991556608 00000100:00100000:0.0:1746127000.645904:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991556608 00002000:00100000:0.0:1746127000.645925:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (3928064->3932159) req@ffff88009942c380 x1830945991556608/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.645932:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c380 with x1830945991556608 ext(3928064->3932159) 00002000:00010000:0.0:1746127000.645935:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c380 00000100:00100000:0.0:1746127000.645949:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8495 00000100:00100000:0.0:1746127000.645954:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991556608:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127000.646032:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991556608:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 77us (338us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127000.646040:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8495 00002000:00100000:0.0:1746127000.646044:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (3928064->3932159) req@ffff88009942c380 x1830945991556608/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127000.646050:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c380 with x1830945991556608 ext(3928064->3932159) 00002000:00010000:0.0:1746127000.646052:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c380 00000100:00100000:1.0:1746127000.646200:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994215680:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.646214:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.646235:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991556352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 12556us (12720us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.646241:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9972 00000100:00100000:3.0:1746127000.650017:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2029:x1830945991556096:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 16657us (18039us total) trans 21474842805 rc 0/0 00000100:00100000:3.0:1746127000.650028:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1861 00002000:00100000:3.0:1746127000.650040:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1859583) req@ffff880122387480 x1830945991556096/t21474842805(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.650049:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387480 with x1830945991556096 ext(1048576->1859583) 00010000:00010000:3.0:1746127000.650057:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.650079:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.650086:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122387480 00000100:00100000:0.0:1746127000.656749:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.656805:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991556736 00000100:00100000:1.0:1746127000.656813:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991556736 00000100:00100000:0.0:1746127000.656844:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127000.656845:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.656881:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9973 00000100:00100000:1.0:1746127000.656891:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2029:x1830945991556736:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.656902:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.656917:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.656932:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.656950:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129691800/0x34dc807b6ef9239 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1859583) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b2c expref: 25 pid: 9611 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.656973:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.656975:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.656981:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.656988:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.657016:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.657026:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994215808:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127000.657126:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991556864 00000100:00100000:3.0:1746127000.657156:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991556864 00000100:00100000:3.0:1746127000.657205:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21356 00000100:00100000:3.0:1746127000.657212:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:4163:x1830945991556864:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127000.657222:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.657230:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c1a expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.657356:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.657363:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.657368:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.657377:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.657378:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.657381:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4194304->4431871] (req 4194304->4431871) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 26 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.657396:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.657405:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 26 pid: 1507 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.657412:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994215936:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.657912:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00010000:00010000:3.0:1746127000.657991:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.657999:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 9 pid: 3148 timeout: 995 lvb_type: 1 00000100:00100000:3.0:1746127000.658008:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216064:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.658032:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 7 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.658039:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 7 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.658050:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216192:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.658063:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.659031:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.659102:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991557120 00000100:00100000:3.0:1746127000.659109:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991557120 00002000:00100000:3.0:1746127000.659180:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3928063) req@ffff8800a7c51c00 x1830945991557120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.659189:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51c00 with x1830945991557120 ext(2097152->3928063) 00002000:00010000:3.0:1746127000.659193:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c51c00 00000100:00100000:1.0:1746127000.660086:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994215808:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.660101:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127000.660273:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8496 00000100:00100000:3.0:1746127000.660284:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991557120:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127000.660654:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2029:x1830945991556736:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3760us (3906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.660663:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9973 00000100:00100000:2.0:1746127000.660828:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994215936:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127000.669471:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.669493:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216064:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127000.669500:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216192:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127000.669502:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127000.669519:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4194304->4431871] (req 4194304->4431871) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 25 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.669527:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127000.669535:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bff200, rc 0) 00000100:00100000:0.0:1746127000.669551:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.669555:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991557376 00000100:00100000:2.0:1746127000.669559:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991557376 00000100:00100000:0.0:1746127000.669573:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991557248 00010000:00010000:2.0:1746127000.669576:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 26 pid: 1507 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.669576:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991557248 00010000:00010000:0.0:1746127000.669589:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00000100:00100000:2.0:1746127000.669591:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991557632 00000100:00100000:2.0:1746127000.669592:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991557632 00010000:00010000:2.0:1746127000.669598:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 8 pid: 12333 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.669606:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9974 00000100:00100000:2.0:1746127000.669615:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9975 00000100:00100000:1.0:1746127000.669717:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9976 00000100:00100000:3.0:1746127000.669753:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991557760 00000100:00100000:3.0:1746127000.669756:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991557760 00000100:00100000:2.0:1746127000.670243:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991557248:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127000.670253:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127000.670265:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00010000:00010000:2.0:1746127000.670272:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00010000:00010000:2.0:1746127000.670285:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096629600/0x34dc807b6ef926a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b56 expref: 10 pid: 3148 timeout: 995 lvb_type: 1 00010000:00010000:2.0:1746127000.670295:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127000.670318:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991557248:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 699us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.670324:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9975 00000100:00100000:2.0:1746127000.670344:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:4163:x1830945991556864:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 13134us (13501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.670347:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21356 00002000:00100000:3.0:1746127000.670356:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a7c53800 x1830945991557760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.670365:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53800 with x1830945991557760 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.670369:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53800 00000100:00100000:3.0:1746127000.670389:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8497 00000100:00100000:3.0:1746127000.670394:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991557760:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127000.670908:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991557376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127000.670917:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127000.670927:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.670937:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.670959:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6ef9240 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b33 expref: 25 pid: 1507 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746127000.670972:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127000.670992:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2026:x1830945991557376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1380us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.670997:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9974 00000100:00100000:1.0:1746127000.671021:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991557632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.671029:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.671037:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.671045:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.671056:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e88f800/0x34dc807b6ef9208 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52b09 expref: 9 pid: 12333 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.671082:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.671083:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.671089:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.671096:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.671120:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.671146:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994216320:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.671198:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.671970:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991557120:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11688us (12938us total) trans 0 rc 1830912/1830912 00000100:00100000:3.0:1746127000.671978:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8496 00002000:00100000:3.0:1746127000.671985:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3928063) req@ffff8800a7c51c00 x1830945991557120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1830912/1830912 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.671993:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51c00 with x1830945991557120 ext(2097152->3928063) 00002000:00010000:3.0:1746127000.671996:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c51c00 00000100:00100000:1.0:1746127000.676433:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994216320:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.676451:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.676495:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991557632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6770us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.676504:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9976 00000100:00100000:3.0:1746127000.677267:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991557760:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6870us (7761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.677275:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8497 00002000:00100000:3.0:1746127000.677284:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a7c53800 x1830945991557760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.677292:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53800 with x1830945991557760 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.677297:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53800 00000100:00100000:0.0:1746127000.685026:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.685089:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.685228:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991558016 00000100:00100000:2.0:1746127000.685236:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991558016 00002000:00100000:2.0:1746127000.685272:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800a178aa00 x1830945991558016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.685281:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178aa00 with x1830945991558016 ext(3145728->4194303) 00002000:00010000:2.0:1746127000.685285:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178aa00 00000100:00100000:2.0:1746127000.685300:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991558272 00000100:00100000:2.0:1746127000.685302:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991558272 00002000:00100000:2.0:1746127000.685312:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4427776->4431871) req@ffff8800a178ad80 x1830945991558272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.685318:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178ad80 with x1830945991558272 ext(4427776->4431871) 00000100:00100000:3.0:1746127000.685356:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8498 00000100:00100000:3.0:1746127000.685365:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991558016:12345-192.168.203.42@tcp:3:multiop.0 00002000:00010000:2.0:1746127000.686009:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178ad80 00000100:00100000:2.0:1746127000.686031:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8499 00000100:00100000:2.0:1746127000.686037:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2029:x1830945991558272:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127000.686110:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2029:x1830945991558272:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 72us (1020us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127000.686115:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8499 00002000:00100000:2.0:1746127000.686120:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4427776->4431871) req@ffff8800a178ad80 x1830945991558272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.686142:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178ad80 with x1830945991558272 ext(4427776->4431871) 00002000:00010000:2.0:1746127000.686146:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178ad80 00000100:00100000:0.0:1746127000.691193:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.691268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.691355:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991558400 00000100:00100000:2.0:1746127000.691363:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991558400 00000100:00100000:2.0:1746127000.691395:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991558528 00000100:00100000:2.0:1746127000.691397:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991558528 00000100:00100000:2.0:1746127000.691411:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21357 00000100:00100000:2.0:1746127000.691417:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991558400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.691432:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.691446:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef93ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c21 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.691486:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216448:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.691556:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.691577:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21358 00000100:00100000:2.0:1746127000.691583:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991558528:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.691589:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.691598:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef93c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c28 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.691620:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994216576:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.691642:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00002000:00010000:3.0:1746127000.693075:0:1964:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746126997 -> 1746126999 00002000:00010000:3.0:1746127000.693080:0:1964:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746126997 -> 1746126999 00002000:00010000:3.0:1746127000.693082:0:1964:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746126998 -> 1746126999 00000100:00100000:3.0:1746127000.693097:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994216576:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127000.693119:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef93c1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c28 expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.693154:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643000/0x34dc807b6ef93c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c28 expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127000.693175:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643000, rc 0) 00000100:00100000:3.0:1746127000.693203:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991558528:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1619us (1934us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127000.693210:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21358 00002000:00010000:2.0:1746127000.693663:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746126998 -> 1746126999 00002000:00010000:2.0:1746127000.693666:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746126998 -> 1746126999 00002000:00010000:2.0:1746127000.693667:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746126998 -> 1746126999 00000100:00100000:2.0:1746127000.693676:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216448:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.693689:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef93ba lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c21 expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.693698:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6ef93ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c21 expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.693944:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643e00, rc 0) 00000100:00100000:2.0:1746127000.693974:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991558400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2556us (2788us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.693979:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21357 00000100:00100000:0.0:1746127000.696757:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.696830:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.696834:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2026:x1830945991558016:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11470us (11813us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.696842:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8498 00002000:00100000:3.0:1746127000.696850:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800a178aa00 x1830945991558016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.696859:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178aa00 with x1830945991558016 ext(3145728->4194303) 00002000:00010000:3.0:1746127000.696863:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178aa00 00000100:00100000:1.0:1746127000.696953:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991558912 00000100:00100000:1.0:1746127000.696959:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991558912 00000100:00100000:1.0:1746127000.696987:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6548 00000100:00100000:1.0:1746127000.696993:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4163:x1830945991558912:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127000.697113:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991558656 00000100:00100000:2.0:1746127000.697117:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991558656 00000100:00100000:2.0:1746127000.697160:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21359 00000100:00100000:2.0:1746127000.697167:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4160:x1830945991558656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.697175:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127000.697179:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4163:x1830945991558912:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 185us (348us total) trans 8589938149 rc 0/0 00010000:00010000:2.0:1746127000.697187:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c2f expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.697206:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.697213:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.697215:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.697218:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 8 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.697241:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.697254:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 23 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:2.0:1746127000.697264:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216704:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127000.697280:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6548 00000100:00100000:2.0:1746127000.697305:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.699053:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216704:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127000.699090:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 8 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.699211:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642a00, rc 0) 00000100:00100000:2.0:1746127000.699238:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4160:x1830945991558656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2071us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.699245:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21359 00000100:00100000:0.0:1746127000.701458:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.701529:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991559040 00000100:00100000:3.0:1746127000.701535:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991559040 00002000:00100000:3.0:1746127000.701570:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4431871) req@ffff8800a178b100 x1830945991559040/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.701580:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178b100 with x1830945991559040 ext(4194304->4431871) 00010000:00010000:3.0:1746127000.701587:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 24 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.701599:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 24 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.701605:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a178b100 00000100:00100000:3.0:1746127000.701619:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1862 00000100:00100000:3.0:1746127000.701625:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945991559040:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127000.707847:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.707881:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.708677:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991559040:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 7050us (7221us total) trans 21474842806 rc 0/0 00000100:00100000:3.0:1746127000.708690:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1862 00002000:00100000:3.0:1746127000.708700:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4431871) req@ffff8800a178b100 x1830945991559040/t21474842806(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.708709:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178b100 with x1830945991559040 ext(4194304->4431871) 00010000:00010000:3.0:1746127000.708717:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 26 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.708729:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 26 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.708735:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a178b100 00000100:00100000:2.0:1746127000.708765:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991559168 00000100:00100000:2.0:1746127000.708771:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991559168 00000100:00100000:3.0:1746127000.708932:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991559296 00000100:00100000:3.0:1746127000.708935:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991559296 00000100:00100000:2.0:1746127000.709016:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21360 00000100:00100000:2.0:1746127000.709022:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991559168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.709032:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.709042:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c36 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.709057:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.709059:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.709065:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.709094:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.709102:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642000, rc 0) 00000100:00100000:2.0:1746127000.709141:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991559168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 120us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.709146:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21360 00000100:00100000:2.0:1746127000.709155:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21361 00000100:00100000:2.0:1746127000.709159:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991559296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.709164:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.709169:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef93d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c3d expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127000.709195:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216832:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127000.709231:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.710667:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994216832:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127000.710685:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef93d6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c3d expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.710696:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef93d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c3d expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.711016:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642c00, rc 0) 00000100:00100000:2.0:1746127000.711049:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991559296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1889us (3167us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127000.711056:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21361 00000100:00100000:0.0:1746127000.717813:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.717907:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991559424 00000100:00100000:1.0:1746127000.717916:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991559424 00010000:00010000:1.0:1746127000.717947:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.717974:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9977 00000100:00100000:1.0:1746127000.717981:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991559424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.717993:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.718008:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.718018:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.718036:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6ef93b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c1a expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.718078:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.718081:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.718087:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 7 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.718093:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 7 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127000.718311:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127000.718456:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 7 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.718468:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994216960:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127000.718503:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991559680 00000100:00100000:2.0:1746127000.718506:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991559680 00000100:00100000:2.0:1746127000.718529:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21362 00000100:00100000:2.0:1746127000.718534:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4155:x1830945991559680:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.718544:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.718553:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c44 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.718566:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.718567:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.718571:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.718581:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.718588:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642800, rc 0) 00000100:00100000:2.0:1746127000.718610:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4155:x1830945991559680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.718616:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21362 00000100:00100000:1.0:1746127000.719090:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.727521:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.727746:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994216960:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.727763:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.727826:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991559424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 9844us (10018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.727836:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9977 00000100:00100000:2.0:1746127000.728091:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991559936 00000100:00100000:2.0:1746127000.728096:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991559936 00000100:00100000:0.0:1746127000.728106:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:2.0:1746127000.728147:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a1789880 x1830945991559936/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.728156:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789880 with x1830945991559936 ext(4194304->4829183) 00002000:00010000:2.0:1746127000.728161:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1789880 00000100:00100000:2.0:1746127000.728477:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991560192 00000100:00100000:2.0:1746127000.728481:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991560192 00002000:00100000:2.0:1746127000.728499:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009c4cce00 x1830945991560192/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.728647:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cce00 with x1830945991560192 ext(2097152->3145727) 00002000:00010000:2.0:1746127000.728649:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cce00 00000100:00100000:1.0:1746127000.729012:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8500 00000100:00100000:1.0:1746127000.729020:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991559936:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127000.729033:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8501 00000100:00100000:3.0:1746127000.729039:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991560192:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127000.738597:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991559936:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9570us (11075us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127000.738608:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8500 00002000:00100000:1.0:1746127000.738619:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a1789880 x1830945991559936/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.738628:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789880 with x1830945991559936 ext(4194304->4829183) 00002000:00010000:1.0:1746127000.738633:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1789880 00000100:00100000:3.0:1746127000.741428:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991560192:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12383us (13315us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.741437:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8501 00002000:00100000:3.0:1746127000.741446:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009c4cce00 x1830945991560192/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.741453:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cce00 with x1830945991560192 ext(2097152->3145727) 00002000:00010000:3.0:1746127000.741458:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cce00 00000100:00100000:0.0:1746127000.747088:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.747147:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.747968:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991560320 00000100:00100000:2.0:1746127000.747976:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991560320 00000100:00100000:3.0:1746127000.747998:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991560448 00000100:00100000:3.0:1746127000.748002:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991560448 00000100:00100000:2.0:1746127000.748014:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21363 00000100:00100000:2.0:1746127000.748023:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4157:x1830945991560320:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:3.0:1746127000.748037:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21364 00010000:00010000:2.0:1746127000.748037:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127000.748042:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4160:x1830945991560448:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.748048:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.748051:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c4b expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.748054:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c52 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.748084:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 31 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.748091:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.748205:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.748210:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.748359:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.748362:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127000.748366:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->4194303] (req 3239936->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 14 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.748377:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->4194303] (req 3239936->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 14 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.748386:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643c00, rc 0) 00010000:00010000:3.0:1746127000.748389:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 31 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.748399:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 31 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.748409:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994217088:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.748484:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.748896:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4157:x1830945991560320:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 873us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.748902:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21363 00000100:00100000:3.0:1746127000.750333:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994217088:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.750355:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.750367:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe800, rc 0) 00000100:00100000:3.0:1746127000.750435:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4160:x1830945991560448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2392us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.750442:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21364 00000100:00100000:0.0:1746127000.751004:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.751085:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991560576 00000100:00100000:3.0:1746127000.751090:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991560576 00002000:00100000:3.0:1746127000.751121:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3928064->4194303) req@ffff88009c4cea00 x1830945991560576/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.751153:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cea00 with x1830945991560576 ext(3928064->4194303) 00010000:00010000:3.0:1746127000.751160:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 32 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.751170:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 32 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.751177:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4cea00 00000100:00100000:3.0:1746127000.751234:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1863 00000100:00100000:3.0:1746127000.751241:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991560576:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127000.754126:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991560576:12345-192.168.203.42@tcp:4:cat.0 Request processed in 2878us (3115us total) trans 17179875547 rc 0/0 00000100:00100000:3.0:1746127000.754148:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1863 00002000:00100000:3.0:1746127000.754158:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3928064->4194303) req@ffff88009c4cea00 x1830945991560576/t17179875547(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.754166:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cea00 with x1830945991560576 ext(3928064->4194303) 00010000:00010000:3.0:1746127000.754175:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 34 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.754192:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 34 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.754199:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4cea00 00000100:00100000:0.0:1746127000.757903:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.758488:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991560704 00000100:00100000:1.0:1746127000.758497:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991560704 00010000:00010000:1.0:1746127000.758533:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 34 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.758567:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9978 00000100:00100000:1.0:1746127000.758574:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991560704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.758585:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.758600:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 34 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.758610:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 34 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.758629:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef93ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c13 expref: 34 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.758658:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.758660:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.758666:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 12 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.758673:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 12 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.758684:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.758685:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.758688:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.758693:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.758718:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.758729:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994217216:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.759274:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 12 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.759283:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994217344:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.759479:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127000.762794:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.762891:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994217216:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.762901:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994217344:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.762917:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.762955:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991560704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4380us (5058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.762964:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9978 00000100:00100000:3.0:1746127000.763025:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991560960 00000100:00100000:3.0:1746127000.763030:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991560960 00002000:00100000:3.0:1746127000.763059:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3239936->3244031) req@ffff88009c4cd500 x1830945991560960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.763076:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd500 with x1830945991560960 ext(3239936->3244031) 00002000:00010000:3.0:1746127000.763080:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cd500 00000100:00100000:3.0:1746127000.763093:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8502 00000100:00100000:3.0:1746127000.763098:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991560960:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127000.763197:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991560960:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 98us (413us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127000.763202:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8502 00002000:00100000:3.0:1746127000.763206:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3239936->3244031) req@ffff88009c4cd500 x1830945991560960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.763212:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd500 with x1830945991560960 ext(3239936->3244031) 00002000:00010000:3.0:1746127000.763215:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cd500 00000100:00100000:0.0:1746127000.766956:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.767005:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.767052:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991561216 00000100:00100000:1.0:1746127000.767060:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991561216 00002000:00100000:1.0:1746127000.767106:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88009ab0e680 x1830945991561216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.767114:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0e680 with x1830945991561216 ext(2097152->3145727) 00002000:00010000:1.0:1746127000.767119:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0e680 00000100:00100000:1.0:1746127000.767282:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991561472 00000100:00100000:1.0:1746127000.767285:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991561472 00002000:00100000:1.0:1746127000.767298:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009ab0ce00 x1830945991561472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127000.767329:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ce00 with x1830945991561472 ext(3145728->4194303) 00002000:00010000:1.0:1746127000.767332:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ce00 00000100:00100000:1.0:1746127000.767347:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8503 00000100:00100000:1.0:1746127000.767353:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991561216:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127000.767367:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8504 00000100:00100000:3.0:1746127000.767375:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991561472:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127000.779359:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991561472:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11978us (12346us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.779372:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8504 00002000:00100000:3.0:1746127000.779382:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009ab0ce00 x1830945991561472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.779390:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ce00 with x1830945991561472 ext(3145728->4194303) 00002000:00010000:3.0:1746127000.779395:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ce00 00000100:00100000:0.0:1746127000.780303:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.780624:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991561600 00000100:00100000:3.0:1746127000.780631:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991561600 00000100:00100000:3.0:1746127000.781242:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21365 00000100:00100000:3.0:1746127000.781250:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4157:x1830945991561600:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127000.781264:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.781279:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c59 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.781301:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 9 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.781309:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 26 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.781314:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.781316:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127000.781318:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4243455] (req 4194304->4243455) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.781344:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 26 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.781358:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 26 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.781367:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994217472:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.781435:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 9 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.781443:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 9 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.781450:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994217600:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.781467:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127000.782119:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991561216:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 14764us (15170us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127000.782146:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8503 00002000:00100000:2.0:1746127000.782154:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88009ab0e680 x1830945991561216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.782162:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0e680 with x1830945991561216 ext(2097152->3145727) 00002000:00010000:2.0:1746127000.782166:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0e680 00000100:00100000:3.0:1746127000.783699:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994217472:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.784499:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994217600:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.784525:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4243455] (req 4194304->4243455) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.784539:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebf800, rc 0) 00000100:00100000:3.0:1746127000.784584:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4157:x1830945991561600:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3335us (4281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.784591:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21365 00000100:00100000:0.0:1746127000.786212:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.786309:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991561728 00000100:00100000:1.0:1746127000.786315:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991561728 00010000:00010000:1.0:1746127000.786342:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.786364:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9979 00000100:00100000:1.0:1746127000.786370:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991561728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.786381:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.786395:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.786403:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.786425:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef93dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c44 expref: 27 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.787535:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.787592:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991561728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1218us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.787600:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9979 00000100:00100000:0.0:1746127000.789226:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.789315:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991561856 00000100:00100000:1.0:1746127000.789321:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991561856 00010000:00010000:1.0:1746127000.789346:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 9 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746127000.789370:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.789381:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9980 00000100:00100000:1.0:1746127000.789387:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991561856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.789397:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.789471:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 9 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.789481:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 9 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.789499:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642a00/0x34dc807b6ef93c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c2f expref: 9 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.789510:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.789513:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.789518:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 8 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.789522:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991561984 00010000:00010000:1.0:1746127000.789525:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 8 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.789526:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991561984 00010000:00010000:1.0:1746127000.789550:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127000.789556:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21366 00000100:00100000:3.0:1746127000.789560:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4160:x1830945991561984:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127000.789560:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994217728:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127000.789571:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.789579:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c60 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.789592:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.789597:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.789598:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.789601:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.789607:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00010000:00010000:3.0:1746127000.789615:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.789624:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 10 pid: 1964 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.789632:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994217856:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.789650:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.791023:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994217728:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127000.791091:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994217856:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127000.791164:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.791193:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991561856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1805us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.791200:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9980 00010000:00010000:3.0:1746127000.791267:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.791279:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7a00, rc 0) 00000100:00100000:3.0:1746127000.791300:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4160:x1830945991561984:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1739us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.791306:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21366 00000100:00100000:0.0:1746127000.792662:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.792746:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991562240 00000100:00100000:2.0:1746127000.792752:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991562240 00002000:00100000:2.0:1746127000.792784:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4239360->4243455) req@ffff88009ab0dc00 x1830945991562240/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.792793:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0dc00 with x1830945991562240 ext(4239360->4243455) 00010000:00010000:2.0:1746127000.792800:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.792811:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 995 lvb_type: 0 00002000:00010000:2.0:1746127000.792817:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ab0dc00 00000100:00100000:2.0:1746127000.792843:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1864 00000100:00100000:2.0:1746127000.792849:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991562240:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127000.792942:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991562240:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 93us (283us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127000.792947:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1864 00002000:00100000:2.0:1746127000.792951:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4239360->4243455) req@ffff88009ab0dc00 x1830945991562240/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/4536 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127000.792958:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0dc00 with x1830945991562240 ext(4239360->4243455) 00010000:00010000:2.0:1746127000.792962:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 995 lvb_type: 0 00010000:00010000:2.0:1746127000.792970:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 995 lvb_type: 0 00002000:00010000:2.0:1746127000.792975:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ab0dc00 00000100:00100000:0.0:1746127000.795391:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.795703:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991562496 00000100:00100000:3.0:1746127000.795711:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991562496 00002000:00100000:3.0:1746127000.795743:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4243455) req@ffff88009ab0ed80 x1830945991562496/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.795751:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ed80 with x1830945991562496 ext(4194304->4243455) 00010000:00010000:3.0:1746127000.795758:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.795770:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 9 pid: 1964 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.795776:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ab0ed80 00000100:00100000:0.0:1746127000.795905:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.796114:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991562752 00000100:00100000:1.0:1746127000.796118:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991562752 00000100:00100000:1.0:1746127000.796173:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6549 00000100:00100000:1.0:1746127000.796180:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4157:x1830945991562752:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127000.796538:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4157:x1830945991562752:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 358us (633us total) trans 8589938150 rc 0/0 00000100:00100000:1.0:1746127000.796543:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6549 00000100:00100000:3.0:1746127000.796875:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1865 00000100:00100000:3.0:1746127000.796883:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991562496:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127000.799124:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991562496:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 2237us (3734us total) trans 21474842807 rc 0/0 00000100:00100000:3.0:1746127000.799151:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1865 00002000:00100000:3.0:1746127000.799159:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4243455) req@ffff88009ab0ed80 x1830945991562496/t21474842807(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.799167:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ed80 with x1830945991562496 ext(4194304->4243455) 00010000:00010000:3.0:1746127000.799175:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 11 pid: 1964 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.799192:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 11 pid: 1964 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.799198:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ab0ed80 00000100:00100000:0.0:1746127000.801698:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.802339:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991562880 00000100:00100000:1.0:1746127000.802347:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991562880 00010000:00010000:1.0:1746127000.802376:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 11 pid: 1964 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.802401:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9981 00000100:00100000:1.0:1746127000.802408:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991562880:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.802421:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.802436:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 11 pid: 1964 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.802446:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 11 pid: 1964 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.802465:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6ef93f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c59 expref: 11 pid: 1964 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.802478:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.802480:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.802485:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.802493:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.802518:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.802529:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994217984:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.802580:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.805591:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994217984:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.805607:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.805638:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991562880:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3231us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.805648:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9981 00000100:00100000:0.0:1746127000.807490:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.807720:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991563136 00000100:00100000:3.0:1746127000.807728:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991563136 00002000:00100000:3.0:1746127000.807829:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009cd64700 x1830945991563136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.807837:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64700 with x1830945991563136 ext(3145728->4194303) 00002000:00010000:3.0:1746127000.807841:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64700 00000100:00100000:3.0:1746127000.808484:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8505 00000100:00100000:3.0:1746127000.808493:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991563136:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127000.816554:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991563136:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 8055us (9062us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.816563:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8505 00002000:00100000:3.0:1746127000.816574:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009cd64700 x1830945991563136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.816582:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64700 with x1830945991563136 ext(3145728->4194303) 00002000:00010000:3.0:1746127000.816586:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64700 00000100:00100000:0.0:1746127000.826594:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.826648:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991563264 00000100:00100000:3.0:1746127000.826657:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991563264 00000100:00100000:3.0:1746127000.826710:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21367 00000100:00100000:3.0:1746127000.826718:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4160:x1830945991563264:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127000.826737:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127000.826752:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c67 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.826777:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 14 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.826783:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.826785:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127000.826788:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.826816:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 14 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.826825:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 14 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:3.0:1746127000.826834:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994218112:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127000.826909:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127000.829722:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994218112:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127000.829743:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127000.829756:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7600, rc 0) 00000100:00100000:3.0:1746127000.829783:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4160:x1830945991563264:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3066us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127000.829790:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21367 00000100:00100000:0.0:1746127000.831887:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.831978:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991563392 00000100:00100000:3.0:1746127000.831984:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991563392 00002000:00100000:3.0:1746127000.832019:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3239936->4194303) req@ffff88009cd65c00 x1830945991563392/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.832028:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65c00 with x1830945991563392 ext(3239936->4194303) 00010000:00010000:3.0:1746127000.832036:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 14 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.832048:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 14 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.832055:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd65c00 00000100:00100000:3.0:1746127000.832088:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1866 00000100:00100000:3.0:1746127000.832095:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991563392:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127000.843823:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991563392:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 11718us (11928us total) trans 17179875548 rc 0/0 00000100:00100000:3.0:1746127000.843837:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1866 00002000:00100000:3.0:1746127000.843850:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3239936->4194303) req@ffff88009cd65c00 x1830945991563392/t17179875548(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/448 e 0 to 0 dl 1746127011 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.843859:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65c00 with x1830945991563392 ext(3239936->4194303) 00010000:00010000:3.0:1746127000.843870:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 16 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:3.0:1746127000.843893:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 16 pid: 3148 timeout: 995 lvb_type: 0 00002000:00010000:3.0:1746127000.843900:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd65c00 00000100:00100000:0.0:1746127000.846292:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127000.848469:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991563520 00000100:00100000:1.0:1746127000.848483:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991563520 00010000:00010000:1.0:1746127000.848990:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 16 pid: 3148 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746127000.849283:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9982 00000100:00100000:1.0:1746127000.849293:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991563520:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127000.849308:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127000.849329:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 16 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.849343:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 16 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.849368:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643c00/0x34dc807b6ef93e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3239936->18446744073709551615] (req 3239936->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c4b expref: 16 pid: 3148 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746127000.849401:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.849403:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127000.849411:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.849424:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127000.849459:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127000.849472:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994218240:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127000.850168:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127000.853033:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994218240:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127000.853054:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127000.853103:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991563520:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3811us (6819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127000.853113:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9982 00000100:00100000:0.0:1746127000.857748:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.857895:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991563776 00000100:00100000:3.0:1746127000.857904:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991563776 00002000:00100000:3.0:1746127000.857952:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009cd67800 x1830945991563776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.857961:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67800 with x1830945991563776 ext(3145728->4194303) 00002000:00010000:3.0:1746127000.857965:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd67800 00000100:00100000:3.0:1746127000.857997:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8506 00000100:00100000:3.0:1746127000.858005:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991563776:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127000.870586:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991563776:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 12573us (12840us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.870618:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8506 00002000:00100000:3.0:1746127000.870630:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009cd67800 x1830945991563776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.870639:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67800 with x1830945991563776 ext(3145728->4194303) 00002000:00010000:3.0:1746127000.870643:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd67800 00000100:00100000:0.0:1746127000.878939:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.879034:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991564032 00000100:00100000:3.0:1746127000.879042:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991564032 00002000:00100000:3.0:1746127000.879108:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009cd64000 x1830945991564032/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.879148:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64000 with x1830945991564032 ext(4194304->4829183) 00002000:00010000:3.0:1746127000.879152:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64000 00000100:00100000:3.0:1746127000.879182:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8507 00000100:00100000:3.0:1746127000.879189:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991564032:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:0.0:1746127000.879204:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746127000.885637:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991564032:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6239us (6495us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127000.885650:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8507 00002000:00100000:3.0:1746127000.885661:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009cd64000 x1830945991564032/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.885670:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64000 with x1830945991564032 ext(4194304->4829183) 00002000:00010000:3.0:1746127000.885674:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64000 00000100:00100000:0.0:1746127000.909638:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994218368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746127000.909710:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127000.909991:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994218368 00000100:00100000:2.0:1746127000.910002:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994218368 00000100:00100000:2.0:1746127000.910092:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1746127000.910101:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994218368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746127000.910124:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1129827648 pending 1593344 free 3907129344 avail 3668197376 00000100:00100000:2.0:1746127000.910231:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994218368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.910237:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1746127000.910265:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994218368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746127000.919656:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.919868:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991564288 00000100:00100000:2.0:1746127000.919876:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991564288 00000100:00100000:2.0:1746127000.919915:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17224 00000100:00100000:2.0:1746127000.919922:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4170:x1830945991564288:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127000.919945:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.919959:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642200/0x34dc807b6ef9407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c6e expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.920015:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920027:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920035:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920044:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920049:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920053:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920170:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920177:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920182:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127000.920188:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127000.920235:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920323:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920328:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920333:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920338:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096643800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127000.920341:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920346:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920353:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127000.920355:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127000.920358:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920362:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643800/0x34dc807b6ef940e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920387:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920392:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920395:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920399:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096642600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127000.920400:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920404:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920408:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098619000) 00010000:00010000:2.0:1746127000.920410:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127000.920412:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920415:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9415 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127000.920441:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642200/0x34dc807b6ef9407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 40 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.920448:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 39 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.920454:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127000.920455:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127000.920457:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643c00, rc 0) 00000100:00100000:2.0:1746127000.922288:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4170:x1830945991564288:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2361us (2634us total) trans 8589938151 rc 0/0 00000100:00100000:2.0:1746127000.922298:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17224 00000100:00100000:3.0:1746127000.925286:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994218496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746127000.925336:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127000.925378:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994218496 00000100:00100000:0.0:1746127000.925385:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994218496 00000100:00100000:0.0:1746127000.925418:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1746127000.925484:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3784:x1830945994218496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746127000.925503:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1105788224 pending 2498560 free 3910705152 avail 3669417984 00000100:00100000:0.0:1746127000.925599:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3784:x1830945994218496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 175us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127000.925606:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1746127000.925809:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994218496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746127000.965944:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127000.966034:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127000.966210:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991564416 00000100:00100000:2.0:1746127000.966221:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991564416 00000100:00100000:2.0:1746127000.966279:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991564544 00000100:00100000:2.0:1746127000.966283:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991564544 00000100:00100000:2.0:1746127000.966337:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21368 00000100:00100000:2.0:1746127000.966347:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991564416:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.966370:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.966391:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c75 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.966418:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.966420:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.966433:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.966452:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.966465:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642800, rc 0) 00000100:00100000:2.0:1746127000.966520:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991564416:12345-192.168.203.42@tcp:101:cat.0 Request processed in 175us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.966526:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21368 00000100:00100000:2.0:1746127000.966544:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21369 00000100:00100000:2.0:1746127000.966550:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991564544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127000.966560:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127000.966572:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c7c expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127000.966585:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.966586:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127000.966593:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 34 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.966605:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 34 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127000.966613:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643e00, rc 0) 00000100:00100000:2.0:1746127000.966637:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991564544:12345-192.168.203.42@tcp:101:cat.0 Request processed in 86us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127000.966646:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21369 00000100:00100000:0.0:1746127000.977382:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127000.977472:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991564800 00000100:00100000:3.0:1746127000.977481:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991564800 00002000:00100000:3.0:1746127000.977529:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fc8e00 x1830945991564800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/0 e 0 to 0 dl 1746127011 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.977538:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8e00 with x1830945991564800 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.977543:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8e00 00000100:00100000:3.0:1746127000.977817:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8508 00000100:00100000:3.0:1746127000.977824:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991564800:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127000.985667:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991564800:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7828us (8281us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127000.985680:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8508 00002000:00100000:3.0:1746127000.985695:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fc8e00 x1830945991564800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:6/0 lens 488/440 e 0 to 0 dl 1746127011 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127000.985705:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8e00 with x1830945991564800 ext(1048576->2097151) 00002000:00010000:3.0:1746127000.985711:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8e00 00000100:00100000:0.0:1746127001.010959:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.011040:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.011429:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991565056 00000100:00100000:3.0:1746127001.011440:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991565056 00002000:00100000:3.0:1746127001.011497:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a2fca300 x1830945991565056/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.011507:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fca300 with x1830945991565056 ext(2097152->4194303) 00002000:00010000:3.0:1746127001.011513:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fca300 00000100:00100000:3.0:1746127001.011533:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991565312 00000100:00100000:3.0:1746127001.011536:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991565312 00002000:00100000:3.0:1746127001.011549:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a2fc8700 x1830945991565312/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.011556:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8700 with x1830945991565312 ext(2097152->4194303) 00002000:00010000:3.0:1746127001.011558:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc8700 00000100:00100000:3.0:1746127001.012678:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8509 00000100:00100000:3.0:1746127001.012691:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991565056:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127001.017187:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8510 00000100:00100000:2.0:1746127001.017210:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991565312:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127001.036431:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991565312:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19216us (25377us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127001.036445:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8510 00002000:00100000:3.0:1746127001.036462:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a2fc8700 x1830945991565312/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.036472:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8700 with x1830945991565312 ext(2097152->4194303) 00002000:00010000:3.0:1746127001.036479:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc8700 00000100:00100000:0.0:1746127001.041266:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.041423:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991565568 00000100:00100000:3.0:1746127001.041433:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991565568 00002000:00100000:3.0:1746127001.041566:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff8800a2fc9500 x1830945991565568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.041576:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9500 with x1830945991565568 ext(2097152->3145727) 00002000:00010000:3.0:1746127001.041581:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc9500 00000100:00080000:2.0:1746127001.041662:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746127001.041782:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8511 00000100:00100000:3.0:1746127001.041791:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991565568:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127001.047845:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991565056:12345-192.168.203.42@tcp:3:cat.0 Request processed in 35146us (36886us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127001.047858:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8509 00002000:00100000:3.0:1746127001.047871:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a2fca300 x1830945991565056/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.047880:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fca300 with x1830945991565056 ext(2097152->4194303) 00002000:00010000:3.0:1746127001.047885:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fca300 00000100:00100000:0.0:1746127001.053280:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.053842:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991565824 00000100:00100000:2.0:1746127001.053852:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991565824 00000100:00080000:0.0:1746127001.054243:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746127001.058241:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17225 00000100:00100000:2.0:1746127001.058260:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4177:x1830945991565824:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127001.058286:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.058304:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32000/0x34dc807b6ef9438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c83 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.058409:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.058423:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 38 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.058431:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.058463:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 38 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.058475:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 38 pid: 7258 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.058487:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994218624:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.058575:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.059589:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991565568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17797us (18331us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127001.059599:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8511 00002000:00100000:2.0:1746127001.059610:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff8800a2fc9500 x1830945991565568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.059619:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9500 with x1830945991565568 ext(2097152->3145727) 00002000:00010000:2.0:1746127001.059624:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc9500 00000100:00100000:0.0:1746127001.073761:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.073833:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566080 00000100:00100000:2.0:1746127001.073843:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566080 00002000:00100000:2.0:1746127001.073895:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fca680 x1830945991566080/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.073905:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fca680 with x1830945991566080 ext(4194304->4829183) 00002000:00010000:2.0:1746127001.073911:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fca680 00000100:00100000:2.0:1746127001.075403:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8512 00000100:00100000:2.0:1746127001.075416:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991566080:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127001.075944:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.077833:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994218624:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.077862:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127001.079746:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566208 00000100:00100000:1.0:1746127001.079757:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566208 00010000:00010000:1.0:1746127001.079803:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 39 pid: 7258 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.079828:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9983 00000100:00100000:1.0:1746127001.079834:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991566208:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127001.079847:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127001.079851:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 39 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.079867:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 39 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.079890:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6ef941c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c6e expref: 39 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.079908:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127001.079913:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127001.079921:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127001.079927:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127001.079945:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127001.079991:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991566208:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 156us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.079997:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9983 00000100:00080000:0.0:1746127001.080145:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746127001.080187:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.080195:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127001.080214:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:3.0:1746127001.080263:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127001.080337:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32000/0x34dc807b6ef9438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 23 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.080356:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 22 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.080362:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000100:00100000:3.0:1746127001.080364:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991566080:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4952us (6612us total) trans 0 rc 634880/634880 00010000:00010000:2.0:1746127001.080364:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127001.080367:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32600, rc 0) 00000100:00100000:3.0:1746127001.080372:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8512 00002000:00100000:3.0:1746127001.080379:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fca680 x1830945991566080/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127001.080383:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4177:x1830945991565824:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 22133us (27114us total) trans 8589938152 rc 0/0 00002000:00100000:3.0:1746127001.080387:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fca680 with x1830945991566080 ext(4194304->4829183) 00000100:00100000:2.0:1746127001.080389:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17225 00002000:00010000:3.0:1746127001.080391:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fca680 00000100:00100000:3.0:1746127001.080413:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566336 00000100:00100000:3.0:1746127001.080415:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566336 00000100:00100000:3.0:1746127001.080436:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21370 00000100:00100000:3.0:1746127001.080441:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4170:x1830945991566336:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127001.080709:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.080724:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c8a expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.080743:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.080750:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.080756:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.080762:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.080763:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.080766:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.080794:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.080805:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 14 pid: 1507 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.080817:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994218752:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.081122:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.081148:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 11 pid: 1964 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.081157:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994218880:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.081308:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.081316:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 35 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.081325:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994219008:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.081347:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.082247:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.082358:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566464 00000100:00100000:1.0:1746127001.082363:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566464 00010000:00010000:1.0:1746127001.082389:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 12 pid: 1964 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.082414:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9984 00000100:00100000:1.0:1746127001.082420:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991566464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127001.082429:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127001.082446:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 12 pid: 1964 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746127001.082455:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 12 pid: 1964 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746127001.082471:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127001.082494:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991566464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.082498:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9984 00000100:00100000:3.0:1746127001.082694:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994218752:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.082705:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6ef934a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bd4 expref: 11 pid: 1964 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.082719:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994218880:192.168.203.42@tcp:104: 00000100:00080000:0.0:1746127001.083017:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746127001.083180:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994219008:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.083207:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.083216:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7200, rc 0) 00000100:00100000:3.0:1746127001.083238:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4170:x1830945991566336:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2797us (2976us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.083244:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21370 00000100:00100000:0.0:1746127001.083543:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.083669:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566720 00000100:00100000:3.0:1746127001.083673:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566720 00000100:00100000:3.0:1746127001.083690:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21371 00000100:00100000:3.0:1746127001.083694:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2029:x1830945991566720:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.083704:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.083714:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e369000/0x34dc807b6ef9454 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c91 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.083727:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.083733:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e369000/0x34dc807b6ef9454 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c91 expref: 36 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.083740:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e369000/0x34dc807b6ef9454 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c91 expref: 36 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.083751:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e369000, rc 0) 00000100:00100000:3.0:1746127001.083767:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2029:x1830945991566720:12345-192.168.203.42@tcp:101:cat.0 Request processed in 73us (224us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127001.083771:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21371 00000100:00100000:0.0:1746127001.084223:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.084396:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566592 00000100:00100000:2.0:1746127001.084400:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566592 00010000:00010000:2.0:1746127001.084427:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 15 pid: 1507 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.084449:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9985 00000100:00100000:2.0:1746127001.084453:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991566592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.084460:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.084473:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 15 pid: 1507 timeout: 996 lvb_type: 1 00010000:00010000:2.0:1746127001.084481:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 15 pid: 1507 timeout: 996 lvb_type: 1 00010000:00010000:2.0:1746127001.084495:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8de200/0x34dc807b6ef930b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bb8 expref: 15 pid: 1507 timeout: 996 lvb_type: 1 00010000:00010000:2.0:1746127001.084509:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.084527:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991566592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.084532:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9985 00000100:00080000:0.0:1746127001.084618:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746127001.086771:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.086854:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566848 00000100:00100000:1.0:1746127001.086861:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566848 00010000:00010000:1.0:1746127001.086886:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 35 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.086906:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9986 00000100:00100000:1.0:1746127001.086910:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991566848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127001.086919:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127001.086932:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 35 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.086940:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 35 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.086955:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6ef92e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52baa expref: 35 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.086972:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.086974:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.086979:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 34 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.086985:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 34 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.087007:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 34 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127001.087015:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994219136:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127001.087087:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.089820:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994219136:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127001.089842:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127001.090493:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991566848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3579us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.090504:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9986 00000100:00100000:0.0:1746127001.091695:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.092036:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991566976 00000100:00100000:2.0:1746127001.092044:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991566976 00000100:00100000:2.0:1746127001.092121:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21372 00000100:00100000:2.0:1746127001.092145:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4170:x1830945991566976:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127001.092163:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.092228:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c98 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.092258:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.092265:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 35 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.092272:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.092273:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.092276:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1626111] (req 1048576->1626111) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 35 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.092307:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 35 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.092323:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 35 pid: 3148 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.092335:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994219264:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.092428:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.092436:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 13 pid: 3148 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.092444:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994219392:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.092464:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.093775:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994219264:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.093783:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994219392:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.093806:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1626111] (req 1048576->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 35 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.093818:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32e00, rc 0) 00000100:00100000:2.0:1746127001.093852:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4170:x1830945991566976:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1725us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.093858:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21372 00000100:00100000:0.0:1746127001.102174:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.102225:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.102324:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991567232 00000100:00100000:2.0:1746127001.102325:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991567104 00000100:00100000:2.0:1746127001.102334:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991567104 00000100:00100000:1.0:1746127001.102334:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991567232 00010000:00010000:2.0:1746127001.102450:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 35 pid: 3148 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.102604:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 14 pid: 3148 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.102741:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9987 00000100:00100000:1.0:1746127001.102748:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9988 00000100:00100000:2.0:1746127001.102751:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991567104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127001.102754:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991567232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.102764:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127001.102764:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.102782:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 35 pid: 3148 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.102782:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 14 pid: 3148 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.102792:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 14 pid: 3148 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.102802:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 35 pid: 3148 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.102825:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfd200/0x34dc807b6ef9366 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf0 expref: 14 pid: 3148 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.102830:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944a4c00/0x34dc807b6ef9382 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bfe expref: 35 pid: 3148 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.102861:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.102863:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.102870:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 34 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.103336:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 34 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.103348:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127001.103369:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 34 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.103381:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994219520:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127001.103426:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991567232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 671us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.103434:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9988 00000100:00100000:2.0:1746127001.103451:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.104600:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994219520:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127001.104617:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.104643:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991567104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1894us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.104652:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9987 00000100:00100000:0.0:1746127001.109097:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.109164:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991567488 00000100:00100000:3.0:1746127001.109173:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991567488 00002000:00100000:3.0:1746127001.109220:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1622016->1626111) req@ffff88009da75c00 x1830945991567488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.109229:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da75c00 with x1830945991567488 ext(1622016->1626111) 00002000:00010000:3.0:1746127001.109234:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da75c00 00000100:00100000:3.0:1746127001.109266:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8513 00000100:00100000:3.0:1746127001.109274:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991567488:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127001.109422:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991567488:12345-192.168.203.42@tcp:3:cat.0 Request processed in 148us (337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.109428:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8513 00002000:00100000:3.0:1746127001.109433:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1622016->1626111) req@ffff88009da75c00 x1830945991567488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.109440:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da75c00 with x1830945991567488 ext(1622016->1626111) 00002000:00010000:3.0:1746127001.109442:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da75c00 00000100:00100000:0.0:1746127001.112452:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.112594:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991567744 00000100:00100000:1.0:1746127001.112691:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991567744 00000100:00100000:1.0:1746127001.112739:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6550 00000100:00100000:1.0:1746127001.112746:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4170:x1830945991567744:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127001.112957:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4170:x1830945991567744:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 210us (512us total) trans 8589938153 rc 0/0 00000100:00100000:1.0:1746127001.112963:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6550 00000100:00100000:0.0:1746127001.161259:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.161373:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991567872 00000100:00100000:2.0:1746127001.161383:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991567872 00000100:00100000:2.0:1746127001.161447:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21373 00000100:00100000:2.0:1746127001.161455:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4177:x1830945991567872:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127001.161474:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.161493:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52c9f expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.161528:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.161534:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.161536:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.161539:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1871872->2097151] (req 1871872->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.161569:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.161580:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 33 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.161597:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994219648:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.162073:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.162847:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994219648:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.162865:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1871872->2097151] (req 1871872->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.162876:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e3200, rc 0) 00000100:00100000:2.0:1746127001.162905:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4177:x1830945991567872:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1451us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.162910:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21373 00000100:00100000:0.0:1746127001.164476:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.164552:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991568000 00000100:00100000:2.0:1746127001.164558:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991568000 00002000:00100000:2.0:1746127001.164596:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1626111) req@ffff88009da77480 x1830945991568000/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.164603:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77480 with x1830945991568000 ext(1048576->1626111) 00010000:00010000:2.0:1746127001.164611:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 34 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.164621:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 34 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.164626:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009da77480 00000100:00100000:2.0:1746127001.164650:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1867 00000100:00100000:2.0:1746127001.164654:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991568000:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127001.169622:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991568000:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4956us (5141us total) trans 17179875549 rc 0/0 00000100:00100000:2.0:1746127001.169634:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1867 00002000:00100000:2.0:1746127001.169646:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1626111) req@ffff88009da77480 x1830945991568000/t17179875549(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.169656:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77480 with x1830945991568000 ext(1048576->1626111) 00010000:00010000:2.0:1746127001.169667:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 36 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.169681:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 36 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.169689:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009da77480 00000100:00100000:0.0:1746127001.173423:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.173499:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991568128 00000100:00100000:2.0:1746127001.173510:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991568128 00010000:00010000:2.0:1746127001.173550:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 36 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.173593:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9989 00000100:00100000:2.0:1746127001.173601:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991568128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.173615:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746127001.173632:0:7246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126998 -> 1746126999 00002000:00010000:2.0:1746127001.173634:0:7246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126998 -> 1746126999 00010000:00010000:2.0:1746127001.173639:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 36 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.173655:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 36 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.173679:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6ef945b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1626111) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c98 expref: 36 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.173712:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.173714:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.173722:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.173730:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.173762:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.173774:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994219776:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127001.173861:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.176883:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994219776:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127001.176905:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.176946:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991568128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3345us (3532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.176956:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9989 00000100:00100000:0.0:1746127001.177170:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.177224:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991568384 00000100:00100000:3.0:1746127001.177231:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991568384 00002000:00100000:3.0:1746127001.177273:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1871872->1875967) req@ffff88009da74380 x1830945991568384/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.177288:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74380 with x1830945991568384 ext(1871872->1875967) 00002000:00010000:3.0:1746127001.177292:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da74380 00000100:00100000:3.0:1746127001.177310:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8514 00000100:00100000:3.0:1746127001.177317:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991568384:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.177427:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991568384:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 110us (298us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.177432:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8514 00002000:00100000:3.0:1746127001.177437:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1871872->1875967) req@ffff88009da74380 x1830945991568384/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.177443:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74380 with x1830945991568384 ext(1871872->1875967) 00002000:00010000:3.0:1746127001.177446:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da74380 00000100:00100000:0.0:1746127001.182949:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.183034:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991568512 00000100:00100000:2.0:1746127001.183044:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991568512 00000100:00100000:2.0:1746127001.183816:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21374 00000100:00100000:2.0:1746127001.183825:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4177:x1830945991568512:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127001.183845:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.183862:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ca6 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.183892:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.183901:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 26 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.183907:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.183909:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.183913:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->1613823] (req 1048576->1613823) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 11 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.183943:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 26 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.183955:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 26 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.183967:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994219904:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.184407:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.184421:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 11 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.184430:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994220032:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.186377:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.186411:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994219904:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.186689:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994220032:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.186715:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->1613823] (req 1048576->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 11 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.186731:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e3000, rc 0) 00000100:00100000:2.0:1746127001.186765:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4177:x1830945991568512:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2941us (3827us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.186773:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21374 00000100:00100000:0.0:1746127001.187475:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.187574:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991568640 00000100:00100000:2.0:1746127001.187581:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991568640 00010000:00010000:2.0:1746127001.187608:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 11 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.187984:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9990 00000100:00100000:2.0:1746127001.187989:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991568640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.188001:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.188020:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 11 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.188028:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 11 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.188047:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef93a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c0c expref: 11 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.188120:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.188202:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991568640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 211us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.188209:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9990 00000100:00100000:2.0:1746127001.188491:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.188555:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991568768 00000100:00100000:3.0:1746127001.188560:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991568768 00010000:00010000:3.0:1746127001.188854:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.188885:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9991 00000100:00100000:3.0:1746127001.188892:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991568768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.188900:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.188911:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.188920:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.188934:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642000/0x34dc807b6ef93cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c36 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.188948:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.188949:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.188956:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.189074:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.189105:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.189117:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994220160:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.189201:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.190286:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994220160:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.190302:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.190336:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2029:x1830945991568768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1445us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.190344:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9991 00000100:00100000:0.0:1746127001.191246:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.191475:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991568896 00000100:00100000:3.0:1746127001.191481:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991568896 00000100:00100000:3.0:1746127001.191521:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21375 00000100:00100000:3.0:1746127001.191528:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991568896:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.191547:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.191564:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e368e00/0x34dc807b6ef9470 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cad expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.191609:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994220288:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127001.191684:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5600 going to sleep for 11 seconds 00002000:00010000:3.0:1746127001.192962:0:1964:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746126998 -> 1746126999 00002000:00010000:3.0:1746127001.192966:0:1964:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746126998 -> 1746126999 00000100:00100000:3.0:1746127001.192983:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994220288:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127001.193007:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e368e00/0x34dc807b6ef9470 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cad expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.193019:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e368e00/0x34dc807b6ef9470 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cad expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.193027:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e368e00, rc 0) 00000100:00100000:3.0:1746127001.193055:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991568896:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1527us (1811us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127001.193061:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21375 00000100:00100000:0.0:1746127001.194293:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.194977:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991569152 00000100:00100000:2.0:1746127001.194984:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991569152 00002000:00100000:2.0:1746127001.195024:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1609728->1613823) req@ffff880094f14a80 x1830945991569152/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.195034:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14a80 with x1830945991569152 ext(1609728->1613823) 00002000:00010000:2.0:1746127001.195038:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f14a80 00000100:00100000:3.0:1746127001.195445:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8515 00000100:00100000:3.0:1746127001.195456:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991569152:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.196249:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991569152:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 794us (1957us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.196256:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8515 00002000:00100000:3.0:1746127001.196262:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1609728->1613823) req@ffff880094f14a80 x1830945991569152/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.196271:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14a80 with x1830945991569152 ext(1609728->1613823) 00002000:00010000:3.0:1746127001.196274:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f14a80 00000100:00100000:1.0:1746127001.198294:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.198361:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991569280 00000100:00100000:3.0:1746127001.198369:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991569280 00000100:00100000:3.0:1746127001.198414:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21376 00000100:00100000:3.0:1746127001.198421:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4184:x1830945991569280:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.198437:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.198455:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cb4 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.198483:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 34 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.198490:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127001.198492:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127001.198496:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.198539:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 34 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.198552:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 34 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.198564:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994220416:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.198652:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.200373:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.200626:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994220416:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.200659:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.200674:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e369400, rc 0) 00000100:00100000:3.0:1746127001.200746:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4184:x1830945991569280:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2325us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.200754:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21376 00000100:00100000:2.0:1746127001.201019:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991569408 00000100:00100000:2.0:1746127001.201025:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991569408 00002000:00100000:2.0:1746127001.201073:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1789952->2097151) req@ffff880094f17800 x1830945991569408/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.201082:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f17800 with x1830945991569408 ext(1789952->2097151) 00010000:00010000:2.0:1746127001.201089:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 35 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.201106:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 35 pid: 12333 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.201112:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f17800 00000100:00100000:2.0:1746127001.201155:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1868 00000100:00100000:2.0:1746127001.201162:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991569408:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127001.202871:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.203020:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991569664 00000100:00100000:2.0:1746127001.203027:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991569664 00000100:00100000:2.0:1746127001.203156:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17226 00000100:00100000:2.0:1746127001.203163:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4187:x1830945991569664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.203185:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.203202:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2200/0x34dc807b6ef947e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cbb expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.203270:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203282:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203293:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203304:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203309:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203317:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203412:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203421:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203426:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127001.203434:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127001.203503:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203508:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203513:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203519:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203525:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011d9e2400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127001.203528:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203535:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203545:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127001.203548:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127001.203553:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203557:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6ef9485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203577:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203582:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203587:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203591:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011d9e3a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127001.203593:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203597:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203603:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829000) 00010000:00010000:2.0:1746127001.203604:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127001.203606:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203610:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6ef948c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.203641:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2200/0x34dc807b6ef947e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 42 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.203650:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 41 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.203656:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127001.203658:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127001.203660:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e3600, rc 0) 00000100:00100000:2.0:1746127001.204374:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4187:x1830945991569664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1209us (1508us total) trans 8589938154 rc 0/0 00000100:00100000:2.0:1746127001.204381:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17226 00000100:00100000:3.0:1746127001.204445:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991569408:12345-192.168.203.42@tcp:4:cat.0 Request processed in 3283us (4076us total) trans 17179875550 rc 0/0 00000100:00100000:3.0:1746127001.204453:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1868 00002000:00100000:3.0:1746127001.204461:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1789952->2097151) req@ffff880094f17800 x1830945991569408/t17179875550(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.204469:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f17800 with x1830945991569408 ext(1789952->2097151) 00010000:00010000:3.0:1746127001.204476:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 37 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.204487:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 37 pid: 12333 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746127001.204494:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f17800 00000100:00100000:2.0:1746127001.206731:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.206785:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.206858:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991570048 00000100:00100000:1.0:1746127001.206864:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991569920 00000100:00100000:3.0:1746127001.206866:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991570048 00000100:00100000:1.0:1746127001.206867:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991569920 00010000:00010000:3.0:1746127001.206897:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 37 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.206911:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6551 00000100:00100000:1.0:1746127001.206918:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4187:x1830945991569920:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127001.206921:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9992 00000100:00100000:3.0:1746127001.206925:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991570048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.206937:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.206953:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 37 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.206963:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 37 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.206982:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7200/0x34dc807b6ef944d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c8a expref: 37 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.207050:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.207052:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.207060:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.207077:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.207107:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.207119:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994220544:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.207327:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.207438:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4187:x1830945991569920:12345-192.168.203.42@tcp:35:cat.0 Request processed in 434us (627us total) trans 8589938155 rc 0/0 00000100:00100000:1.0:1746127001.207444:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6551 00000100:00100000:3.0:1746127001.208175:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994220544:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.208190:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.208216:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991570048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1289us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.208223:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9992 00000100:00100000:0.0:1746127001.208682:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.208798:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991570176 00000100:00100000:3.0:1746127001.208802:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991570176 00000100:00100000:3.0:1746127001.208828:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21377 00000100:00100000:3.0:1746127001.208834:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991570176:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.208846:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.208860:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cc2 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.208879:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.208881:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.208886:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 37 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.208899:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 37 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.208907:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e368a00, rc 0) 00000100:00100000:3.0:1746127001.208942:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991570176:12345-192.168.203.42@tcp:101:cat.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.208948:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21377 00000100:00100000:1.0:1746127001.209096:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.209152:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.209255:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991570304 00000100:00100000:0.0:1746127001.209258:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991570304 00000100:00100000:0.0:1746127001.209276:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991570432 00000100:00100000:0.0:1746127001.209278:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991570432 00000100:00100000:0.0:1746127001.209292:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21378 00000100:00100000:0.0:1746127001.209297:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991570304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127001.209304:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127001.209316:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef94a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cc9 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127001.209332:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21379 00000100:00100000:1.0:1746127001.209339:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991570432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127001.209349:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127001.209349:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994220672:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127001.209358:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a65800/0x34dc807b6ef94af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cd0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127001.209382:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd67480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994220800:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127001.209393:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.209401:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.210975:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994220672:192.168.203.42@tcp:106: 00002000:00010000:1.0:1746127001.210999:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746126998 -> 1746126999 00010000:00010000:2.0:1746127001.211001:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef94a8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc9 expref: 38 pid: 12333 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746127001.211003:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746126998 -> 1746126999 00010000:00010000:2.0:1746127001.211011:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef94a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc9 expref: 38 pid: 12333 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127001.211014:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd67480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994220800:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127001.211028:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a65800/0x34dc807b6ef94af lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cd0 expref: 27 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.211035:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3a00, rc 0) 00000100:00100000:2.0:1746127001.211072:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991570304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1766us (1968us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127001.211079:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21378 00010000:00010000:1.0:1746127001.211099:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a65800/0x34dc807b6ef94af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cd0 expref: 27 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.211107:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a65800, rc 0) 00000100:00100000:1.0:1746127001.211122:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991570432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1785us (1971us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127001.211147:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21379 00000100:00100000:0.0:1746127001.213421:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.213521:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991570688 00000100:00100000:3.0:1746127001.213531:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991570688 00002000:00100000:3.0:1746127001.213575:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094f14380 x1830945991570688/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.213586:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14380 with x1830945991570688 ext(1048576->2097151) 00002000:00010000:3.0:1746127001.213591:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f14380 00000100:00100000:3.0:1746127001.213619:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8516 00000100:00100000:3.0:1746127001.213627:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991570688:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127001.213721:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.213743:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.213761:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991570944 00000100:00100000:1.0:1746127001.213764:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991570944 00002000:00100000:1.0:1746127001.213781:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1871871) req@ffff88009cd67480 x1830945991570944/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.213789:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67480 with x1830945991570944 ext(1048576->1871871) 00002000:00010000:1.0:1746127001.213792:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd67480 00000100:00100000:1.0:1746127001.213803:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991571200 00000100:00100000:1.0:1746127001.213805:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991571200 00002000:00100000:1.0:1746127001.213816:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1613824->2097151) req@ffff88009cd65500 x1830945991571200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.213822:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65500 with x1830945991571200 ext(1613824->2097151) 00002000:00010000:1.0:1746127001.213825:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65500 00000100:00100000:1.0:1746127001.213835:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8517 00000100:00100000:1.0:1746127001.213846:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991570944:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127001.213888:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8518 00000100:00100000:0.0:1746127001.213894:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991571200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127001.218708:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.219401:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991571456 00000100:00100000:2.0:1746127001.219410:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991571456 00002000:00100000:2.0:1746127001.219452:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007ec78a80 x1830945991571456/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.219462:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec78a80 with x1830945991571456 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.219468:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec78a80 00000100:00100000:2.0:1746127001.219491:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8519 00000100:00100000:2.0:1746127001.219499:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991571456:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127001.219688:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991570944:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5846us (5967us total) trans 0 rc 823296/823296 00000100:00100000:1.0:1746127001.219695:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8517 00002000:00100000:1.0:1746127001.219700:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1871871) req@ffff88009cd67480 x1830945991570944/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.219705:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67480 with x1830945991570944 ext(1048576->1871871) 00002000:00010000:1.0:1746127001.219708:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd67480 00000100:00100000:3.0:1746127001.221151:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991570688:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7519us (7732us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127001.221160:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8516 00002000:00100000:3.0:1746127001.221168:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094f14380 x1830945991570688/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.221176:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14380 with x1830945991570688 ext(1048576->2097151) 00002000:00010000:3.0:1746127001.221180:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f14380 00000100:00100000:2.0:1746127001.223969:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991571200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10065us (10215us total) trans 0 rc 483328/483328 00000100:00100000:2.0:1746127001.223981:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8518 00002000:00100000:2.0:1746127001.223992:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1613824->2097151) req@ffff88009cd65500 x1830945991571200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.224000:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65500 with x1830945991571200 ext(1613824->2097151) 00002000:00010000:2.0:1746127001.224006:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65500 00000100:00100000:2.0:1746127001.230926:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991571456:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11415us (12216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127001.230941:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8519 00002000:00100000:2.0:1746127001.230952:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007ec78a80 x1830945991571456/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.230961:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec78a80 with x1830945991571456 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.230966:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec78a80 00000100:00100000:0.0:1746127001.238101:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.238158:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991571712 00000100:00100000:2.0:1746127001.238168:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991571712 00000100:00100000:2.0:1746127001.238230:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17227 00000100:00100000:2.0:1746127001.238237:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4190:x1830945991571712:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127001.238262:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.238283:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880076179400/0x34dc807b6ef94b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cd7 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.238364:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238377:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238388:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238400:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238405:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238410:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238504:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4000/0x34dc807b6ef94cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238511:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4000/0x34dc807b6ef94cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238516:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4000/0x34dc807b6ef94cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127001.238524:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127001.238610:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238616:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238625:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238631:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238637:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880076179600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127001.238640:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238646:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238656:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127001.238658:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127001.238662:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238668:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880076179600/0x34dc807b6ef94bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238689:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238694:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238698:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238702:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800967e5800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127001.238704:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238713:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238718:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829b00) 00010000:00010000:2.0:1746127001.238720:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127001.238722:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238726:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6ef94c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.238759:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880076179400/0x34dc807b6ef94b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cd7 expref: 45 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.238770:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4000/0x34dc807b6ef94cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cd7 expref: 44 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.238776:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127001.238778:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127001.238781:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4000, rc 0) 00000100:00100000:2.0:1746127001.238833:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4190:x1830945991571712:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 597us (742us total) trans 8589938156 rc 0/0 00000100:00100000:2.0:1746127001.238839:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17227 00000100:00100000:0.0:1746127001.245361:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.246893:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991571840 00000100:00100000:1.0:1746127001.246907:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991571840 00000100:00100000:1.0:1746127001.247000:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21380 00000100:00100000:1.0:1746127001.247011:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4187:x1830945991571840:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127001.247033:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.247053:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cde expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.247100:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.247108:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.247110:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.247114:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 38 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.247178:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.247192:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.247205:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994220928:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.247330:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.247387:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.247407:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991571968 00000100:00100000:3.0:1746127001.247411:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991571968 00000100:00100000:3.0:1746127001.247440:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1014 00000100:00100000:3.0:1746127001.247445:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991571968:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.247455:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.247476:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4000/0x34dc807b6ef94cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cd7 expref: 44 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.247495:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.247498:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.247520:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991571968:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 73us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.247525:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1014 00000100:00100000:0.0:1746127001.257425:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.257431:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994220928:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.257461:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 38 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.257486:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915ba00, rc 0) 00000100:00100000:2.0:1746127001.257489:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991572096 00000100:00100000:2.0:1746127001.257500:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991572096 00000100:00100000:1.0:1746127001.257543:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4187:x1830945991571840:12345-192.168.203.42@tcp:101:cat.0 Request processed in 10535us (12195us total) trans 0 rc 0/0 00002000:00100000:2.0:1746127001.257545:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1871872->2097151) req@ffff88007ec78700 x1830945991572096/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127001.257552:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21380 00002000:00100000:2.0:1746127001.257554:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec78700 with x1830945991572096 ext(1871872->2097151) 00010000:00010000:2.0:1746127001.257561:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.257573:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.257580:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ec78700 00000100:00100000:2.0:1746127001.257681:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1869 00000100:00100000:2.0:1746127001.257687:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991572096:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127001.267846:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991572096:12345-192.168.203.42@tcp:4:cat.0 Request processed in 10146us (10420us total) trans 17179875551 rc 0/0 00000100:00100000:2.0:1746127001.267860:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1869 00002000:00100000:2.0:1746127001.267872:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1871872->2097151) req@ffff88007ec78700 x1830945991572096/t17179875551(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.267880:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec78700 with x1830945991572096 ext(1871872->2097151) 00010000:00010000:2.0:1746127001.267889:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 17 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.267902:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 17 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.267909:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ec78700 00000100:00100000:0.0:1746127001.276092:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.276302:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991572224 00000100:00100000:2.0:1746127001.276312:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991572224 00010000:00010000:2.0:1746127001.276352:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 17 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.276405:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9993 00000100:00100000:2.0:1746127001.276412:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991572224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.276428:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.276449:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 17 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.276462:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 17 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.276487:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3200/0x34dc807b6ef9462 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c9f expref: 17 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.276508:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.276510:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.276517:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 37 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.276524:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 37 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.276558:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 37 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.276968:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994221056:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127001.277343:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.282715:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.282866:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991572480 00000100:00100000:2.0:1746127001.282874:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991572480 00002000:00100000:2.0:1746127001.282923:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ec7a680 x1830945991572480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.282933:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7a680 with x1830945991572480 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.282938:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec7a680 00000100:00100000:2.0:1746127001.282958:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8520 00000100:00100000:2.0:1746127001.282965:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991572480:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127001.283166:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994221056:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.283190:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.283248:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991572224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6836us (7166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.283260:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9993 00000100:00100000:2.0:1746127001.297434:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991572480:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14458us (14909us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127001.297447:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8520 00002000:00100000:2.0:1746127001.297458:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ec7a680 x1830945991572480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.297467:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7a680 with x1830945991572480 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.297473:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec7a680 00000100:00100000:0.0:1746127001.305943:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.305971:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991572608 00000100:00100000:1.0:1746127001.305980:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991572608 00000100:00100000:1.0:1746127001.306034:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21381 00000100:00100000:1.0:1746127001.306043:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:4187:x1830945991572608:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127001.306061:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.306088:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ce5 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.306122:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.306143:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.306144:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.306148:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.306179:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 9 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.306190:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 9 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.306208:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221184:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.306302:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.309590:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.309707:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221184:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.309738:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.309756:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915ac00, rc 0) 00000100:00100000:1.0:1746127001.309799:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4187:x1830945991572608:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3758us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.309808:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21381 00000100:00100000:2.0:1746127001.309890:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991572736 00000100:00100000:2.0:1746127001.309897:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991572736 00002000:00100000:2.0:1746127001.309937:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1613823) req@ffff88009d1b5180 x1830945991572736/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.309945:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5180 with x1830945991572736 ext(1048576->1613823) 00010000:00010000:2.0:1746127001.309951:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 10 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.309962:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 10 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.309972:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1b5180 00000100:00100000:2.0:1746127001.309991:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1870 00000100:00100000:2.0:1746127001.309998:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991572736:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127001.320106:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991572736:12345-192.168.203.42@tcp:4:cat.0 Request processed in 10095us (10513us total) trans 21474842808 rc 0/0 00000100:00100000:2.0:1746127001.320122:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1870 00002000:00100000:2.0:1746127001.320161:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1613823) req@ffff88009d1b5180 x1830945991572736/t21474842808(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.320171:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5180 with x1830945991572736 ext(1048576->1613823) 00010000:00010000:2.0:1746127001.320182:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 12 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.320199:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 12 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.320205:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d1b5180 00000100:00100000:0.0:1746127001.326014:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.326193:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991572864 00000100:00100000:3.0:1746127001.326202:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991572864 00010000:00010000:3.0:1746127001.326241:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 12 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.326275:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9994 00000100:00100000:3.0:1746127001.326282:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991572864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.326296:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.326317:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 12 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.326328:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 12 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.326350:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3000/0x34dc807b6ef9469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1613823) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ca6 expref: 12 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.326469:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.326471:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.326479:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.326492:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.326526:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.326539:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994221312:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.326802:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.329514:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994221312:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.329537:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.329587:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991572864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3305us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.329598:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9994 00000100:00100000:0.0:1746127001.332587:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.333599:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991573120 00000100:00100000:2.0:1746127001.333609:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991573120 00002000:00100000:2.0:1746127001.333660:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009d1b4000 x1830945991573120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.333670:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4000 with x1830945991573120 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.333676:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b4000 00000100:00100000:2.0:1746127001.333840:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8521 00000100:00100000:2.0:1746127001.333850:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991573120:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127001.347695:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991573120:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13835us (15105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127001.347707:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8521 00002000:00100000:2.0:1746127001.347718:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009d1b4000 x1830945991573120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.347727:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4000 with x1830945991573120 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.347733:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b4000 00000100:00100000:0.0:1746127001.361310:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.362424:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991573248 00000100:00100000:1.0:1746127001.362435:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991573248 00000100:00100000:1.0:1746127001.362962:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21382 00000100:00100000:1.0:1746127001.362972:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4193:x1830945991573248:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127001.362990:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.363010:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cec expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.363044:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 26 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.363052:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 12 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.363079:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 8 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.363086:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.363088:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.363091:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [655360->1048575] (req 655360->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 12 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.363122:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 8 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.363150:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 8 pid: 9611 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.363163:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221440:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.363320:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 12 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.363329:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 12 pid: 12333 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.363337:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1788a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221568:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.363366:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 26 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.363377:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 26 pid: 11152 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.363384:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221696:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.363398:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.365091:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221440:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.365103:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a1788a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221568:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.365110:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994221696:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.365175:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [655360->1048575] (req 655360->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 12 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.365190:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915a200, rc 0) 00000100:00100000:1.0:1746127001.365238:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4193:x1830945991573248:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2267us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.365246:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21382 00000100:00100000:0.0:1746127001.366808:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.366847:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.366880:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991573376 00000100:00100000:0.0:1746127001.366888:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.366889:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991573376 00010000:00010000:3.0:1746127001.366925:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 9 pid: 9611 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.367448:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991573504 00000100:00100000:3.0:1746127001.367453:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991573504 00010000:00010000:3.0:1746127001.367467:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 12 pid: 12333 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.367486:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991573632 00000100:00100000:1.0:1746127001.367490:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991573632 00010000:00010000:1.0:1746127001.367505:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 27 pid: 11152 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.367508:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9995 00000100:00100000:2.0:1746127001.367516:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991573376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127001.367523:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9996 00000100:00100000:1.0:1746127001.367527:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991573632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.367529:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127001.367534:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.367549:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 9 pid: 9611 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746127001.367549:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 27 pid: 11152 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.367559:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 9 pid: 9611 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.367582:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9997 00000100:00100000:3.0:1746127001.367588:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991573504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.367595:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127001.368216:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 27 pid: 11152 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.368248:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3a00/0x34dc807b6ef90d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a37 expref: 27 pid: 11152 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.368260:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6ef90f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a45 expref: 9 pid: 9611 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746127001.368277:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127001.368297:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.368319:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991573376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 804us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.368323:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991573632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 796us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.368326:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9995 00000100:00100000:1.0:1746127001.368328:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9996 00010000:00010000:3.0:1746127001.368440:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 12 pid: 12333 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.368452:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 12 pid: 12333 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.368464:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6ef9175 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a92 expref: 12 pid: 12333 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.368475:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.368477:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.368483:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 11 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.368491:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 11 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.368522:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 11 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.368535:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994221824:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.368590:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.369849:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994221824:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.369868:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.369910:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991573504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2322us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.369923:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9997 00000100:00100000:1.0:1746127001.370424:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.370524:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991573888 00000100:00100000:3.0:1746127001.370531:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991573888 00002000:00100000:3.0:1746127001.370565:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9c:0x0] (655360->659455) req@ffff8801303d2a00 x1830945991573888/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.370574:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d2a00 with x1830945991573888 ext(655360->659455) 00002000:00010000:3.0:1746127001.370578:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d2a00 00000100:00100000:3.0:1746127001.370594:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8522 00000100:00100000:3.0:1746127001.370599:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991573888:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.371164:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991573888:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 563us (739us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.371171:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8522 00002000:00100000:3.0:1746127001.371176:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9c:0x0] (655360->659455) req@ffff8801303d2a00 x1830945991573888/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.371184:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d2a00 with x1830945991573888 ext(655360->659455) 00002000:00010000:3.0:1746127001.371187:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d2a00 00000100:00100000:0.0:1746127001.376407:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.376471:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991574016 00000100:00100000:1.0:1746127001.376480:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991574016 00000100:00100000:1.0:1746127001.376540:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21383 00000100:00100000:1.0:1746127001.376548:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4193:x1830945991574016:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127001.376571:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.376589:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cf3 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.376619:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.376627:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 37 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.376638:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.376640:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.376643:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 17 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.376672:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 37 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.376684:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 37 pid: 1964 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.376696:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994221952:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.376798:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.377204:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 17 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.377213:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222080:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.377443:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.381763:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.381860:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994221952:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.381871:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222080:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.381908:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 17 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.381922:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fdc00, rc 0) 00000100:00100000:3.0:1746127001.382606:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991574144 00000100:00100000:3.0:1746127001.382612:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991574144 00010000:00010000:3.0:1746127001.382651:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 18 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.382688:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9998 00000100:00100000:3.0:1746127001.382695:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991574144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.382707:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.382722:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 18 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.382736:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 18 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.382765:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6ef9477 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cb4 expref: 18 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.382836:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4193:x1830945991574016:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6288us (6436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.382841:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21383 00010000:00010000:3.0:1746127001.382895:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.382930:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991574144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 235us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.382935:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9998 00000100:00100000:0.0:1746127001.383971:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.384126:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991574272 00000100:00100000:3.0:1746127001.384150:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991574272 00010000:00010000:3.0:1746127001.384166:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 38 pid: 1964 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.384393:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9999 00000100:00100000:3.0:1746127001.384400:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991574272:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.384410:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.384421:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 38 pid: 1964 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.384431:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 38 pid: 1964 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.384450:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6ef94a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cc2 expref: 38 pid: 1964 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.384464:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.384465:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.384470:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.384477:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.384502:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.384513:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994222208:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.384751:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.389090:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.389192:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994222208:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.389209:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.389256:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991574272:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4855us (5285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.389265:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9999 00000100:00100000:0.0:1746127001.389368:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991574528 00000100:00100000:0.0:1746127001.389374:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991574528 00002000:00100000:0.0:1746127001.389405:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1110016->1114111) req@ffff880122384000 x1830945991574528/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127001.389414:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384000 with x1830945991574528 ext(1110016->1114111) 00002000:00010000:0.0:1746127001.389418:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122384000 00000100:00100000:0.0:1746127001.389433:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8523 00000100:00100000:0.0:1746127001.389439:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991574528:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127001.389555:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991574528:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 116us (471us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127001.389561:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8523 00002000:00100000:0.0:1746127001.389565:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1110016->1114111) req@ffff880122384000 x1830945991574528/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127001.389572:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384000 with x1830945991574528 ext(1110016->1114111) 00002000:00010000:0.0:1746127001.389574:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122384000 00000100:00100000:0.0:1746127001.405845:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.405905:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991574656 00000100:00100000:2.0:1746127001.405913:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991574656 00000100:00100000:2.0:1746127001.405957:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21384 00000100:00100000:2.0:1746127001.405964:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:4190:x1830945991574656:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127001.405978:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.405991:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52cfa expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.406768:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.406778:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.406783:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.406785:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.406788:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.406819:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.406830:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.406841:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994222336:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.406934:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 10 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.406942:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 10 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.406950:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994222464:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.406965:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.409258:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994222336:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.409268:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994222464:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.409289:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.409522:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5400, rc 0) 00000100:00100000:2.0:1746127001.412566:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4190:x1830945991574656:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6592us (6716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.412580:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21384 00000100:00100000:0.0:1746127001.415567:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.415632:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991574784 00000100:00100000:3.0:1746127001.415640:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991574784 00000100:00100000:0.0:1746127001.415647:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127001.416078:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 11 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.416193:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991574912 00000100:00100000:2.0:1746127001.416198:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991574912 00010000:00010000:2.0:1746127001.416214:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.416241:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10000 00000100:00100000:2.0:1746127001.416247:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991574784:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.416258:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.416306:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 11 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.416315:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 11 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.416334:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf7a00/0x34dc807b6ef93f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c60 expref: 11 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.416365:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.416647:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10001 00000100:00100000:3.0:1746127001.416654:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991574912:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.416661:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.416669:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.416677:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.416689:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6ef942a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c75 expref: 27 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.416800:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991574784:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 552us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.416806:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10000 00010000:00010000:3.0:1746127001.417052:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.417055:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.417061:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.417077:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.417103:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.417114:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994222592:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.417295:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.422805:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.422905:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991575168 00000100:00100000:0.0:1746127001.422913:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991575168 00002000:00100000:0.0:1746127001.422948:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2895872->2899967) req@ffff880122384700 x1830945991575168/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127001.422956:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384700 with x1830945991575168 ext(2895872->2899967) 00002000:00010000:0.0:1746127001.422961:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122384700 00000100:00100000:0.0:1746127001.422992:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8524 00000100:00100000:0.0:1746127001.422999:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991575168:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.423038:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994222592:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.423053:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.423098:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991574912:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6444us (7451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127001.423102:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991575168:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 103us (302us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.423105:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10001 00000100:00100000:0.0:1746127001.423108:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8524 00002000:00100000:0.0:1746127001.423114:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2895872->2899967) req@ffff880122384700 x1830945991575168/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127001.423120:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384700 with x1830945991575168 ext(2895872->2899967) 00002000:00010000:0.0:1746127001.423122:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122384700 00000100:00100000:0.0:1746127001.427462:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.427553:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991575296 00000100:00100000:2.0:1746127001.427564:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991575296 00000100:00100000:2.0:1746127001.427618:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21385 00000100:00100000:2.0:1746127001.427626:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4190:x1830945991575296:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127001.427641:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.427656:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d01 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.427681:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.427689:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.427696:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 38 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.427701:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.427702:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.427705:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->2781183] (req 2097152->2781183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 38 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.427730:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 38 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.427740:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 38 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.427756:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222720:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.428509:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.428518:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.428526:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222848:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.428559:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.428566:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.428573:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222976:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.428588:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.429196:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222720:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.431588:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.431691:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991575424 00000100:00100000:3.0:1746127001.431698:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991575424 00010000:00010000:3.0:1746127001.431728:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 39 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.431808:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10002 00000100:00100000:3.0:1746127001.431816:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991575424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.431829:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.431844:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 39 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.431854:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 39 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.431871:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9431 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c7c expref: 39 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.432358:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.432535:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991575424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 717us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.432541:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10002 00000100:00100000:0.0:1746127001.439268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.439370:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222848:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.439381:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994222976:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.439406:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2781183] (req 2097152->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 37 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.439421:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4a00, rc 0) 00000100:00100000:2.0:1746127001.439458:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4190:x1830945991575296:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 11833us (12005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.439466:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21385 00000100:00100000:3.0:1746127001.439537:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991575552 00000100:00100000:3.0:1746127001.439544:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991575552 00010000:00010000:3.0:1746127001.439566:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 16 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.439584:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10003 00000100:00100000:3.0:1746127001.439589:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991575552:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.439599:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.439613:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 16 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.439621:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 16 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.439638:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bebe800/0x34dc807b6ef93eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c52 expref: 16 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.440961:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.441010:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991575552:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1417us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.441018:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10003 00000100:00100000:2.0:1746127001.442025:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.442122:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991575680 00000100:00100000:3.0:1746127001.442154:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991575680 00010000:00010000:3.0:1746127001.442176:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.442204:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10004 00000100:00100000:3.0:1746127001.442210:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991575680:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.442223:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.442237:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.442247:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.442262:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7600/0x34dc807b6ef9400 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c67 expref: 15 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.442273:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.442275:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.442280:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.442287:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.442312:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.442327:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994223104:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.442405:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.443848:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994223104:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.443862:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.444227:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991575680:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2015us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.444236:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10004 00000100:00100000:0.0:1746127001.451492:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.451554:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991575936 00000100:00100000:1.0:1746127001.451563:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991575936 00002000:00100000:1.0:1746127001.451602:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2777088->2781183) req@ffff88012d3fe300 x1830945991575936/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.451618:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe300 with x1830945991575936 ext(2777088->2781183) 00002000:00010000:1.0:1746127001.451622:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fe300 00000100:00100000:1.0:1746127001.451653:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8525 00000100:00100000:1.0:1746127001.451661:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991575936:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127001.451763:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991575936:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 103us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127001.451769:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8525 00002000:00100000:1.0:1746127001.451774:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2777088->2781183) req@ffff88012d3fe300 x1830945991575936/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.451779:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe300 with x1830945991575936 ext(2777088->2781183) 00002000:00010000:1.0:1746127001.451782:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fe300 00000100:00100000:0.0:1746127001.455325:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.455398:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991576192 00000100:00100000:1.0:1746127001.455405:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991576192 00000100:00100000:1.0:1746127001.455459:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6552 00000100:00100000:1.0:1746127001.455466:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4190:x1830945991576192:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127001.455707:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4190:x1830945991576192:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 241us (387us total) trans 8589938157 rc 0/0 00000100:00100000:1.0:1746127001.456096:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6552 00000100:00100000:0.0:1746127001.465579:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.465619:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.465666:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.465708:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991576320 00000100:00100000:1.0:1746127001.465719:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991576320 00000100:00100000:1.0:1746127001.465768:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991576448 00000100:00100000:1.0:1746127001.465770:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991576448 00000100:00100000:1.0:1746127001.465802:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991576576 00000100:00100000:1.0:1746127001.465805:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991576576 00000100:00100000:2.0:1746127001.465813:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21386 00000100:00100000:1.0:1746127001.465830:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21387 00000100:00100000:2.0:1746127001.465833:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21388 00000100:00100000:1.0:1746127001.465834:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991576448:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127001.465838:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991576576:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127001.465849:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991576320:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.465857:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.465857:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.465870:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880076178e00/0x34dc807b6ef950a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d16 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.465870:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d0f expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.465888:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.465890:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.465896:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.465908:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127001.465911:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994223232:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127001.465916:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fde00, rc 0) 00000100:00100000:0.0:1746127001.466237:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.466245:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991576448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 409us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.466251:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21387 00000100:00100000:2.0:1746127001.466257:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00010000:00010000:2.0:1746127001.466268:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127001.466274:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991576704 00010000:00010000:2.0:1746127001.466277:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d08 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127001.466277:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991576704 00010000:00010000:2.0:1746127001.466288:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.466289:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746127001.466291:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21389 00010000:00010000:2.0:1746127001.466293:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 16 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127001.466295:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991576704:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127001.466300:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.466302:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 16 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.466306:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9518 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d1d expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.466308:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4200, rc 0) 00000100:00100000:1.0:1746127001.466325:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994223360:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127001.466443:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.466444:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991576320:12345-192.168.203.42@tcp:101:cat.0 Request processed in 624us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.466450:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21386 00002000:00010000:2.0:1746127001.467520:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746126999 -> 1746127000 00002000:00010000:2.0:1746127001.467524:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746126999 -> 1746127000 00002000:00010000:2.0:1746127001.467526:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746126999 -> 1746127000 00000100:00100000:2.0:1746127001.467540:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994223232:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127001.467561:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880076178e00/0x34dc807b6ef950a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d16 expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.467571:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880076178e00/0x34dc807b6ef950a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d16 expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.467593:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076178e00, rc 0) 00000100:00100000:2.0:1746127001.467634:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991576576:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1795us (1966us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127001.467640:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21388 00002000:00010000:1.0:1746127001.468665:0:12333:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127001.468669:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127001.468671:0:12333:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746126999 -> 1746127000 00000100:00100000:1.0:1746127001.468682:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994223360:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127001.468697:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9518 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d1d expref: 16 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.468707:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9518 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d1d expref: 16 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.468732:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fc800, rc 0) 00000100:00100000:1.0:1746127001.468864:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991576704:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2567us (2627us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127001.468870:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21389 00000100:00100000:0.0:1746127001.477489:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.477527:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.477553:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.477736:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.477958:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991577216 00000100:00100000:2.0:1746127001.477967:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991577216 00002000:00100000:2.0:1746127001.478018:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012d288700 x1830945991577216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.478028:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288700 with x1830945991577216 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.478033:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288700 00000100:00100000:2.0:1746127001.478052:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991577088 00000100:00100000:2.0:1746127001.478056:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991577088 00002000:00100000:2.0:1746127001.478081:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1114112->2097151) req@ffff88012d289500 x1830945991577088/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.478087:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d289500 with x1830945991577088 ext(1114112->2097151) 00002000:00010000:2.0:1746127001.478091:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d289500 00000100:00100000:2.0:1746127001.478102:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991577472 00000100:00100000:2.0:1746127001.478105:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991577472 00002000:00100000:2.0:1746127001.478117:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->655359) req@ffff880130a77800 x1830945991577472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.478123:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77800 with x1830945991577472 ext(0->655359) 00002000:00010000:2.0:1746127001.478154:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a77800 00000100:00100000:2.0:1746127001.478170:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991577600 00000100:00100000:2.0:1746127001.478173:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991577600 00002000:00100000:2.0:1746127001.478184:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a75500 x1830945991577600/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.478190:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75500 with x1830945991577600 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.478193:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a75500 00000100:00100000:2.0:1746127001.478204:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8526 00000100:00100000:2.0:1746127001.478211:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991577216:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127001.478663:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8527 00000100:00100000:1.0:1746127001.478670:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991577088:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127001.479040:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8528 00000100:00100000:0.0:1746127001.479049:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991577472:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127001.479548:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8529 00000100:00100000:0.0:1746127001.479554:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991577600:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127001.491239:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991577472:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12179us (13670us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746127001.491253:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8528 00002000:00100000:2.0:1746127001.491264:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (0->655359) req@ffff880130a77800 x1830945991577472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.491275:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77800 with x1830945991577472 ext(0->655359) 00002000:00010000:2.0:1746127001.491280:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a77800 00000100:00100000:1.0:1746127001.491418:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991577088:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12748us (13889us total) trans 0 rc 983040/983040 00000100:00100000:1.0:1746127001.491425:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8527 00002000:00100000:1.0:1746127001.491431:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1114112->2097151) req@ffff88012d289500 x1830945991577088/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.491438:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d289500 with x1830945991577088 ext(1114112->2097151) 00002000:00010000:1.0:1746127001.491441:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d289500 00000100:00100000:1.0:1746127001.494687:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991577600:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15122us (16940us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127001.494705:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8529 00002000:00100000:1.0:1746127001.494716:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a75500 x1830945991577600/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.494725:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75500 with x1830945991577600 ext(1048576->2097151) 00002000:00010000:1.0:1746127001.494735:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a75500 00000100:00100000:3.0:1746127001.495520:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991577216:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17305us (18037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127001.495532:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8526 00002000:00100000:3.0:1746127001.495537:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012d288700 x1830945991577216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.495544:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288700 with x1830945991577216 ext(1048576->2097151) 00002000:00010000:3.0:1746127001.495548:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288700 00000100:00100000:0.0:1746127001.508763:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.508821:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.508849:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991577856 00000100:00100000:1.0:1746127001.508858:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991577856 00000100:00100000:1.0:1746127001.508914:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991577984 00000100:00100000:1.0:1746127001.508916:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991577984 00000100:00100000:1.0:1746127001.508932:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21390 00000100:00100000:1.0:1746127001.508940:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991577856:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127001.508958:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.508976:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967fd000/0x34dc807b6ef951f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d24 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127001.509032:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994223488:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127001.509156:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.509159:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21391 00000100:00100000:3.0:1746127001.509168:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991577984:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.509175:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.509187:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6ef9526 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d2b expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.509213:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994223616:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127001.509249:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.514586:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994223488:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127001.514598:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994223616:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127001.514625:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6ef9526 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d2b expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.514625:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967fd000/0x34dc807b6ef951f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d24 expref: 12 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.514638:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6ef9526 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d2b expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.514638:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967fd000/0x34dc807b6ef951f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d24 expref: 12 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.514655:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918a400, rc 0) 00010000:00010000:1.0:1746127001.514666:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fd000, rc 0) 00000100:00100000:3.0:1746127001.514697:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991577984:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5531us (5876us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127001.514698:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991577856:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5759us (5945us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127001.514705:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21391 00000100:00100000:1.0:1746127001.514715:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21390 00000100:00100000:0.0:1746127001.518694:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.519386:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991578112 00000100:00100000:3.0:1746127001.519396:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991578112 00000100:00100000:3.0:1746127001.519456:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21392 00000100:00100000:3.0:1746127001.519464:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4199:x1830945991578112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.519484:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.519502:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d32 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.519535:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.519543:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127001.519545:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127001.519552:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 12 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.519583:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.519595:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 25 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.519607:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994223744:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.519686:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.534394:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.534441:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.535085:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991578368 00000100:00100000:1.0:1746127001.535094:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991578368 00000100:00100000:1.0:1746127001.536941:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21393 00000100:00100000:1.0:1746127001.536953:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4203:x1830945991578368:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127001.536973:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.536992:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d39 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.537187:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991578240 00000100:00100000:2.0:1746127001.537194:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991578240 00000100:00100000:3.0:1746127001.537201:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994223744:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.537227:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746127001.537228:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2895872->3145727) req@ffff8800a5b9bb80 x1830945991578240/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.537237:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9bb80 with x1830945991578240 ext(2895872->3145727) 00010000:00010000:3.0:1746127001.537243:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b800, rc 0) 00010000:00010000:2.0:1746127001.537244:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 26 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.537256:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 26 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.537262:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5b9bb80 00000100:00100000:2.0:1746127001.537284:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1871 00000100:00100000:2.0:1746127001.537290:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991578240:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127001.537295:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4199:x1830945991578112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 17831us (18608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.537302:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21392 00010000:00010000:1.0:1746127001.537838:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.537846:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.537852:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.537854:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.537857:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1183744->1490943] (req 1183744->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 13 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.537885:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.537900:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.537911:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994223872:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.537993:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.538001:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 27 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.538008:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994224000:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.538026:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.548893:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.549264:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994223872:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.549276:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994224000:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.549309:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1183744->1490943] (req 1183744->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 13 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.549327:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fd200, rc 0) 00000100:00100000:1.0:1746127001.549377:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4203:x1830945991578368:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 12428us (14991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.549385:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21393 00000100:00100000:2.0:1746127001.549588:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991578496 00000100:00100000:2.0:1746127001.549595:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991578496 00010000:00010000:2.0:1746127001.549622:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.549643:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10005 00000100:00100000:2.0:1746127001.549649:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991578496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.549660:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.549680:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 996 lvb_type: 1 00010000:00010000:2.0:1746127001.549689:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 996 lvb_type: 1 00010000:00010000:2.0:1746127001.549712:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967fde00/0x34dc807b6ef9503 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d0f expref: 13 pid: 12333 timeout: 996 lvb_type: 1 00010000:00010000:2.0:1746127001.550431:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.550501:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991578496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 849us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.550510:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10005 00000100:00100000:0.0:1746127001.551869:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.552565:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991578624 00000100:00100000:2.0:1746127001.552573:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991578624 00010000:00010000:2.0:1746127001.552602:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 30 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.552633:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10006 00000100:00100000:2.0:1746127001.552640:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991578624:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.552652:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.552667:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 30 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.552677:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 30 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.552696:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009915ac00/0x34dc807b6ef94e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ce5 expref: 30 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.552710:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.552711:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.552718:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.552730:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.552757:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 11 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.552767:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994224128:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127001.552839:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.553015:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991578240:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 15724us (18572us total) trans 21474842809 rc 0/0 00000100:00100000:3.0:1746127001.553025:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1871 00002000:00100000:3.0:1746127001.553033:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2895872->3145727) req@ffff8800a5b9bb80 x1830945991578240/t21474842809(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.553041:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9bb80 with x1830945991578240 ext(2895872->3145727) 00010000:00010000:3.0:1746127001.553047:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 28 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.553057:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 28 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746127001.553074:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5b9bb80 00000100:00100000:0.0:1746127001.555696:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.555807:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994224128:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127001.555828:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.556176:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991578880 00000100:00100000:3.0:1746127001.556183:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991578880 00002000:00100000:3.0:1746127001.556872:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1183744->1187839) req@ffff880096632d80 x1830945991578880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.556881:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096632d80 with x1830945991578880 ext(1183744->1187839) 00002000:00010000:3.0:1746127001.556887:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096632d80 00000100:00100000:3.0:1746127001.556919:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8530 00000100:00100000:3.0:1746127001.556926:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991578880:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127001.557083:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991578624:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4442us (5216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.557092:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10006 00000100:00100000:3.0:1746127001.557691:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991578880:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 764us (2003us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.557698:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8530 00002000:00100000:3.0:1746127001.557704:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1183744->1187839) req@ffff880096632d80 x1830945991578880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.557712:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096632d80 with x1830945991578880 ext(1183744->1187839) 00002000:00010000:3.0:1746127001.557715:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096632d80 00000100:00100000:0.0:1746127001.558109:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.558484:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991579008 00000100:00100000:2.0:1746127001.558490:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991579008 00010000:00010000:2.0:1746127001.558513:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 27 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.558891:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10007 00000100:00100000:2.0:1746127001.558897:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991579008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.558908:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.558925:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 27 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.558942:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 27 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.558962:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5400/0x34dc807b6ef94f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cfa expref: 27 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.561020:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.561026:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.561041:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 11 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.561051:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 11 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.561112:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 11 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.561124:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994224256:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127001.561242:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.562420:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.563578:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991579264 00000100:00100000:3.0:1746127001.563589:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991579264 00002000:00100000:3.0:1746127001.563656:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1486848->1490943) req@ffff88009cbb3100 x1830945991579264/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.563667:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb3100 with x1830945991579264 ext(1486848->1490943) 00002000:00010000:3.0:1746127001.563673:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb3100 00000100:00100000:3.0:1746127001.563706:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8531 00000100:00100000:3.0:1746127001.563714:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991579264:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.564319:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991579264:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 605us (1901us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.564327:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8531 00002000:00100000:3.0:1746127001.564333:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1486848->1490943) req@ffff88009cbb3100 x1830945991579264/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.564345:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb3100 with x1830945991579264 ext(1486848->1490943) 00002000:00010000:3.0:1746127001.564348:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb3100 00000100:00100000:2.0:1746127001.567048:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994224256:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127001.567076:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.567116:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991579008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8218us (9007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.567168:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10007 00000100:00100000:0.0:1746127001.568693:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.568872:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991579520 00000100:00100000:2.0:1746127001.568881:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991579520 00002000:00100000:2.0:1746127001.568924:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009cbb2300 x1830945991579520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.568936:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb2300 with x1830945991579520 ext(2097152->3145727) 00002000:00010000:2.0:1746127001.568941:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb2300 00000100:00100000:2.0:1746127001.568968:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8532 00000100:00100000:2.0:1746127001.568975:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991579520:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127001.576811:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991579520:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 7823us (8110us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127001.576824:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8532 00002000:00100000:2.0:1746127001.576837:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009cbb2300 x1830945991579520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.576846:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cbb2300 with x1830945991579520 ext(2097152->3145727) 00002000:00010000:2.0:1746127001.576852:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cbb2300 00000100:00100000:2.0:1746127001.581859:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.582508:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.582600:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991579904 00000100:00100000:3.0:1746127001.582609:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991579904 00000100:00100000:3.0:1746127001.583180:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17228 00000100:00100000:3.0:1746127001.583190:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4209:x1830945991579904:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.583215:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127001.583226:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991579648 00000100:00100000:1.0:1746127001.583231:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991579648 00010000:00010000:3.0:1746127001.583235:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a400/0x34dc807b6ef953b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d47 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127001.583261:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21394 00000100:00100000:1.0:1746127001.583267:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4199:x1830945991579648:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127001.583275:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.583287:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d40 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.583310:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.583312:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127001.583317:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.583319:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.583322:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 16 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.583324:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583335:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583347:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583351:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127001.583352:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.583356:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127001.583364:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 36 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.583375:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994224384:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.583452:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef9557 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127001.583452:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00010000:00010000:3.0:1746127001.583464:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef9557 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583470:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef9557 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127001.583478:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127001.583561:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583566:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583570:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583575:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583579:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918aa00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127001.583583:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583588:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583598:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127001.583601:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127001.583604:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583608:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583626:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583630:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583635:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583638:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918a000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127001.583640:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583644:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583649:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094be0400) 00010000:00010000:3.0:1746127001.583651:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127001.583653:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583657:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a000/0x34dc807b6ef9550 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.583688:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a400/0x34dc807b6ef953b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d47 expref: 47 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.583698:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef9557 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d47 expref: 46 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.583703:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.583705:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127001.583707:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b000, rc 0) 00000100:00100000:3.0:1746127001.583733:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4209:x1830945991579904:12345-192.168.203.42@tcp:101:cat.0 Request processed in 545us (1884us total) trans 8589938158 rc 0/0 00000100:00100000:3.0:1746127001.583738:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17228 00000100:00100000:0.0:1746127001.586122:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.586187:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994224384:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.586216:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 16 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.586221:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127001.586233:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fc800, rc 0) 00000100:00100000:0.0:1746127001.586262:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.586270:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cbb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4199:x1830945991579648:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3003us (3763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.586277:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21394 00000100:00100000:1.0:1746127001.586317:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991580160 00000100:00100000:0.0:1746127001.586319:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991580288 00000100:00100000:1.0:1746127001.586322:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991580160 00000100:00100000:0.0:1746127001.586322:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991580288 00000100:00100000:1.0:1746127001.586356:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6553 00002000:00100000:0.0:1746127001.586357:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2781183) req@ffff880095ca9f80 x1830945991580288/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746127001.586362:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4209:x1830945991580160:12345-192.168.203.42@tcp:35:cat.0 00002000:00100000:0.0:1746127001.586370:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9f80 with x1830945991580288 ext(2097152->2781183) 00010000:00010000:0.0:1746127001.586376:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 37 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746127001.586386:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 37 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:0.0:1746127001.586392:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca9f80 00000100:00100000:0.0:1746127001.586413:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1872 00000100:00100000:0.0:1746127001.586417:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991580288:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127001.586463:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991580416 00000100:00100000:3.0:1746127001.586468:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991580416 00000100:00100000:1.0:1746127001.586501:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4209:x1830945991580160:12345-192.168.203.42@tcp:35:cat.0 Request processed in 139us (387us total) trans 8589938159 rc 0/0 00000100:00100000:1.0:1746127001.586507:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6553 00000100:00100000:3.0:1746127001.586514:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1015 00000100:00100000:3.0:1746127001.586520:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991580416:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.586529:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.586549:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b000/0x34dc807b6ef9557 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d47 expref: 47 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.586561:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.586564:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.586585:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991580416:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 66us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.586590:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1015 00000100:00100000:2.0:1746127001.590872:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.590911:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.590924:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.591050:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.592036:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991580800 00000100:00100000:1.0:1746127001.592045:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991580800 00000100:00100000:2.0:1746127001.592080:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.592104:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581056 00000100:00100000:1.0:1746127001.592104:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991580928 00000100:00100000:2.0:1746127001.592107:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581056 00000100:00100000:1.0:1746127001.592107:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991580928 00000100:00100000:1.0:1746127001.592119:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581184 00000100:00100000:1.0:1746127001.592120:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581184 00000100:00100000:2.0:1746127001.592122:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581312 00000100:00100000:2.0:1746127001.592124:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581312 00000100:00100000:2.0:1746127001.592149:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21395 00000100:00100000:1.0:1746127001.592155:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21396 00000100:00100000:2.0:1746127001.592156:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991580800:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127001.592159:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991580928:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.592174:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.592174:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.592191:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5600/0x34dc807b6ef9565 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d55 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.592191:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967fc400/0x34dc807b6ef956c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d5c expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.592238:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994224640:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127001.592238:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994224512:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127001.592369:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21397 00000100:00100000:0.0:1746127001.592377:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991581056:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127001.592384:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127001.592392:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef9573 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d63 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.592414:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cabb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994224768:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127001.592451:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21398 00000100:00100000:3.0:1746127001.592459:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991581184:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.592464:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.592471:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d6a expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.592487:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.592489:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.592497:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.592512:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.592520:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918ba00, rc 0) 00000100:00100000:2.0:1746127001.593035:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.593057:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21399 00000100:00100000:2.0:1746127001.593078:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991581312:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127001.593083:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00010000:00010000:2.0:1746127001.593086:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.593096:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef9581 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d71 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.593122:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994224896:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127001.593163:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.593675:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.594227:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991581184:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1766us (3174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.594235:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21398 00000100:00100000:1.0:1746127001.594768:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.594958:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991580672 00000100:00100000:3.0:1746127001.594967:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991580672 00000100:00100000:3.0:1746127001.595013:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17229 00000100:00100000:3.0:1746127001.595022:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4207:x1830945991580672:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127001.595039:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.595054:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6ef9588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d4e expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.595125:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595153:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595162:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595173:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595179:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595184:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595539:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef959d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595548:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef959d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595554:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef959d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127001.595560:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127001.595601:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595606:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595610:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00002000:00010000:0.0:1746127001.595613:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746126997 -> 1746127000 00010000:00010000:3.0:1746127001.595616:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00002000:00010000:0.0:1746127001.595617:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746126997 -> 1746127000 00002000:00010000:0.0:1746127001.595618:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746126998 -> 1746127000 00010000:00010000:3.0:1746127001.595620:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918ac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127001.595623:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595628:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127001.595630:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994224640:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127001.595636:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127001.595638:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127001.595642:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595646:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ac00/0x34dc807b6ef958f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127001.595651:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5600/0x34dc807b6ef9565 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d55 expref: 30 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.595655:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595659:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595663:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595666:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918aa00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127001.595666:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5600/0x34dc807b6ef9565 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d55 expref: 30 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.595667:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595672:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595676:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094be0500) 00010000:00010000:3.0:1746127001.595678:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127001.595679:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5600, rc 0) 00010000:00010000:3.0:1746127001.595680:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595684:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918aa00/0x34dc807b6ef9596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.595709:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6ef9588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d4e expref: 49 pid: 7258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.595712:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991580800:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3557us (4855us total) trans 0 rc 301/301 00010000:00010000:3.0:1746127001.595719:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef959d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d4e expref: 48 pid: 7258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.595719:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21395 00010000:00010000:3.0:1746127001.595725:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.595727:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127001.595728:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918ae00, rc 0) 00000100:00100000:3.0:1746127001.595967:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4207:x1830945991580672:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 946us (1203us total) trans 8589938160 rc 0/0 00000100:00100000:3.0:1746127001.595973:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17229 00000100:00100000:2.0:1746127001.596095:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994224896:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127001.596123:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef9581 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d71 expref: 44 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.596169:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e5800/0x34dc807b6ef9581 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d71 expref: 44 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.596183:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5800, rc 0) 00002000:00010000:1.0:1746127001.596253:0:16295:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127001.596256:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127001.596259:0:16295:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746126999 -> 1746127000 00000100:00100000:1.0:1746127001.596269:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994224512:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127001.596289:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967fc400/0x34dc807b6ef956c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d5c expref: 43 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.596297:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967fc400/0x34dc807b6ef956c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d5c expref: 43 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.596309:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fc400, rc 0) 00000100:00100000:2.0:1746127001.596570:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991581312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3492us (4490us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127001.596578:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21399 00000100:00100000:1.0:1746127001.596674:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991580928:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4514us (5761us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127001.596680:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21396 00002000:00010000:1.0:1746127001.596738:0:9611:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127001.596741:0:9611:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127001.596743:0:9611:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746126999 -> 1746127000 00000100:00100000:1.0:1746127001.596753:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cabb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994224768:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127001.596772:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef9573 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d63 expref: 28 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.596780:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a45600/0x34dc807b6ef9573 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d63 expref: 28 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.596787:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a45600, rc 0) 00000100:00100000:1.0:1746127001.596817:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991581056:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4442us (5891us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127001.596822:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21397 00000100:00100000:1.0:1746127001.597374:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991580288:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 10880us (11035us total) trans 17179875552 rc 0/0 00000100:00100000:1.0:1746127001.597384:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1872 00002000:00100000:1.0:1746127001.597394:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2781183) req@ffff880095ca9f80 x1830945991580288/t17179875552(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.597402:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9f80 with x1830945991580288 ext(2097152->2781183) 00010000:00010000:1.0:1746127001.597410:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 39 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.597422:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 39 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746127001.597428:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca9f80 00000100:00100000:0.0:1746127001.602289:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.602860:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581440 00000100:00100000:3.0:1746127001.602868:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581440 00000100:00100000:3.0:1746127001.602922:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1016 00000100:00100000:3.0:1746127001.602929:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991581440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.602941:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.602961:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6ef959d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d4e expref: 48 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.602975:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.602979:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.603028:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991581440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.603034:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1016 00000100:00100000:3.0:1746127001.604336:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.604385:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581568 00000100:00100000:0.0:1746127001.604391:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581568 00000100:00100000:3.0:1746127001.604404:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127001.604411:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 39 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746127001.604431:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10008 00000100:00100000:0.0:1746127001.604436:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991581568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.604446:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127001.604460:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 39 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746127001.604470:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 39 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.604472:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581696 00000100:00100000:1.0:1746127001.604476:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581696 00010000:00010000:0.0:1746127001.604486:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4a00/0x34dc807b6ef94fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d01 expref: 39 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746127001.604505:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746127001.604508:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21400 00010000:00010000:0.0:1746127001.604508:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746127001.604514:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4209:x1830945991581696:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127001.604514:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 15 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.604521:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 15 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.604525:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.604536:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d78 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.604548:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 15 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.604554:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 11 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.604557:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994225024:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127001.604560:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.604561:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127001.604564:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 28 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.604580:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 11 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.604589:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 11 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.604597:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225152:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.604609:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.604619:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.607029:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ca9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994225024:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127001.607053:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.607697:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991581568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3257us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.607709:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10008 00000100:00100000:0.0:1746127001.608454:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225152:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127001.609117:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 28 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.609156:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620c00, rc 0) 00000100:00100000:0.0:1746127001.609269:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4209:x1830945991581696:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4754us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127001.609277:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21400 00000100:00100000:0.0:1746127001.611657:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.612725:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581824 00000100:00100000:1.0:1746127001.612733:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581824 00002000:00100000:1.0:1746127001.612774:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (655360->1048575) req@ffff880090550050 x1830945991581824/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.613033:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090550050 with x1830945991581824 ext(655360->1048575) 00010000:00010000:1.0:1746127001.613042:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 12 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.613056:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 12 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746127001.613073:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090550050 00000100:00100000:1.0:1746127001.613276:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1873 00000100:00100000:1.0:1746127001.613284:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991581824:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746127001.613486:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.614033:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991581952 00000100:00100000:0.0:1746127001.614038:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991581952 00000100:00100000:0.0:1746127001.614079:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21401 00000100:00100000:0.0:1746127001.614085:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4207:x1830945991581952:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127001.614094:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127001.614111:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d7f expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.614151:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.614159:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 29 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127001.614164:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127001.614165:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127001.614168:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2899968->3071999] (req 2899968->3071999) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 29 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.614191:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 29 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127001.614200:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 29 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746127001.614210:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225280:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127001.614511:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 13 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.614520:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 13 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746127001.614528:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095caad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225408:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.614549:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.615572:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.615634:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991582336 00000100:00100000:2.0:1746127001.615639:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991582336 00002000:00100000:2.0:1746127001.615664:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880095ca8a80 x1830945991582336/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.615671:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8a80 with x1830945991582336 ext(3145728->4194303) 00010000:00010000:2.0:1746127001.615676:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.615685:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.615690:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8a80 00000100:00100000:2.0:1746127001.615766:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1874 00000100:00100000:2.0:1746127001.615772:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991582336:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127001.618710:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225280:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.619325:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.619387:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.619423:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991582592 00000100:00100000:3.0:1746127001.619430:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991582592 00010000:00010000:3.0:1746127001.619460:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 30 pid: 3148 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.619485:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10009 00000100:00100000:3.0:1746127001.619492:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991582592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.619503:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.619518:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 30 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.619528:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 30 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.619547:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918ba00/0x34dc807b6ef957a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d6a expref: 30 pid: 3148 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.619560:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.619592:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991582592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.619597:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10009 00000100:00100000:3.0:1746127001.619734:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095caad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225408:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.619748:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991582464 00000100:00100000:2.0:1746127001.619752:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991582464 00010000:00010000:3.0:1746127001.619758:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2899968->3071999] (req 2899968->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 28 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.619767:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44c00, rc 0) 00002000:00100000:2.0:1746127001.619775:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012238dc00 x1830945991582464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.619783:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238dc00 with x1830945991582464 ext(2097152->4194303) 00002000:00010000:2.0:1746127001.619786:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238dc00 00000100:00100000:2.0:1746127001.619804:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8533 00000100:00100000:2.0:1746127001.619813:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991582464:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.619908:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4207:x1830945991581952:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5822us (6422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.619917:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21401 00000100:00100000:1.0:1746127001.622007:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991581824:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8714us (10345us total) trans 21474842810 rc 0/0 00000100:00100000:1.0:1746127001.622020:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1873 00002000:00100000:1.0:1746127001.622031:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (655360->1048575) req@ffff880090550050 x1830945991581824/t21474842810(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.622041:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090550050 with x1830945991581824 ext(655360->1048575) 00010000:00010000:1.0:1746127001.622051:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 16 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.622082:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 16 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746127001.622089:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090550050 00000100:00100000:3.0:1746127001.626863:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991582336:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11082us (11284us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127001.626875:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1874 00002000:00100000:3.0:1746127001.626886:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880095ca8a80 x1830945991582336/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.626896:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8a80 with x1830945991582336 ext(3145728->4194303) 00010000:00010000:3.0:1746127001.626904:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.626917:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746127001.626923:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8a80 00000100:00100000:0.0:1746127001.631015:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.631229:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991582720 00000100:00100000:3.0:1746127001.631239:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991582720 00010000:00010000:3.0:1746127001.631275:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 14 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.631310:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10010 00000100:00100000:3.0:1746127001.631317:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991582720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.631330:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.631346:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 14 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.631361:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 14 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.631380:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009915a200/0x34dc807b6ef94e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cec expref: 14 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.631604:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.631606:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.631613:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 27 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.631621:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 27 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.631648:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 27 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.631658:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994225536:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.631900:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.632320:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991582464:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 12506us (12998us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127001.632331:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8533 00002000:00100000:2.0:1746127001.632341:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012238dc00 x1830945991582464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.632350:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238dc00 with x1830945991582464 ext(2097152->4194303) 00002000:00010000:2.0:1746127001.632355:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238dc00 00000100:00100000:0.0:1746127001.633482:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.633527:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991582848 00000100:00100000:2.0:1746127001.633534:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991582848 00010000:00010000:2.0:1746127001.633559:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.633598:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10011 00000100:00100000:2.0:1746127001.633604:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991582848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.633616:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.633632:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.633644:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.633665:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6ef952d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d32 expref: 14 pid: 1964 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.633699:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.633701:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.633707:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 27 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.633716:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 27 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.633742:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 27 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.633753:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994225664:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127001.633816:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.635264:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994225536:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.635307:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.635348:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991582720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4031us (4342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.635359:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10010 00000100:00100000:0.0:1746127001.639531:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.639605:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.639738:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991583104 00000100:00100000:2.0:1746127001.639747:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991583104 00002000:00100000:2.0:1746127001.639790:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880095cab480 x1830945991583104/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.639802:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab480 with x1830945991583104 ext(0->1048575) 00002000:00010000:2.0:1746127001.639808:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab480 00000100:00100000:2.0:1746127001.639831:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8534 00000100:00100000:2.0:1746127001.639838:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991583104:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127001.639961:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.639963:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994225664:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.639983:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.640025:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991582848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6420us (6544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.640034:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10011 00000100:00100000:1.0:1746127001.640045:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991583488 00000100:00100000:1.0:1746127001.640050:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991583488 00000100:00100000:3.0:1746127001.640105:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991583232 00000100:00100000:3.0:1746127001.640108:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991583232 00000100:00100000:3.0:1746127001.640159:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21402 00000100:00100000:3.0:1746127001.640165:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4199:x1830945991583232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.640174:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.640191:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d86 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.640215:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.640221:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127001.640223:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127001.640231:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 13 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.640255:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746127001.640259:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2899968->2904063) req@ffff880095cab800 x1830945991583488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746127001.640266:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00002000:00100000:1.0:1746127001.640267:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab800 with x1830945991583488 ext(2899968->2904063) 00010000:00010000:1.0:1746127001.640273:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.640277:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225792:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.640285:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746127001.640291:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cab800 00000100:00100000:1.0:1746127001.640304:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1875 00000100:00100000:1.0:1746127001.640310:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991583488:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.640317:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.640376:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991583488:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 66us (416us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127001.640382:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1875 00002000:00100000:1.0:1746127001.640386:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2899968->2904063) req@ffff880095cab800 x1830945991583488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.640393:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab800 with x1830945991583488 ext(2899968->2904063) 00010000:00010000:1.0:1746127001.640397:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.640407:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746127001.640412:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cab800 00000100:00100000:3.0:1746127001.641750:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994225792:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.641799:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 13 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.641813:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeac00, rc 0) 00000100:00100000:3.0:1746127001.641847:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4199:x1830945991583232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1683us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.641853:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21402 00000100:00100000:0.0:1746127001.645274:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.645373:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991583744 00000100:00100000:1.0:1746127001.645383:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991583744 00002000:00100000:1.0:1746127001.645424:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3067904->3071999) req@ffff880095ca8000 x1830945991583744/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.645435:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8000 with x1830945991583744 ext(3067904->3071999) 00010000:00010000:1.0:1746127001.645444:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.645459:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746127001.645466:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8000 00000100:00100000:1.0:1746127001.645498:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1876 00000100:00100000:1.0:1746127001.645505:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991583744:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127001.645686:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991583744:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 179us (420us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127001.645693:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1876 00002000:00100000:1.0:1746127001.645698:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3067904->3071999) req@ffff880095ca8000 x1830945991583744/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127001.645706:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8000 with x1830945991583744 ext(3067904->3071999) 00010000:00010000:1.0:1746127001.645710:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746127001.645719:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746127001.645725:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca8000 00000100:00100000:2.0:1746127001.648155:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991583104:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 8283us (8599us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127001.648167:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8534 00002000:00100000:2.0:1746127001.648179:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880095cab480 x1830945991583104/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.648187:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab480 with x1830945991583104 ext(0->1048575) 00002000:00010000:2.0:1746127001.648192:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab480 00000100:00100000:0.0:1746127001.648750:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.648835:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991584256 00000100:00100000:1.0:1746127001.648842:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991584256 00000100:00100000:1.0:1746127001.648874:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6554 00000100:00100000:1.0:1746127001.648880:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4207:x1830945991584256:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127001.649073:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4207:x1830945991584256:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 180us (312us total) trans 8589938161 rc 0/0 00000100:00100000:1.0:1746127001.649079:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6554 00000100:00100000:0.0:1746127001.649824:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.649853:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991584000 00000100:00100000:2.0:1746127001.649857:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991584000 00002000:00100000:2.0:1746127001.649881:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2899968->3071999) req@ffff880095ca9180 x1830945991584000/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.649890:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9180 with x1830945991584000 ext(2899968->3071999) 00010000:00010000:2.0:1746127001.649898:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 28 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.649912:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 28 pid: 9611 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.649918:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca9180 00000100:00100000:2.0:1746127001.649942:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1877 00000100:00100000:2.0:1746127001.649949:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991584000:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127001.653864:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991584000:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3906us (4031us total) trans 21474842811 rc 0/0 00000100:00100000:2.0:1746127001.653876:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1877 00002000:00100000:2.0:1746127001.653888:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2899968->3071999) req@ffff880095ca9180 x1830945991584000/t21474842811(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.653898:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9180 with x1830945991584000 ext(2899968->3071999) 00010000:00010000:2.0:1746127001.653908:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.653924:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.653932:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ca9180 00000100:00100000:0.0:1746127001.658573:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.658703:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.658803:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991584384 00000100:00100000:3.0:1746127001.658810:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991584384 00010000:00010000:3.0:1746127001.658839:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.658865:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10012 00000100:00100000:3.0:1746127001.658872:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991584384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.658884:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.658900:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.658911:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.658929:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a44c00/0x34dc807b6ef95b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2899968->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d7f expref: 30 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.658950:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.658952:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.658958:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 12 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.659183:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991584512 00000100:00100000:2.0:1746127001.659187:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991584512 00000100:00100000:2.0:1746127001.659210:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21403 00000100:00100000:2.0:1746127001.659215:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4209:x1830945991584512:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.659227:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.659242:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d8d expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.659259:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.659264:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.659265:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.659268:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 39 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.659288:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.659297:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 15 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.659311:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994225920:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.659377:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cab40 going to sleep for 11 seconds 00010000:00010000:3.0:1746127001.659657:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 12 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.659678:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 12 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.659687:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994226048:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.659707:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.660971:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994225920:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.660989:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 39 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.661000:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36600, rc 0) 00000100:00100000:2.0:1746127001.661025:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4209:x1830945991584512:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1809us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.661031:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21403 00000100:00100000:0.0:1746127001.663388:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.663407:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991584640 00000100:00100000:2.0:1746127001.663415:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991584640 00002000:00100000:2.0:1746127001.663449:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1114111) req@ffff880095ca8700 x1830945991584640/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.663458:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8700 with x1830945991584640 ext(1048576->1114111) 00010000:00010000:2.0:1746127001.663465:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 16 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.663477:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 16 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.663483:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca8700 00000100:00100000:2.0:1746127001.663510:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1878 00000100:00100000:2.0:1746127001.663516:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991584640:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127001.663769:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994226048:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.663810:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.663833:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991584384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4957us (5264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.663841:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10012 00000100:00100000:1.0:1746127001.666907:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.666969:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991584896 00000100:00100000:2.0:1746127001.666976:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991584896 00002000:00100000:2.0:1746127001.667008:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8801303d0700 x1830945991584896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.667017:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0700 with x1830945991584896 ext(3145728->4194303) 00002000:00010000:2.0:1746127001.667022:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0700 00000100:00100000:2.0:1746127001.667037:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8535 00000100:00100000:2.0:1746127001.667042:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991584896:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.667306:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991584640:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3789us (3922us total) trans 17179875553 rc 0/0 00000100:00100000:3.0:1746127001.667313:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1878 00002000:00100000:3.0:1746127001.667318:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1114111) req@ffff880095ca8700 x1830945991584640/t17179875553(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.667325:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8700 with x1830945991584640 ext(1048576->1114111) 00010000:00010000:3.0:1746127001.667332:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 18 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.667344:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 18 pid: 1507 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746127001.667350:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca8700 00000100:00100000:0.0:1746127001.671480:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.671665:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991585024 00000100:00100000:3.0:1746127001.671673:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991585024 00010000:00010000:3.0:1746127001.671700:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 18 pid: 1507 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.671737:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10013 00000100:00100000:3.0:1746127001.671744:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991585024:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.671755:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.671770:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 18 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.671779:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 18 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.671798:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967fdc00/0x34dc807b6ef94ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cf3 expref: 18 pid: 1507 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.672217:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.672219:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.672227:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 38 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.672239:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 38 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.672269:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 38 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.672280:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994226176:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.672813:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.676961:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994226176:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.677004:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.677045:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991585024:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5300us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.677054:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10013 00000100:00100000:3.0:1746127001.677569:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991584896:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 10526us (10898us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127001.677577:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8535 00002000:00100000:3.0:1746127001.677586:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8801303d0700 x1830945991584896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.677593:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0700 with x1830945991584896 ext(3145728->4194303) 00002000:00010000:3.0:1746127001.677598:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0700 00000100:00100000:0.0:1746127001.678761:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.678873:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991585280 00000100:00100000:3.0:1746127001.678879:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991585280 00002000:00100000:3.0:1746127001.678909:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880095caad80 x1830945991585280/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.678921:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caad80 with x1830945991585280 ext(1048576->2097151) 00002000:00010000:3.0:1746127001.678925:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caad80 00000100:00100000:3.0:1746127001.678939:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8536 00000100:00100000:3.0:1746127001.678945:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991585280:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127001.682811:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.683634:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.683702:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991585408 00000100:00100000:2.0:1746127001.683709:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991585408 00000100:00100000:2.0:1746127001.683740:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991585536 00000100:00100000:2.0:1746127001.683743:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991585536 00000100:00100000:2.0:1746127001.683764:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21404 00000100:00100000:2.0:1746127001.683771:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991585408:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.683785:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.683798:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d94 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.683815:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.683821:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.683828:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.683840:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.683850:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36400, rc 0) 00000100:00100000:2.0:1746127001.683899:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991585408:12345-192.168.203.42@tcp:101:cat.0 Request processed in 129us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.683904:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21404 00000100:00100000:2.0:1746127001.683915:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21405 00000100:00100000:2.0:1746127001.683919:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991585536:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.683925:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.683933:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52d9b expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.683943:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.683944:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.683947:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.683955:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.683960:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36000, rc 0) 00000100:00100000:2.0:1746127001.683974:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991585536:12345-192.168.203.42@tcp:101:cat.0 Request processed in 54us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.683979:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21405 00000100:00100000:3.0:1746127001.690923:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991585280:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11965us (12153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127001.690938:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8536 00002000:00100000:3.0:1746127001.690949:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880095caad80 x1830945991585280/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.690960:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caad80 with x1830945991585280 ext(1048576->2097151) 00002000:00010000:3.0:1746127001.690966:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caad80 00000100:00100000:0.0:1746127001.694868:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.695192:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991585792 00000100:00100000:3.0:1746127001.695201:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991585792 00002000:00100000:3.0:1746127001.695250:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880095cabb80 x1830945991585792/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.695260:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cabb80 with x1830945991585792 ext(4194304->4829183) 00002000:00010000:3.0:1746127001.695265:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cabb80 00000100:00100000:3.0:1746127001.695285:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8537 00000100:00100000:3.0:1746127001.695549:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991585792:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127001.702251:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.702432:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991585920 00000100:00100000:2.0:1746127001.702443:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991585920 00000100:00100000:2.0:1746127001.702500:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21406 00000100:00100000:2.0:1746127001.702509:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4209:x1830945991585920:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.702524:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.702540:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52da2 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.702566:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 15 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.702572:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.702574:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.702577:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 30 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.702601:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 15 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.702610:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 15 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.702620:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994226304:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.702706:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.705778:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991585792:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10476us (10910us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127001.705791:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8537 00002000:00100000:3.0:1746127001.705803:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880095cabb80 x1830945991585792/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.705812:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cabb80 with x1830945991585792 ext(4194304->4829183) 00002000:00010000:3.0:1746127001.705817:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cabb80 00000100:00100000:2.0:1746127001.706566:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.706595:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991586048 00000100:00100000:2.0:1746127001.706601:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991586048 00002000:00100000:2.0:1746127001.706634:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1183744->1490943) req@ffff880122385c00 x1830945991586048/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.706643:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385c00 with x1830945991586048 ext(1183744->1490943) 00010000:00010000:2.0:1746127001.706651:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 14 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.706663:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 14 pid: 12333 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.706669:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122385c00 00000100:00100000:2.0:1746127001.706696:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1879 00000100:00100000:2.0:1746127001.706702:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991586048:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127001.706973:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994226304:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.706997:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 30 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.707010:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c37600, rc 0) 00000100:00100000:3.0:1746127001.707033:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4209:x1830945991585920:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4527us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.707039:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21406 00000100:00100000:2.0:1746127001.713896:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.714388:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991586176 00000100:00100000:3.0:1746127001.714397:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991586176 00000100:00100000:3.0:1746127001.714445:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21407 00000100:00100000:3.0:1746127001.714453:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991586176:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.714472:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.714489:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef95dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52da9 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.714541:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994226432:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127001.714625:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.716508:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991586048:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9797us (9940us total) trans 21474842812 rc 0/0 00000100:00100000:2.0:1746127001.716520:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1879 00002000:00100000:2.0:1746127001.716531:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1183744->1490943) req@ffff880122385c00 x1830945991586048/t21474842812(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.716540:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385c00 with x1830945991586048 ext(1183744->1490943) 00010000:00010000:2.0:1746127001.716549:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 18 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.716563:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 18 pid: 12333 timeout: 996 lvb_type: 0 00002000:00010000:2.0:1746127001.716569:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122385c00 00000100:00100000:3.0:1746127001.718587:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994226432:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127001.718647:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef95dc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da9 expref: 17 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.718665:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef95dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da9 expref: 17 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.718709:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb800, rc 0) 00000100:00100000:3.0:1746127001.718775:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991586176:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4321us (4887us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127001.718784:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21407 00000100:00100000:0.0:1746127001.719738:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.719804:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991586304 00000100:00100000:3.0:1746127001.719810:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991586304 00010000:00010000:3.0:1746127001.719839:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 16 pid: 12333 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.719875:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10014 00000100:00100000:3.0:1746127001.719881:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991586304:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.719894:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.719904:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 16 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.719913:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 16 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.719934:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967fd200/0x34dc807b6ef9534 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1490943) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d39 expref: 16 pid: 12333 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.719946:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.719949:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.719956:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.719963:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.719994:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.720005:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994226560:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.720099:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.721179:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.721241:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991586432 00000100:00100000:3.0:1746127001.721247:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991586432 00000100:00100000:3.0:1746127001.721563:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21408 00000100:00100000:3.0:1746127001.721570:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991586432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.721587:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.721600:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52db0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.721616:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.721618:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.721624:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 17 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.721636:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 17 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.721649:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeaa00, rc 0) 00000100:00100000:3.0:1746127001.721699:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991586432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 128us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.721704:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21408 00000100:00100000:3.0:1746127001.722380:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994226560:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127001.722413:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.722446:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991586304:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2565us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.722454:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10014 00000100:00100000:0.0:1746127001.724169:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.724249:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991586688 00000100:00100000:3.0:1746127001.724257:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991586688 00002000:00100000:3.0:1746127001.724297:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007ede1500 x1830945991586688/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.724306:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede1500 with x1830945991586688 ext(1048576->2097151) 00002000:00010000:3.0:1746127001.724311:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede1500 00000100:00100000:0.0:1746127001.724534:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8538 00000100:00100000:0.0:1746127001.724543:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991586688:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127001.735675:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991586688:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11116us (11527us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127001.735687:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8538 00002000:00100000:2.0:1746127001.735703:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007ede1500 x1830945991586688/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.735714:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede1500 with x1830945991586688 ext(1048576->2097151) 00002000:00010000:2.0:1746127001.735721:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede1500 00000100:00100000:1.0:1746127001.746273:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.746386:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.746723:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991586816 00000100:00100000:3.0:1746127001.746732:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991586816 00000100:00100000:3.0:1746127001.746782:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991586944 00000100:00100000:3.0:1746127001.746784:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991586944 00000100:00100000:3.0:1746127001.746802:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21409 00000100:00100000:3.0:1746127001.746810:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991586816:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127001.746828:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.746846:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52db7 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.746873:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.746875:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.746883:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 31 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.746899:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 31 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.746910:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb400, rc 0) 00000100:00100000:3.0:1746127001.746967:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991586816:12345-192.168.203.42@tcp:101:cat.0 Request processed in 154us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.746973:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21409 00000100:00100000:2.0:1746127001.746986:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21410 00000100:00100000:2.0:1746127001.746993:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991586944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127001.747001:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.747024:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52dbe expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.747035:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.747037:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.747041:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 40 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.747051:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 40 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.747067:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35ca00, rc 0) 00000100:00100000:2.0:1746127001.747086:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991586944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 94us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.747091:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21410 00000100:00100000:0.0:1746127001.758896:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.758954:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.759050:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991587200 00000100:00100000:2.0:1746127001.759058:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991587200 00002000:00100000:2.0:1746127001.759106:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ede2680 x1830945991587200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.759115:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2680 with x1830945991587200 ext(2097152->4194303) 00002000:00010000:2.0:1746127001.759120:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede2680 00000100:00100000:2.0:1746127001.759156:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991587456 00000100:00100000:2.0:1746127001.759159:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991587456 00002000:00100000:2.0:1746127001.759171:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007ede0380 x1830945991587456/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.759177:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede0380 with x1830945991587456 ext(2097152->4194303) 00002000:00010000:2.0:1746127001.759179:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede0380 00000100:00100000:2.0:1746127001.759191:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8539 00000100:00100000:2.0:1746127001.759196:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991587200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127001.759411:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8540 00000100:00100000:3.0:1746127001.759418:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991587456:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127001.771652:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991587200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12445us (12753us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127001.771664:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8539 00002000:00100000:2.0:1746127001.771676:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ede2680 x1830945991587200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.771685:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2680 with x1830945991587200 ext(2097152->4194303) 00002000:00010000:2.0:1746127001.771691:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede2680 00000100:00100000:3.0:1746127001.775665:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991587456:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16235us (16698us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127001.775678:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8540 00002000:00100000:3.0:1746127001.775689:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007ede0380 x1830945991587456/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.775699:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede0380 with x1830945991587456 ext(2097152->4194303) 00002000:00010000:3.0:1746127001.775704:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede0380 00000100:00100000:0.0:1746127001.780681:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.780821:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991587712 00000100:00100000:3.0:1746127001.780830:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991587712 00000100:00100000:3.0:1746127001.780887:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17230 00000100:00100000:3.0:1746127001.780896:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4213:x1830945991587712:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127001.780920:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.780939:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6ef95f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52dc5 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.781010:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781023:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781034:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781046:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781051:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781056:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781195:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef960d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781205:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef960d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781212:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef960d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127001.781220:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127001.781290:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781297:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781302:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781308:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781314:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caea400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127001.781318:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781324:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781335:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127001.781338:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127001.781343:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781347:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea400/0x34dc807b6ef95ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781399:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781404:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781409:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781413:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caebe00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127001.781416:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781421:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781428:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094be0500) 00010000:00010000:3.0:1746127001.781430:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127001.781432:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781437:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebe00/0x34dc807b6ef9606 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.781499:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6ef95f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dc5 expref: 51 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.781514:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef960d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dc5 expref: 50 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.781520:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.781522:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127001.781525:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb800, rc 0) 00000100:00100000:3.0:1746127001.782428:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4213:x1830945991587712:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1529us (1753us total) trans 8589938162 rc 0/0 00000100:00100000:3.0:1746127001.782436:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17230 00000100:00100000:0.0:1746127001.784300:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.784403:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991587840 00000100:00100000:3.0:1746127001.784410:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991587840 00000100:00100000:3.0:1746127001.784458:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1017 00000100:00100000:3.0:1746127001.784465:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991587840:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.784480:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.784877:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6ef960d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dc5 expref: 50 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.784913:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.784917:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.784955:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2027:x1830945991587840:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 490us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.784961:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1017 00000100:00100000:0.0:1746127001.795636:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.795826:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991588096 00000100:00100000:3.0:1746127001.795836:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991588096 00002000:00100000:3.0:1746127001.795889:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ede2d80 x1830945991588096/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.795899:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2d80 with x1830945991588096 ext(4194304->4829183) 00002000:00010000:3.0:1746127001.795904:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede2d80 00000100:00100000:3.0:1746127001.795979:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8541 00000100:00100000:3.0:1746127001.795986:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991588096:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127001.827733:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991588096:12345-192.168.203.42@tcp:3:cat.0 Request processed in 31733us (32095us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127001.827747:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8541 00002000:00100000:3.0:1746127001.827758:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ede2d80 x1830945991588096/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/440 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.827767:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2d80 with x1830945991588096 ext(4194304->4829183) 00002000:00010000:3.0:1746127001.827773:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede2d80 00000100:00100000:0.0:1746127001.860586:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.860714:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991588224 00000100:00100000:1.0:1746127001.860724:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991588224 00000100:00100000:1.0:1746127001.860788:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21411 00000100:00100000:1.0:1746127001.860796:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4215:x1830945991588224:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127001.860825:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127001.860848:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52dcc expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.860878:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 39 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.860887:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 19 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.860897:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.860899:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.860902:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1327104->1839103] (req 1327104->1839103) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.860935:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 19 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.860947:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 19 pid: 16295 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.860959:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994226688:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.861055:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 39 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.861074:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 39 pid: 9611 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746127001.861085:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994226816:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.861103:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.861482:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.861809:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991588352 00000100:00100000:3.0:1746127001.861815:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991588352 00000100:00100000:3.0:1746127001.861852:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21412 00000100:00100000:3.0:1746127001.861858:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4213:x1830945991588352:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127001.861867:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.861879:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52dd3 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.861896:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 32 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.861904:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 15 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.861909:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.861910:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.861913:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1191936->1945599] (req 1191936->1945599) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 32 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.861930:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 15 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.861938:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 15 pid: 9612 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746127001.861947:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994226944:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.861996:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 32 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.862009:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 32 pid: 9612 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.862017:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994227072:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.862040:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127001.864403:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994226688:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.864416:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994226816:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127001.864448:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1327104->1839103] (req 1327104->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.864448:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127001.864468:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e8200, rc 0) 00000100:00100000:1.0:1746127001.864523:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4215:x1830945991588224:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3727us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.864531:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21411 00000100:00100000:0.0:1746127001.865502:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.865820:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991588480 00000100:00100000:1.0:1746127001.865832:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991588480 00000100:00100000:3.0:1746127001.865872:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991588608 00000100:00100000:3.0:1746127001.865876:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991588608 00010000:00010000:3.0:1746127001.865911:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 40 pid: 9611 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.865945:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10015 00000100:00100000:3.0:1746127001.865952:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991588608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.865966:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.865984:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 40 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.865995:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 40 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.866019:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef95c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d8d expref: 40 pid: 9611 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.866037:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.866081:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991588608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 129us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.866091:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10015 00010000:00010000:1.0:1746127001.866168:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 19 pid: 16295 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746127001.866183:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10016 00000100:00100000:1.0:1746127001.866188:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991588480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127001.866194:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127001.866202:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 19 pid: 16295 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746127001.866217:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 19 pid: 16295 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746127001.866230:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c36000/0x34dc807b6ef95ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d9b expref: 19 pid: 16295 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746127001.866248:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.866250:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.866256:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.866264:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.866292:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127001.866304:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994227200:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127001.866356:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.866827:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994226944:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.866836:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994227072:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127001.866890:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1191936->1945599] (req 1191936->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 32 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.867054:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb800, rc 0) 00000100:00100000:0.0:1746127001.867274:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4213:x1830945991588352:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5416us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127001.867281:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21412 00000100:00100000:0.0:1746127001.867621:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.867668:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.867799:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991588736 00000100:00100000:2.0:1746127001.867804:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991588736 00010000:00010000:2.0:1746127001.867879:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 16 pid: 9612 timeout: 996 lvb_type: 1 00000100:00100000:2.0:1746127001.867903:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991588864 00000100:00100000:2.0:1746127001.867906:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991588864 00010000:00010000:2.0:1746127001.867915:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 32 pid: 9612 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.867929:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10017 00000100:00100000:2.0:1746127001.867934:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991588736:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.867946:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127001.867949:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10018 00000100:00100000:3.0:1746127001.867958:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991588864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.867962:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 16 pid: 9612 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.867966:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.867971:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 16 pid: 9612 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.867984:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 32 pid: 9612 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.867994:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef95e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db0 expref: 16 pid: 9612 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746127001.867996:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 32 pid: 9612 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746127001.868012:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef95d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52da2 expref: 32 pid: 9612 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.868013:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.868015:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.868020:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.868031:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.868039:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127001.868053:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.868072:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991588864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 115us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.868077:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994227328:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127001.868079:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10018 00000100:00100000:2.0:1746127001.868122:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.870410:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127001.870522:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994227200:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127001.870546:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127001.870596:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991588480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4406us (6149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.870606:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10016 00000100:00100000:3.0:1746127001.871408:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991589120 00000100:00100000:3.0:1746127001.871416:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991589120 00002000:00100000:3.0:1746127001.871460:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1191936->1196031) req@ffff88007ede0e00 x1830945991589120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.871469:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede0e00 with x1830945991589120 ext(1191936->1196031) 00002000:00010000:3.0:1746127001.871474:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede0e00 00000100:00100000:3.0:1746127001.871507:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8542 00000100:00100000:3.0:1746127001.871515:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991589120:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.871640:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991589120:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 126us (1238us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.871645:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8542 00002000:00100000:3.0:1746127001.871650:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1191936->1196031) req@ffff88007ede0e00 x1830945991589120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.871657:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede0e00 with x1830945991589120 ext(1191936->1196031) 00002000:00010000:3.0:1746127001.871659:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede0e00 00000100:00100000:2.0:1746127001.872684:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994227328:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127001.872700:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.872722:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991588736:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4788us (5102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.872731:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10017 00000100:00100000:0.0:1746127001.874744:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.876616:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991589376 00000100:00100000:2.0:1746127001.876629:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991589376 00002000:00100000:2.0:1746127001.876678:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1835008->1839103) req@ffff88007ede2a00 x1830945991589376/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.876688:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2a00 with x1830945991589376 ext(1835008->1839103) 00002000:00010000:2.0:1746127001.876695:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede2a00 00000100:00100000:2.0:1746127001.876733:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8543 00000100:00100000:2.0:1746127001.876741:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991589376:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127001.876905:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991589376:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 164us (2165us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127001.876912:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8543 00002000:00100000:2.0:1746127001.876917:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1835008->1839103) req@ffff88007ede2a00 x1830945991589376/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.876924:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2a00 with x1830945991589376 ext(1835008->1839103) 00002000:00010000:2.0:1746127001.876927:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede2a00 00010000:00010000:2.0:1746127001.882279:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127001.889421:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.889617:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991589632 00000100:00100000:3.0:1746127001.889626:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991589632 00002000:00100000:3.0:1746127001.889676:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1941504->1945599) req@ffff88007ede3800 x1830945991589632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.889686:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3800 with x1830945991589632 ext(1941504->1945599) 00002000:00010000:3.0:1746127001.889691:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede3800 00000100:00100000:3.0:1746127001.889726:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8544 00000100:00100000:3.0:1746127001.889733:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991589632:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127001.889883:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991589632:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 150us (471us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127001.889889:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8544 00002000:00100000:3.0:1746127001.889895:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1941504->1945599) req@ffff88007ede3800 x1830945991589632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/4536 e 0 to 0 dl 1746127012 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.889902:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3800 with x1830945991589632 ext(1941504->1945599) 00002000:00010000:3.0:1746127001.889905:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede3800 00000100:00100000:0.0:1746127001.903511:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.903618:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991589888 00000100:00100000:2.0:1746127001.903628:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991589888 00000100:00100000:2.0:1746127001.903687:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6555 00000100:00100000:2.0:1746127001.903694:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:4213:x1830945991589888:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127001.905446:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4213:x1830945991589888:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 1746us (1940us total) trans 8589938163 rc 0/0 00000100:00100000:2.0:1746127001.905457:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6555 00000100:00100000:0.0:1746127001.921695:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.922183:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991590016 00000100:00100000:3.0:1746127001.922194:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991590016 00000100:00080000:0.0:1746127001.922313:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746127001.922346:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17231 00000100:00100000:3.0:1746127001.922354:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:4219:x1830945991590016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127001.922382:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.922401:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a200/0x34dc807b6ef9629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52dda expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.922465:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922476:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922488:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922500:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922504:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922509:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922578:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922588:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 21 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.922594:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.922628:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 21 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.922639:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 21 pid: 7258 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.922651:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994227456:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.925174:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.926622:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.926716:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994227456:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.926739:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127001.926812:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991590272 00000100:00100000:1.0:1746127001.926819:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991590272 00000100:00100000:1.0:1746127001.926876:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6556 00000100:00100000:1.0:1746127001.926884:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:32472:x1830945991590272:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746127001.927692:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:32472:x1830945991590272:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 807us (1075us total) trans 8589938164 rc 0/0 00000100:00100000:1.0:1746127001.927699:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6556 00000100:00100000:0.0:1746127001.929187:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.929332:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991590400 00000100:00100000:2.0:1746127001.929339:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991590400 00010000:00010000:2.0:1746127001.929370:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 23 pid: 7258 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.929405:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10019 00000100:00100000:2.0:1746127001.929412:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991590400:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.929423:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.929429:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 23 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.929438:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 23 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.929460:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6ef943f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52c83 expref: 23 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.929489:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127001.929494:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.929503:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.929510:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.930161:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.930204:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991590400:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 792us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.930215:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10019 00010000:00010000:3.0:1746127001.930370:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930377:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127001.930421:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127001.930424:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127001.930437:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930446:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930456:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930461:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930470:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930476:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930481:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009914ba00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127001.930484:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930489:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930496:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127001.930498:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127001.930501:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930505:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930528:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930532:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930537:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930541:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009914a600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127001.930543:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930551:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930557:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094be0b00) 00010000:00010000:3.0:1746127001.930559:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127001.930560:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930564:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.930596:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a200/0x34dc807b6ef9629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 18 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.930607:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 17 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.930613:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.930615:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127001.930617:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914a000, rc 0) 00000100:00100000:3.0:1746127001.930642:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:4219:x1830945991590016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 8289us (8957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.930648:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17231 00000100:00100000:0.0:1746127001.934389:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.935548:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991590528 00000100:00100000:2.0:1746127001.935559:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991590528 00000100:00100000:2.0:1746127001.935619:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21413 00000100:00100000:2.0:1746127001.935627:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991590528:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127001.935647:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.935669:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52de1 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.935692:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.935694:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.935703:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.935718:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.935729:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8600, rc 0) 00000100:00100000:2.0:1746127001.935785:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991590528:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 158us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.935790:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21413 00000100:00100000:0.0:1746127001.936967:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.937795:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.937817:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.937839:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991590656 00000100:00100000:0.0:1746127001.937844:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991590656 00000100:00100000:0.0:1746127001.937871:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991590912 00000100:00100000:0.0:1746127001.937873:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991590912 00000100:00100000:0.0:1746127001.937881:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991590784 00000100:00100000:0.0:1746127001.937883:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991590784 00000100:00100000:0.0:1746127001.937893:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21414 00000100:00100000:0.0:1746127001.937899:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991590656:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127001.937915:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127001.937929:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef964c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52de8 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.937973:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994227584:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127001.938045:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.938083:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.938146:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.938172:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991591040 00000100:00100000:0.0:1746127001.938174:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991591040 00000100:00100000:0.0:1746127001.939774:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991591168 00000100:00100000:0.0:1746127001.939780:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991591168 00000100:00100000:2.0:1746127001.939908:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21415 00000100:00100000:2.0:1746127001.939921:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991590912:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:1.0:1746127001.939934:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21416 00010000:00010000:2.0:1746127001.939936:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127001.939941:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991590784:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127001.939948:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.939951:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef9653 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52df6 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.939956:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52def expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.939973:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.939975:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.939983:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127001.939993:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994227712:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127001.939997:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.940006:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9e00, rc 0) 00000100:00100000:2.0:1746127001.940048:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.940057:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21417 00000100:00100000:3.0:1746127001.940074:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991591040:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127001.940081:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.940088:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52dfd expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.940101:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.940102:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.940107:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.940116:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.940122:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914ac00, rc 0) 00000100:00100000:1.0:1746127001.940178:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991590784:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 237us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.940185:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21416 00000100:00100000:0.0:1746127001.940199:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21418 00000100:00100000:0.0:1746127001.940204:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991591168:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127001.940211:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127001.940217:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e04 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.940227:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127001.940228:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127001.940233:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127001.940241:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127001.940248:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c37600, rc 0) 00000100:00100000:0.0:1746127001.940265:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991591168:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 61us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.940269:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991591040:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 196us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127001.940270:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21418 00000100:00100000:3.0:1746127001.940274:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21417 00000100:00100000:2.0:1746127001.943676:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994227584:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127001.943712:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef964c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de8 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.943725:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6ef964c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de8 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.943750:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7600, rc 0) 00000100:00100000:2.0:1746127001.944009:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991590656:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6107us (7042us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127001.944017:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21414 00000100:00100000:3.0:1746127001.944039:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994227712:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127001.944091:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef9653 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52df6 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.944100:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8000/0x34dc807b6ef9653 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52df6 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.944120:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8000, rc 0) 00000100:00100000:3.0:1746127001.944158:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991590912:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4238us (6363us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127001.944163:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21415 00000100:00100000:0.0:1746127001.950889:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.951222:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991591424 00000100:00100000:3.0:1746127001.951232:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991591424 00000100:00100000:3.0:1746127001.951297:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17232 00000100:00100000:3.0:1746127001.951305:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:4219:x1830945991591424:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127001.951328:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.951347:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a400/0x34dc807b6ef966f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e0b expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.951449:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.951464:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 18 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.951471:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.951502:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 18 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.951513:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 18 pid: 7258 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746127001.951525:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994227840:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.951615:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.954300:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994227840:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.954312:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127001.954327:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:2.0:1746127001.954388:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991591552 00000100:00100000:2.0:1746127001.954394:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991591552 00010000:00010000:2.0:1746127001.954425:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 19 pid: 7258 timeout: 996 lvb_type: 0 00000100:00100000:2.0:1746127001.954946:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10020 00000100:00100000:2.0:1746127001.954954:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2027:x1830945991591552:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.954968:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.954973:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 19 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.954982:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 19 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.955003:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a000/0x34dc807b6ef963e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dda expref: 19 pid: 7258 timeout: 996 lvb_type: 0 00010000:00010000:2.0:1746127001.955028:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127001.955032:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.955041:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.955047:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127001.955078:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.955115:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991591552:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 162us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.955120:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10020 00010000:00010000:3.0:1746127001.955282:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.955294:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127001.955311:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127001.955420:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a400/0x34dc807b6ef966f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e0b expref: 19 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.955439:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e0b expref: 18 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.955444:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.955446:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127001.955447:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914b200, rc 0) 00000100:00100000:3.0:1746127001.955470:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4219:x1830945991591424:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4167us (4594us total) trans 8589938165 rc 0/0 00000100:00100000:3.0:1746127001.955475:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17232 00000100:00100000:0.0:1746127001.958242:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.958295:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.958330:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991591808 00000100:00100000:2.0:1746127001.958338:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991591808 00000100:00100000:3.0:1746127001.958347:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991591680 00000100:00100000:3.0:1746127001.958352:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991591680 00000100:00100000:3.0:1746127001.958655:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21419 00000100:00100000:3.0:1746127001.958663:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991591680:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:2.0:1746127001.958667:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21420 00000100:00100000:2.0:1746127001.958675:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991591808:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127001.958684:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.958707:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6ef9684 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e12 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.958759:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994227968:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127001.958784:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127001.958796:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef968b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e19 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.958832:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127001.959077:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994228096:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127001.959263:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.959983:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994227968:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127001.960005:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6ef9684 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e12 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.960017:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6ef9684 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e12 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.960026:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914a200, rc 0) 00000100:00100000:3.0:1746127001.960072:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991591680:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1409us (1774us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127001.960079:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21419 00000100:00100000:2.0:1746127001.960618:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994228096:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127001.960637:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef968b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e19 expref: 11 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.960646:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7400/0x34dc807b6ef968b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e19 expref: 11 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.960653:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7400, rc 0) 00000100:00100000:2.0:1746127001.960687:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991591808:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2012us (2453us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127001.960692:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21420 00000100:00100000:0.0:1746127001.963884:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.963994:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592064 00000100:00100000:3.0:1746127001.964004:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592064 00000100:00100000:3.0:1746127001.964078:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17233 00000100:00100000:3.0:1746127001.964087:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4219:x1830945991592064:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127001.964116:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127001.964120:0:7258:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746127001.964235:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914b200/0x34dc807b6ef9676 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e0b expref: 18 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.964253:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.964257:0:7258:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127001.964423:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9692 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e20 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.964525:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9699 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.964539:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9699 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.964550:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9699 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127001.964561:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127001.964659:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914a600/0x34dc807b6ef9692 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e20 expref: 20 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.964672:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9699 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e20 expref: 19 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.964678:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.964680:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127001.964682:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914ba00, rc 0) 00000100:00100000:3.0:1746127001.964915:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:4219:x1830945991592064:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 829us (1039us total) trans 8589938166 rc 0/0 00000100:00100000:3.0:1746127001.964922:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17233 00000100:00100000:0.0:1746127001.968559:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.968596:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.968631:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.968636:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592320 00000100:00100000:2.0:1746127001.968647:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592320 00000100:00100000:0.0:1746127001.968664:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.968684:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592576 00000100:00100000:2.0:1746127001.968687:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592576 00000100:00100000:0.0:1746127001.968689:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592832 00000100:00100000:0.0:1746127001.968695:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592832 00000100:00100000:2.0:1746127001.968706:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21421 00000100:00100000:2.0:1746127001.968713:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991592320:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:0.0:1746127001.968726:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592192 00000100:00100000:0.0:1746127001.968729:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592192 00000100:00100000:0.0:1746127001.968747:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21422 00010000:00010000:2.0:1746127001.968749:0:9611:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.968753:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991592576:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127001.968766:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.968773:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.968774:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.968777:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.968788:0:12340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.968804:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 30 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.968805:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.968816:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127001.968817:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 17 pid: 11152 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127001.968817:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127001.968820:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.968828:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994228224:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127001.968845:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 30 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.968858:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 30 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127001.968873:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994228352:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.968920:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21423 00000100:00100000:3.0:1746127001.968929:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991592832:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:1.0:1746127001.968942:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21424 00000100:00100000:1.0:1746127001.968950:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991592192:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:3.0:1746127001.968953:0:16295:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.968965:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 17 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.968969:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.968972:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 14 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.968979:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 30 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.968983:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 38 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.968985:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.968988:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.968989:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.968991:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.968991:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.968995:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.968996:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.968998:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.969007:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 38 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127001.969012:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.969014:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 38 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127001.969019:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 14 pid: 16295 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127001.969022:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994228480:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.969026:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994228608:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.969339:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.969347:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00010000:00010000:3.0:1746127001.969358:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 14 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.969366:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 14 pid: 12333 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127001.969374:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994228736:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.969401:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 17 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.969403:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127001.969414:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 17 pid: 12333 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127001.969414:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127001.969422:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994228864:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.969424:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592448 00010000:00010000:1.0:1746127001.969426:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 11 pid: 16295 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127001.969427:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592448 00000100:00100000:1.0:1746127001.969434:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994228992:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.969439:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127001.969441:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.969454:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592704 00000100:00100000:2.0:1746127001.969456:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592704 00010000:00010000:1.0:1746127001.969456:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 30 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.969459:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21425 00010000:00010000:1.0:1746127001.969463:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 30 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127001.969465:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991592448:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:1.0:1746127001.969470:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994229120:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.969474:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21426 00010000:00010000:3.0:1746127001.969479:0:12333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.969480:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991592704:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:1.0:1746127001.969484:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746127001.969487:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 38 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.969492:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.969498:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 17 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.969499:0:9613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.969504:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.969505:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.969506:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.969525:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 17 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.969533:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 17 pid: 1507 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127001.969541:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994229248:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.969562:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127001.969569:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 15 pid: 11152 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127001.969577:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994229376:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.969594:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 38 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.969601:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 38 pid: 1507 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127001.969609:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994229504:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.969620:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d240 going to sleep for 11 seconds 00010000:00010000:2.0:1746127001.969645:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 14 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.969653:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.969659:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 30 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.969664:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.969666:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.969668:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.969688:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 30 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.969697:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 30 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127001.969705:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994229632:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.969732:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127001.969740:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127001.969748:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994229760:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.969826:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 14 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.969833:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 14 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.969841:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994229888:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.969853:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127001.971178:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994228480:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.971224:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994228224:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.971247:0:9611:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.971386:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994228736:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.972264:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994229248:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.972276:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994229376:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.972282:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994229504:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127001.972301:0:12333:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.972303:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.972319:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994228864:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.972324:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127001.972334:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.972351:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994229632:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.972352:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.972360:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994228352:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.972361:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994229760:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.972369:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994229888:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127001.972380:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593344 00010000:00010000:2.0:1746127001.972386:0:9613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.972386:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593344 00010000:00010000:3.0:1746127001.972388:0:12340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.972401:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593216 00000100:00100000:3.0:1746127001.972404:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593216 00010000:00010000:0.0:1746127001.972416:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 15 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127001.972418:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127001.972421:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994228608:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.972433:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994228992:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127001.972439:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994229120:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127001.972440:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10021 00000100:00100000:3.0:1746127001.972446:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991593216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.972456:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127001.972456:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10022 00010000:00010000:1.0:1746127001.972458:0:9612:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.972462:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991593344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.972471:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.972475:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127001.972485:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127001.972485:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 15 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127001.972494:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 15 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127001.972507:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9668 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e04 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127001.972508:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef95c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d94 expref: 15 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127001.972521:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127001.972521:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.972551:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991593216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127001.972552:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991593344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.972558:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10021 00000100:00100000:0.0:1746127001.972561:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10022 00000100:00100000:3.0:1746127001.972577:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991592960 00000100:00100000:3.0:1746127001.972580:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991592960 00002000:00100000:3.0:1746127001.972604:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1191936->1945599) req@ffff880095c06300 x1830945991592960/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.972614:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06300 with x1830945991592960 ext(1191936->1945599) 00010000:00010000:3.0:1746127001.972619:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127001.972629:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746127001.972634:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c06300 00000100:00100000:3.0:1746127001.972644:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1880 00000100:00100000:3.0:1746127001.972648:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991592960:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127001.980085:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.980154:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.980177:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991594112 00000100:00100000:0.0:1746127001.980185:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991594112 00010000:00010000:0.0:1746127001.980222:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 18 pid: 12333 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127001.980262:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991594496 00000100:00100000:0.0:1746127001.980265:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991594496 00010000:00010000:0.0:1746127001.980276:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 14 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127001.980293:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10023 00000100:00100000:0.0:1746127001.980299:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991594112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.980311:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127001.980330:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 18 pid: 12333 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127001.980342:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 18 pid: 12333 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127001.980366:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967fc800/0x34dc807b6ef9542 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d40 expref: 18 pid: 12333 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.980371:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10024 00000100:00100000:2.0:1746127001.980381:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991594496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.980384:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127001.980391:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.980406:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 14 pid: 9611 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.980416:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 14 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127001.980419:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991594112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 121us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127001.980426:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10023 00010000:00010000:2.0:1746127001.980430:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeac00/0x34dc807b6ef95b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d86 expref: 14 pid: 9611 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.980460:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127001.980477:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.980478:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991594496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 100us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.980484:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10024 00000100:00100000:0.0:1746127001.980491:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991594240 00000100:00100000:0.0:1746127001.980494:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991594240 00010000:00010000:0.0:1746127001.980505:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 13 pid: 3148 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746127001.980519:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10025 00000100:00100000:0.0:1746127001.980524:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991594240:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127001.981122:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.981169:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593472 00000100:00100000:2.0:1746127001.981174:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593472 00010000:00010000:2.0:1746127001.981189:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 14 pid: 16295 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127001.981212:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.981213:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10026 00000100:00100000:2.0:1746127001.981218:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991593472:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.981224:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.981234:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 14 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127001.981243:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 14 pid: 16295 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127001.981248:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127001.981256:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8600/0x34dc807b6ef9645 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52de1 expref: 14 pid: 16295 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127001.981257:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593728 00000100:00100000:1.0:1746127001.981260:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593984 00000100:00100000:3.0:1746127001.981261:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593728 00000100:00100000:1.0:1746127001.981263:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593984 00010000:00010000:2.0:1746127001.981267:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127001.981276:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 40 pid: 1507 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127001.981277:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 40 pid: 16295 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127001.981285:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991593472:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 67us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.981291:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10026 00000100:00100000:3.0:1746127001.981298:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10027 00000100:00100000:1.0:1746127001.981302:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10028 00000100:00100000:3.0:1746127001.981303:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991593728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127001.981307:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991593984:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127001.981309:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.981318:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 40 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127001.981319:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.981326:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 40 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127001.981329:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 40 pid: 1507 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127001.981338:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c35ca00/0x34dc807b6ef95f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dbe expref: 40 pid: 16295 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127001.981339:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 40 pid: 1507 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127001.981350:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127001.981351:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009915ba00/0x34dc807b6ef94d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cde expref: 39 pid: 1507 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127001.981352:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.981356:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.981364:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127001.981364:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127001.981377:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991593984:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (129us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127001.981383:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127001.981400:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991593728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127001.982409:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10028 00000100:00100000:1.0:1746127001.982469:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.982591:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593088 00000100:00100000:2.0:1746127001.982594:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593088 00002000:00100000:2.0:1746127001.982619:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1327104->1839103) req@ffff8801303d0e00 x1830945991593088/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/0 e 0 to 0 dl 1746127012 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.982629:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0e00 with x1830945991593088 ext(1327104->1839103) 00010000:00010000:2.0:1746127001.982635:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 17 pid: 11152 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.982649:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 17 pid: 11152 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746127001.982654:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801303d0e00 00000100:00100000:2.0:1746127001.982669:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1881 00000100:00100000:2.0:1746127001.982681:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991593088:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127001.982728:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10027 00010000:00010000:3.0:1746127001.982752:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982766:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982782:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982789:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982796:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982803:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009914a800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127001.982807:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982814:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982827:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.982833:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009914a800/0x34dc807b6ef96b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.982871:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127001.982880:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991592832:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 13952us (14247us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127001.982885:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127001.982889:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21423 00010000:00010000:0.0:1746127001.982894:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127001.982907:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009914ac00/0x34dc807b6ef9661 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dfd expref: 12 pid: 3148 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127001.982916:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127001.982933:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991594240:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2408us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.982938:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127001.982939:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10025 00000100:00100000:0.0:1746127001.982960:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593600 00000100:00100000:0.0:1746127001.982962:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593600 00000100:00100000:3.0:1746127001.982972:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127001.982973:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 33 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127001.982995:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991593856 00000100:00100000:0.0:1746127001.982997:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991593856 00000100:00100000:2.0:1746127001.982999:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10029 00000100:00100000:2.0:1746127001.983006:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991593600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.983007:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 14 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127001.983014:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127001.983023:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127001.983023:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 33 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127001.983025:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10030 00010000:00010000:2.0:1746127001.983031:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 33 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127001.983031:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991593856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.983037:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127001.983041:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991594368 00010000:00010000:2.0:1746127001.983043:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096620c00/0x34dc807b6ef95ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d78 expref: 33 pid: 9611 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127001.983044:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991594368 00010000:00010000:0.0:1746127001.983045:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 14 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127001.983053:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 14 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127001.983056:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 19 pid: 1507 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127001.983056:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.983069:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.983073:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.983078:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9e00/0x34dc807b6ef965a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52def expref: 14 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127001.983079:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.983081:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10031 00000100:00100000:3.0:1746127001.983086:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991594368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.983086:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127001.983093:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127001.983100:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 19 pid: 1507 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127001.983102:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127001.983104:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991593856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 73us (132us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127001.983108:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 19 pid: 1507 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746127001.983109:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10030 00010000:00010000:3.0:1746127001.983119:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4200/0x34dc807b6ef9511 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52d08 expref: 19 pid: 1507 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127001.983119:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991593600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 114us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.983125:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10029 00010000:00010000:3.0:1746127001.983126:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.983143:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127001.983145:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983149:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983159:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127001.983159:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.983162:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127001.983164:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983168:0:12333:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983172:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983173:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983175:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983179:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983180:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983182:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e8000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127001.983184:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983184:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.983186:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991594624 00010000:00010000:2.0:1746127001.983187:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983188:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.983188:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991594624 00010000:00010000:3.0:1746127001.983191:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007602ec00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127001.983192:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983195:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983196:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983199:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.983199:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 32 pid: 9612 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127001.983200:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e8000/0x34dc807b6ef96bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.983202:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007602ec00/0x34dc807b6ef96c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.983212:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10032 00000100:00100000:0.0:1746127001.983216:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991594624:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127001.983222:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127001.983224:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991592448:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 13760us (13822us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.983228:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21425 00010000:00010000:0.0:1746127001.983228:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 32 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127001.983232:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991592192:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 14283us (14567us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127001.983236:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 32 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127001.983238:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21424 00000100:00100000:3.0:1746127001.983249:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991594368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 163us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127001.983250:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb400/0x34dc807b6ef95ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52db7 expref: 32 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127001.983252:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10031 00010000:00010000:0.0:1746127001.983260:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127001.983262:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127001.983264:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.983270:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127001.983283:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127001.983297:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.983299:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991594624:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (136us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127001.983303:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127001.983304:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10032 00010000:00010000:2.0:1746127001.983315:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983320:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983326:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983331:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d2d2800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127001.983334:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983340:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983349:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.983355:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6ef96ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127001.983391:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991592704:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 13911us (13949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.983397:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21426 00000100:00100000:3.0:1746127001.986770:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991592960:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 14111us (14408us total) trans 21474842813 rc 0/0 00000100:00100000:3.0:1746127001.986782:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1880 00002000:00100000:3.0:1746127001.986793:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1191936->1945599) req@ffff880095c06300 x1830945991592960/t21474842813(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127001.986803:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06300 with x1830945991592960 ext(1191936->1945599) 00010000:00010000:3.0:1746127001.986813:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127001.986826:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746127001.986834:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c06300 00000100:00100000:2.0:1746127001.988351:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991593088:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 5671us (5876us total) trans 17179875554 rc 0/0 00000100:00100000:2.0:1746127001.988362:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1881 00002000:00100000:2.0:1746127001.988372:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1327104->1839103) req@ffff8801303d0e00 x1830945991593088/t17179875554(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:7/0 lens 488/448 e 0 to 0 dl 1746127012 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127001.988379:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0e00 with x1830945991593088 ext(1327104->1839103) 00010000:00010000:2.0:1746127001.988386:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.988397:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746127001.988404:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801303d0e00 00000100:00100000:0.0:1746127001.988922:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.988971:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991594752 00000100:00100000:2.0:1746127001.988978:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991594752 00010000:00010000:2.0:1746127001.989001:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.989033:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10033 00000100:00100000:2.0:1746127001.989039:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991594752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.989119:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.989160:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.989168:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.989185:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeb800/0x34dc807b6ef9622 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1945599) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dd3 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.989199:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.989201:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.989204:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.989211:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.989231:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.989249:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991594752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 211us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.989255:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10033 00010000:00010000:3.0:1746127001.989270:0:12340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989280:0:12340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989300:0:12340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989308:0:12340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989315:0:12340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989321:0:12340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeaa00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127001.989325:0:12340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989332:0:12340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989342:0:12340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.989351:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6ef96ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.989417:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991592576:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 20663us (20820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.989425:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21422 00000100:00100000:0.0:1746127001.990231:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127001.990269:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991594880 00000100:00100000:2.0:1746127001.990273:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991594880 00010000:00010000:2.0:1746127001.990287:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.990312:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10034 00000100:00100000:2.0:1746127001.990315:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991594880:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127001.990321:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127001.990329:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.990336:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.990346:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8200/0x34dc807b6ef961b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1839103) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52dcc expref: 18 pid: 11152 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127001.990356:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.990357:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127001.990360:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.990364:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.990380:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127001.990407:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991594880:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 91us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127001.990411:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10034 00010000:00010000:3.0:1746127001.990586:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990595:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990608:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990614:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990621:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990627:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd7e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127001.990630:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990636:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990645:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.990650:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7e00/0x34dc807b6ef96a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127001.990688:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991592320:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 21975us (22139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127001.990695:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21421 00000100:00100000:0.0:1746127001.994925:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127001.995109:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991595136 00000100:00100000:3.0:1746127001.995118:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991595136 00000100:00100000:3.0:1746127001.995216:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17234 00000100:00100000:3.0:1746127001.995223:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:4219:x1830945991595136:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:3.0:1746127001.995274:0:7258:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746127001.995301:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb200/0x34dc807b6ef9389 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52bf7 expref: 19 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995320:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158600/0x34dc807b6ef8f06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528cb expref: 18 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995330:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127001.995334:0:7258:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127001.995359:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.995370:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 21 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995377:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 49 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995384:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 21 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995390:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 21 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995402:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 49 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995407:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127001.995434:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 49 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127001.995444:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 49 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127001.995457:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230016:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.998403:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 21 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.998421:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 21 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.998436:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230144:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.999278:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 21 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.999289:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 21 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.999298:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230272:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.999340:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 49 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.999348:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 49 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.999356:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230400:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127001.999380:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 21 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127001.999387:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 21 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127001.999396:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230528:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127001.999413:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.003349:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.003377:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.003406:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.003432:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991595392 00000100:00100000:3.0:1746127002.003439:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991595264 00000100:00100000:0.0:1746127002.003439:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991595392 00000100:00100000:3.0:1746127002.003444:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991595264 00000100:00100000:1.0:1746127002.003454:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991595520 00000100:00100000:1.0:1746127002.003459:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991595520 00010000:00010000:3.0:1746127002.003507:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 50 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.003507:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 23 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.003537:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10035 00000100:00100000:1.0:1746127002.003544:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991595520:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127002.003546:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230016:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.003560:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230144:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127002.003565:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127002.003566:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230272:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127002.003572:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 23 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.003583:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 23 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.003605:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caebc00/0x34dc807b6ef8ef8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528bd expref: 23 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.003623:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10036 00000100:00100000:2.0:1746127002.003634:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991595264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.003639:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.003640:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.003645:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 50 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.003645:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.003655:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127002.003656:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 50 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.003668:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6ef8f14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528d9 expref: 50 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.003686:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.003689:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.003694:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.003700:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991595520:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 156us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.003709:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2027:x1830945991595264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 78us (331us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127002.003747:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 22 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.003946:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10035 00000100:00100000:2.0:1746127002.003951:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10036 00000100:00100000:2.0:1746127002.004119:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230528:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127002.004182:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10037 00000100:00100000:0.0:1746127002.004189:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991595392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127002.004195:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127002.004199:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 21 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.004206:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 21 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.004216:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6ef8eff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e528c4 expref: 21 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.004226:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127002.004229:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127002.004234:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127002.004249:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991595392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 61us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.004254:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10037 00000100:00100000:0.0:1746127002.006083:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.006157:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991595648 00000100:00100000:3.0:1746127002.006163:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991595648 00010000:00010000:3.0:1746127002.006189:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 20 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.006260:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10038 00000100:00100000:3.0:1746127002.006267:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991595648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.006277:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.006281:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 20 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.006291:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 20 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.006305:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6ef90c6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52a30 expref: 20 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.006316:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.006320:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.006326:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.006362:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991595648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.006367:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10038 00000100:00100000:0.0:1746127002.007498:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.007574:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994230400:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.007608:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127002.007671:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991595776 00000100:00100000:1.0:1746127002.007676:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991595776 00010000:00010000:1.0:1746127002.007693:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 49 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.007718:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10039 00000100:00100000:1.0:1746127002.007724:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2029:x1830945991595776:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.007731:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.007735:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 49 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.007742:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 49 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.007757:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3600/0x34dc807b6ef9493 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52cbb expref: 49 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.007767:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.007770:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.007778:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.007784:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.007800:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.007820:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991595776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 96us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.007826:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10039 00010000:00010000:2.0:1746127002.007978:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.007984:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000040:00080000:2.0:1746127002.008603:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1353, 88 off126664 00000004:00080000:2.0:1746127002.008614:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897050483892ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127002.008660:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1376, 88 off128776 00000004:00080000:2.0:1746127002.008665:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897050535263ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127002.008694:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1377, 88 off128864 00000004:00080000:2.0:1746127002.008697:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897050567415ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127002.008705:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1354, 88 off126752 00000004:00080000:2.0:1746127002.008708:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897050578193ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127002.008714:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1355, 88 off126840 00000004:00080000:2.0:1746127002.008717:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897050587525ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127002.008724:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1378, 88 off128952 00000004:00080000:2.0:1746127002.008727:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897050597295ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127002.008733:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1379, 88 off129040 00000004:00080000:2.0:1746127002.008736:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897050606210ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127002.008742:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1380, 88 off129128 00000004:00080000:2.0:1746127002.008745:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897050616120ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127002.008752:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1356, 88 off126928 00000004:00080000:2.0:1746127002.008755:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897050625325ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127002.008761:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1381, 88 off129216 00000004:00080000:2.0:1746127002.008764:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897050634767ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127002.008881:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1357, 88 off127016 00000004:00080000:2.0:1746127002.008886:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897050756745ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127002.008899:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1382, 88 off129304 00000004:00080000:2.0:1746127002.008901:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897050771556ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127002.011469:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1358, 88 off127104 00000004:00080000:3.0:1746127002.011489:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897053358471ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127002.011523:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1359, 88 off127192 00000004:00080000:3.0:1746127002.011527:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897053397554ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127002.011536:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1360, 88 off127280 00000004:00080000:3.0:1746127002.011539:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897053409699ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127002.011547:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1361, 88 off127368 00000004:00080000:3.0:1746127002.011552:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897053422431ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127002.011574:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1383, 88 off129392 00000004:00080000:3.0:1746127002.011577:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897053447767ns, next at 895431202182ns, rc = 0 00000001:00080000:3.0:1746127002.014467:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938167 is committed 00000004:00080000:3.0:1746127002.014477:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1358 committed 00000004:00080000:3.0:1746127002.014494:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1336 committed 00000004:00080000:3.0:1746127002.014582:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1335 committed 00000004:00080000:3.0:1746127002.014585:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1334 committed 00000004:00080000:3.0:1746127002.014587:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1333 committed 00000004:00080000:3.0:1746127002.014588:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1357 committed 00000004:00080000:3.0:1746127002.014592:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1332 committed 00000004:00080000:3.0:1746127002.014594:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1356 committed 00000004:00080000:3.0:1746127002.014595:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1331 committed 00000004:00080000:3.0:1746127002.014597:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1355 committed 00000004:00080000:3.0:1746127002.014599:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1354 committed 00000004:00080000:3.0:1746127002.014600:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1353 committed 00000004:00080000:3.0:1746127002.014602:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1330 committed 00000004:00080000:3.0:1746127002.014603:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1329 committed 00000004:00080000:3.0:1746127002.014604:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1352 committed 00000004:00080000:3.0:1746127002.014606:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1351 committed 00000004:00080000:3.0:1746127002.014607:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1328 committed 00000001:00080000:3.0:1746127002.014616:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938164 is committed 00000001:00080000:3.0:1746127002.014620:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938163 is committed 00000100:00100000:0.0:1746127002.014826:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994230656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.014847:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994230912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.014873:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.014907:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.014909:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.014926:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.014936:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.014946:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231680:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746127002.014953:0:7258:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095c07100 reply state ffff88012bae0000 transno 8589938167 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127002.014954:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.014971:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231936:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746127002.014972:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127002.014973:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746127002.014980:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.014983:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746127002.014987:0:7258:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746127002.014987:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994232192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.014990:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.014999:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.015003:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994232448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.015012:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994230656 00000100:00100000:0.0:1746127002.015015:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746127002.015018:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994230656 00000100:00100000:1.0:1746127002.015019:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.015020:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.015049:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746127002.015055:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994230784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.015066:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994230912 00000100:00100000:2.0:1746127002.015068:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994230912 00000100:00100000:3.0:1746127002.015078:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231168 00000100:00100000:3.0:1746127002.015083:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231168 00000100:00100000:2.0:1746127002.015085:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231424 00000100:00100000:1.0:1746127002.015086:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.015087:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231424 00000100:00100000:1.0:1746127002.015097:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.015098:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231680 00000100:00100000:2.0:1746127002.015099:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231680 00000100:00100000:3.0:1746127002.015104:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231936 00000100:00100000:3.0:1746127002.015106:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231936 00000100:00100000:2.0:1746127002.015108:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994232192 00000100:00100000:2.0:1746127002.015110:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994232192 00000100:00100000:1.0:1746127002.015110:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127002.015114:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994232448 00000100:00100000:3.0:1746127002.015115:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994232448 00000100:00100000:1.0:1746127002.015116:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.015119:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994230784 00000100:00100000:2.0:1746127002.015120:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994230784 00000100:00100000:3.0:1746127002.015122:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231296 00000100:00100000:3.0:1746127002.015124:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231296 00000100:00100000:1.0:1746127002.015143:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.015146:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21427 00000100:00100000:1.0:1746127002.015151:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994232320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.015153:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3785:x1830945994230656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127002.015155:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231808 00000100:00100000:3.0:1746127002.015157:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231808 00000100:00100000:1.0:1746127002.015164:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127002.015168:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21428 00000100:00100000:3.0:1746127002.015174:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3783:x1830945994230912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.015181:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994232320 00000100:00100000:1.0:1746127002.015185:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994232320 00000100:00100000:1.0:1746127002.015199:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21429 00000100:00100000:1.0:1746127002.015204:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3783:x1830945994231424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.015251:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21430 00000100:00100000:2.0:1746127002.015256:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994231168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127002.015317:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746127002.015320:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127002.015322:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127002.015324:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127002.015326:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:0.0:1746127002.015370:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.015384:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3783:x1830945994231424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (427us total) trans 17179875556 rc 0/0 00000100:00100000:0.0:1746127002.015384:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.015390:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21429 00000100:00100000:0.0:1746127002.015401:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.015405:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231040 00000100:00100000:1.0:1746127002.015408:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231040 00000100:00100000:0.0:1746127002.015409:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994232064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.015417:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21431 00000100:00100000:0.0:1746127002.015419:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.015421:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3785:x1830945994231680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.015426:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994232576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.015437:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.015452:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994231552 00000100:00100000:0.0:1746127002.015455:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994231552 00002000:00010000:1.0:1746127002.015461:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127002.015463:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127002.015465:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:1.0:1746127002.015466:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00000100:00100000:0.0:1746127002.015467:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994232064 00002000:00010000:1.0:1746127002.015468:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746127002.015468:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994232064 00000100:00100000:0.0:1746127002.015474:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994232576 00000100:00100000:0.0:1746127002.015475:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994232576 00000100:00100000:0.0:1746127002.015482:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21432 00000100:00100000:0.0:1746127002.015487:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3783:x1830945994231936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.015505:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3785:x1830945994231680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (530us total) trans 17179875557 rc 0/0 00000100:00100000:1.0:1746127002.015513:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21431 00000100:00100000:1.0:1746127002.015524:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21433 00000100:00100000:1.0:1746127002.015528:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994232192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.015568:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3783:x1830945994231936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (577us total) trans 21474842816 rc 0/0 00002000:00010000:1.0:1746127002.015571:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127002.015574:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00000100:00100000:0.0:1746127002.015574:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21432 00002000:00010000:1.0:1746127002.015575:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127002.015577:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127002.015579:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:0.0:1746127002.015585:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21434 00000100:00100000:0.0:1746127002.015589:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3783:x1830945994232448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.015598:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994232192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (597us total) trans 21474842817 rc 0/0 00000100:00100000:1.0:1746127002.015603:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21433 00000100:00100000:1.0:1746127002.015613:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21435 00000100:00100000:1.0:1746127002.015617:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3783:x1830945994230784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127002.015625:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:0.0:1746127002.015627:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127002.015629:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127002.015630:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127002.015632:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:0.0:1746127002.015651:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3783:x1830945994232448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (631us total) trans 21474842818 rc 0/0 00000100:00100000:0.0:1746127002.015656:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21434 00000100:00100000:0.0:1746127002.015665:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21436 00000100:00100000:1.0:1746127002.015667:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3783:x1830945994230784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (580us total) trans 21474842819 rc 0/0 00000100:00100000:0.0:1746127002.015669:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3783:x1830945994231296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.015673:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21435 00000100:00100000:1.0:1746127002.015682:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21437 00000100:00100000:1.0:1746127002.015687:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3783:x1830945994231808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.015719:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3783:x1830945994231296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (608us total) trans 21474842820 rc 0/0 00000100:00100000:1.0:1746127002.015739:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3783:x1830945994231808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (609us total) trans 17179875558 rc 0/0 00000100:00100000:1.0:1746127002.015743:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21437 00000100:00100000:1.0:1746127002.015753:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21438 00000100:00100000:1.0:1746127002.015756:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3783:x1830945994232320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.015804:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3783:x1830945994232320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (638us total) trans 17179875559 rc 0/0 00000100:00100000:1.0:1746127002.015809:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21438 00000100:00100000:1.0:1746127002.015819:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21439 00000100:00100000:3.0:1746127002.015820:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3783:x1830945994230912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 646us (912us total) trans 21474842814 rc 0/0 00000100:00100000:1.0:1746127002.015823:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994231040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127002.015830:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21428 00000100:00100000:3.0:1746127002.015841:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21440 00000100:00100000:3.0:1746127002.015845:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994231552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.015876:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994231040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (505us total) trans 21474842821 rc 0/0 00000100:00100000:1.0:1746127002.015881:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21439 00000100:00100000:1.0:1746127002.015889:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21441 00000100:00100000:1.0:1746127002.015893:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3785:x1830945994232064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127002.015905:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3785:x1830945994231552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (503us total) trans 17179875560 rc 0/0 00000100:00100000:3.0:1746127002.015910:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21440 00000100:00100000:3.0:1746127002.015930:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21442 00002000:00010000:1.0:1746127002.015932:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00000100:00100000:3.0:1746127002.015933:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3785:x1830945994232576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127002.015934:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746127002.015936:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127002.015937:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746127002.015939:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:1.0:1746127002.015957:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3785:x1830945994232064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (536us total) trans 17179875561 rc 0/0 00000100:00100000:1.0:1746127002.015962:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21441 00000100:00100000:3.0:1746127002.015982:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3785:x1830945994232576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (543us total) trans 17179875562 rc 0/0 00000100:00100000:3.0:1746127002.015987:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21442 00000100:00100000:1.0:1746127002.015999:0:3783:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842797 gen 2 00000004:00080000:1.0:1746127002.016004:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f14e00, transno 21474842723 00000004:00080000:1.0:1746127002.016011:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f15180, transno 21474842724 00000004:00080000:1.0:1746127002.016013:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f800, transno 21474842725 00000004:00080000:1.0:1746127002.016016:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f15500, transno 21474842726 00000004:00080000:1.0:1746127002.016018:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22ce00, transno 21474842727 00000100:00100000:2.0:1746127002.016019:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994231168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 762us (1091us total) trans 21474842815 rc 0/0 00000004:00080000:1.0:1746127002.016020:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22ca80, transno 21474842728 00000004:00080000:1.0:1746127002.016022:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22c380, transno 21474842729 00000004:00080000:1.0:1746127002.016024:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f480, transno 21474842730 00000100:00100000:2.0:1746127002.016025:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21430 00000004:00080000:1.0:1746127002.016027:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22dc00, transno 21474842731 00000004:00080000:1.0:1746127002.016030:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8eea300, transno 21474842732 00000004:00080000:1.0:1746127002.016032:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8eea680, transno 21474842733 00000004:00080000:1.0:1746127002.016034:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8eeb100, transno 21474842734 00000004:00080000:1.0:1746127002.016036:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee9180, transno 21474842735 00000004:00080000:1.0:1746127002.016038:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f15f80, transno 21474842736 00000004:00080000:1.0:1746127002.016040:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee9f80, transno 21474842737 00000004:00080000:1.0:1746127002.016043:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee8a80, transno 21474842738 00000004:00080000:1.0:1746127002.016045:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f17b80, transno 21474842739 00000004:00080000:1.0:1746127002.016048:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a2fdaa00, transno 21474842740 00000004:00080000:1.0:1746127002.016050:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009da76680, transno 21474842745 00000100:00100000:0.0:1746127002.016051:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21436 00000004:00080000:1.0:1746127002.016052:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009da75f80, transno 21474842746 00000004:00080000:1.0:1746127002.016054:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009da75500, transno 21474842747 00000004:00080000:1.0:1746127002.016056:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74380, transno 21474842748 00000004:00080000:1.0:1746127002.016069:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a76680, transno 21474842749 00000004:00080000:1.0:1746127002.016071:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74700, transno 21474842750 00000004:00080000:1.0:1746127002.016073:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f0a80, transno 21474842751 00000100:00080000:0.0:1746127002.016073:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746127002.016075:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74e00, transno 21474842752 00000100:00100000:2.0:1746127002.016076:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994230656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 924us (1202us total) trans 17179875555 rc 0/0 00000100:00080000:0.0:1746127002.016076:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746127002.016077:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a77100, transno 21474842753 00000004:00080000:1.0:1746127002.016080:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd4700, transno 21474842754 00000100:00100000:2.0:1746127002.016081:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21427 00000004:00080000:1.0:1746127002.016082:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd5500, transno 21474842755 00000004:00080000:1.0:1746127002.016084:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd5180, transno 21474842756 00000004:00080000:1.0:1746127002.016086:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd4380, transno 21474842757 00000004:00080000:1.0:1746127002.016088:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a78e00, transno 21474842758 00000004:00080000:1.0:1746127002.016090:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd4e00, transno 21474842759 00000004:00080000:1.0:1746127002.016092:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a7aa00, transno 21474842760 00000004:00080000:1.0:1746127002.016093:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a79500, transno 21474842761 00000004:00080000:1.0:1746127002.016095:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a79c00, transno 21474842762 00000004:00080000:1.0:1746127002.016097:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3fe680, transno 21474842779 00000004:00080000:1.0:1746127002.016100:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e3800, transno 21474842780 00000004:00080000:1.0:1746127002.016102:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3fdf80, transno 21474842781 00000004:00080000:1.0:1746127002.016104:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3fed80, transno 21474842782 00000004:00080000:1.0:1746127002.016106:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3fca80, transno 21474842783 00000004:00080000:1.0:1746127002.016108:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e1180, transno 21474842784 00000004:00080000:1.0:1746127002.016110:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3fce00, transno 21474842785 00000004:00080000:1.0:1746127002.016112:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60000, transno 21474842786 00000004:00080000:1.0:1746127002.016114:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3ff800, transno 21474842787 00000004:00080000:1.0:1746127002.016116:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9ce00, transno 21474842789 00000004:00080000:1.0:1746127002.016117:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9ca80, transno 21474842790 00000004:00080000:1.0:1746127002.016119:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9dc00, transno 21474842791 00000004:00080000:1.0:1746127002.016121:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9d880, transno 21474842792 00000004:00080000:1.0:1746127002.016123:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9c380, transno 21474842793 00000004:00080000:1.0:1746127002.016124:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9d180, transno 21474842794 00000004:00080000:1.0:1746127002.016126:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9c700, transno 21474842795 00000004:00080000:1.0:1746127002.016143:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9d500, transno 21474842796 00000004:00080000:1.0:1746127002.016146:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095ca8e00, transno 21474842797 00000100:00100000:1.0:1746127002.016152:0:3783:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880095c04000 x1830945994230784/t21474842819(21474842819) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127018 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746127002.016160:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c04000/2, rc 0, transno 21474842819 00000100:00100000:1.0:1746127002.016165:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994230784:0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746127002.016230:0:7258:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746127002.016241:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4219:x1830945991595136:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 21018us (21327us total) trans 8589938167 rc 0/0 00000100:00100000:3.0:1746127002.016247:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17234 00010000:00010000:3.0:1746127002.016277:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.016285:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.016295:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.016300:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127002.016303:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.016311:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.016322:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.016325:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127002.016467:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.016473:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef96d1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00000004:00080000:0.0:1746127002.016529:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c05500/2, rc 0, transno 21474842821 00000100:00100000:0.0:1746127002.016534:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127002.016547:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d1f80/2, rc 0, transno 17179875560 00000100:00100000:0.0:1746127002.016549:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127002.016557:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d2300/2, rc 0, transno 17179875561 00000100:00100000:0.0:1746127002.016559:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994232064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127002.016565:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d2d80/2, rc 0, transno 17179875562 00000100:00100000:0.0:1746127002.016567:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994232576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127002.016574:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d1500/2, rc 0, transno 17179875555 00000100:00100000:0.0:1746127002.016576:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994230656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127002.016582:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c06680/2, rc 0, transno 21474842815 00000100:00100000:0.0:1746127002.016584:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127002.016592:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d3480/2, rc 0, transno 17179875557 00000100:00100000:0.0:1746127002.016594:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994231680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127002.016602:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c07800/2, rc 0, transno 21474842817 00000100:00100000:0.0:1746127002.016604:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994232192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127002.016671:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c04700/2, rc 0, transno 21474842820 00000100:00100000:1.0:1746127002.016676:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127002.016685:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d0380/2, rc 0, transno 17179875558 00000100:00100000:1.0:1746127002.016689:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127002.016694:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d3100/2, rc 0, transno 17179875559 00000100:00100000:1.0:1746127002.016696:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994232320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127002.016704:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c04a80/2, rc 0, transno 21474842814 00000100:00100000:1.0:1746127002.016707:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994230912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127002.016713:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d1c00/2, rc 0, transno 17179875556 00000100:00100000:1.0:1746127002.016715:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127002.016722:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c05180/2, rc 0, transno 21474842816 00000100:00100000:1.0:1746127002.016724:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994231936:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127002.016730:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c06d80/2, rc 0, transno 21474842818 00000100:00100000:1.0:1746127002.016733:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994232448:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127002.017102:0:8231:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 54 done 00000100:00100000:2.0:1746127002.017190:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746127002.017200:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994232704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.017227:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.017301:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994232704 00000100:00100000:1.0:1746127002.017305:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994232704 00000100:00100000:1.0:1746127002.017327:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21443 00000100:00100000:1.0:1746127002.017429:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3784:x1830945994232704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.017518:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3784:x1830945994232704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (281us total) trans 21474842822 rc 0/0 00000100:00100000:1.0:1746127002.017524:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21443 00000100:00100000:0.0:1746127002.018509:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.019376:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991595904 00000100:00100000:3.0:1746127002.019384:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991595904 00000100:00100000:3.0:1746127002.019426:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17235 00000100:00100000:3.0:1746127002.019431:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4219:x1830945991595904:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.019451:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.019466:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e27 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.019510:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 8 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.019521:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 8 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.019534:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.019536:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127002.019539:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45a00, rc 0) 00000100:00100000:3.0:1746127002.019593:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4219:x1830945991595904:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 160us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.019599:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17235 00000004:00080000:2.0:1746127002.020002:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122386300/2, rc 0, transno 21474842822 00000100:00100000:2.0:1746127002.020008:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994232704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.023360:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.023513:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596032 00000100:00100000:2.0:1746127002.023521:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596032 00000100:00100000:2.0:1746127002.023557:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17236 00000100:00100000:2.0:1746127002.023563:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4219:x1830945991596032:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127002.023578:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.023593:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9800/0x34dc807b6ef96df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e2e expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.023661:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef96e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.023673:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef96e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.023682:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef96e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127002.023707:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127002.023710:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127002.023721:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef96e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.023741:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c9800/0x34dc807b6ef96df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e2e expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.023752:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef96e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e2e expref: 9 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.023759:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.023761:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127002.023763:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8e00, rc 0) 00000100:00100000:2.0:1746127002.023840:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4219:x1830945991596032:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 277us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.023846:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17236 00000100:00100000:2.0:1746127002.027212:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.027231:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596160 00000100:00100000:2.0:1746127002.027237:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596160 00000100:00100000:2.0:1746127002.027281:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21444 00000100:00100000:2.0:1746127002.027290:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991596160:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127002.027303:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.027320:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e35 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746127002.027326:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746127002.027337:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c898, atime: 0x6813c898, ctime: 0x6813c898, blocks: 0x7f8 00010000:00010000:2.0:1746127002.027351:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.027353:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.027360:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.027373:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.027382:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008a408a00, rc 0) 00000100:00100000:2.0:1746127002.027429:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991596160:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 140us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.027435:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21444 00000100:00100000:0.0:1746127002.027699:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.027709:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596288 00000100:00100000:2.0:1746127002.027712:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596288 00000100:00100000:0.0:1746127002.027717:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.027727:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596416 00000100:00100000:2.0:1746127002.027729:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596416 00000100:00100000:0.0:1746127002.027745:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.027746:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21445 00000100:00100000:2.0:1746127002.027751:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991596288:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:0.0:1746127002.027757:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596544 00010000:00010000:2.0:1746127002.027758:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127002.027760:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596544 00010000:00010000:2.0:1746127002.027767:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e3c expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.027777:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21446 00002000:00010000:2.0:1746127002.027782:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c898, atime: 0x6813c898, ctime: 0x6813c898, blocks: 0x800 00000100:00100000:0.0:1746127002.027782:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991596416:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127002.027789:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.027789:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.027791:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.027795:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.027796:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e43 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.027804:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746127002.027807:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c897, atime: 0x6813c897, ctime: 0x6813c897, blocks: 0x808 00010000:00010000:2.0:1746127002.027811:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36600, rc 0) 00010000:00010000:0.0:1746127002.027814:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.027816:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.027820:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 14 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.027829:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 14 pid: 12333 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127002.027831:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991596288:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 79us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.027836:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21445 00010000:00010000:0.0:1746127002.027841:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665c800, rc 0) 00000100:00100000:2.0:1746127002.027847:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21447 00000100:00100000:2.0:1746127002.027851:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991596544:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127002.027856:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127002.027858:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991596416:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 76us (139us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127002.027863:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e4a expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.027863:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21446 00002000:00010000:2.0:1746127002.027872:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c898, atime: 0x6813c898, ctime: 0x6813c898, blocks: 0x800 00010000:00010000:2.0:1746127002.027879:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.027880:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.027884:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.027892:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.027899:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c37600, rc 0) 00000100:00100000:2.0:1746127002.027918:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991596544:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.027922:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21447 00000100:00100000:0.0:1746127002.031124:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.031185:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.031259:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596672 00000100:00100000:3.0:1746127002.031265:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596672 00000100:00100000:3.0:1746127002.031303:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596800 00000100:00100000:3.0:1746127002.031305:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596800 00000100:00100000:3.0:1746127002.031321:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21448 00000100:00100000:3.0:1746127002.031327:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991596672:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.031339:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.031351:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e51 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127002.031376:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c898, atime: 0x6813c898, ctime: 0x6813c898, blocks: 0x14e0 00010000:00010000:3.0:1746127002.031390:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.031392:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.031398:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.031410:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.031418:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45600, rc 0) 00000100:00100000:3.0:1746127002.031452:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991596672:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 125us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.031458:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21448 00000100:00100000:3.0:1746127002.031470:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21449 00000100:00100000:3.0:1746127002.031475:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991596800:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.031482:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.032014:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e58 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127002.032028:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c898, atime: 0x6813c897, ctime: 0x6813c898, blocks: 0x1008 00010000:00010000:3.0:1746127002.032036:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.032038:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.032042:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.032051:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.032067:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44800, rc 0) 00000100:00100000:3.0:1746127002.032095:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991596800:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 620us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.032100:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21449 00000100:00100000:0.0:1746127002.036188:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.036287:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991596928 00000100:00100000:3.0:1746127002.036297:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991596928 00000100:00100000:3.0:1746127002.036890:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21450 00000100:00100000:3.0:1746127002.036898:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991596928:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127002.036996:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991596928:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 98us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.037002:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21450 00000100:00100000:0.0:1746127002.039657:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.039743:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597056 00000100:00100000:2.0:1746127002.039750:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597056 00000100:00100000:2.0:1746127002.039791:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21451 00000100:00100000:2.0:1746127002.039797:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991597056:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127002.039963:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.039988:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.040023:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597184 00000100:00100000:0.0:1746127002.040027:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597184 00000100:00100000:1.0:1746127002.040034:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597440 00000100:00100000:1.0:1746127002.040038:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597440 00000100:00100000:0.0:1746127002.040044:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21452 00000100:00100000:0.0:1746127002.040049:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991597184:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127002.040067:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21453 00000100:00100000:1.0:1746127002.040072:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991597440:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127002.040100:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991597184:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.040106:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21452 00000100:00100000:1.0:1746127002.040110:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991597440:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.040116:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21453 00000100:00100000:2.0:1746127002.040317:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991597056:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 519us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.040322:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21451 00000100:00100000:0.0:1746127002.041303:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.041747:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597312 00000100:00100000:3.0:1746127002.041753:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597312 00000100:00100000:3.0:1746127002.041776:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21454 00000100:00100000:3.0:1746127002.041781:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991597312:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127002.041835:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991597312:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 54us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.041840:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21454 00000100:00100000:3.0:1746127002.042360:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.042668:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597568 00000100:00100000:2.0:1746127002.042808:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597568 00000100:00100000:3.0:1746127002.043104:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21455 00000100:00100000:3.0:1746127002.043110:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991597568:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127002.043306:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991597568:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 196us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.043312:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21455 00000100:00100000:0.0:1746127002.052779:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.052818:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.052877:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597696 00000100:00100000:3.0:1746127002.052884:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597824 00000100:00100000:2.0:1746127002.052886:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597696 00000100:00100000:3.0:1746127002.052887:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597824 00000100:00100000:2.0:1746127002.052931:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21456 00000100:00100000:2.0:1746127002.052939:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991597696:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127002.052946:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21457 00000100:00100000:3.0:1746127002.052952:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991597824:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127002.053312:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991597824:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 359us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.053319:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21457 00000100:00100000:2.0:1746127002.053873:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991597696:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 934us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.053879:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21456 00000100:00100000:0.0:1746127002.054486:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.054516:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.054546:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.054566:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991598080 00000100:00100000:0.0:1746127002.054570:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991598080 00000100:00100000:0.0:1746127002.054600:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991597952 00000100:00100000:0.0:1746127002.054602:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991597952 00000100:00100000:0.0:1746127002.054616:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991598208 00000100:00100000:0.0:1746127002.054618:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991598208 00000100:00100000:1.0:1746127002.054621:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21458 00000100:00100000:1.0:1746127002.054628:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991598080:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127002.054671:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21459 00000100:00100000:0.0:1746127002.054677:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991597952:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127002.054680:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991598080:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 53us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.054686:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21458 00000100:00100000:1.0:1746127002.054695:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21460 00000100:00100000:1.0:1746127002.054700:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991598208:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127002.054707:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991597952:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.054711:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21459 00000100:00100000:1.0:1746127002.054721:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991598208:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 22us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.054726:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21460 00000100:00100000:0.0:1746127002.055475:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.055535:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991598336 00000100:00100000:2.0:1746127002.055538:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991598336 00000100:00100000:2.0:1746127002.055754:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21461 00000100:00100000:2.0:1746127002.055760:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991598336:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127002.055818:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991598336:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 58us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.055823:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21461 00000100:00100000:0.0:1746127002.062964:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.064447:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991598464 00000100:00100000:3.0:1746127002.064456:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991598464 00000100:00100000:3.0:1746127002.064505:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21462 00000100:00100000:3.0:1746127002.064512:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991598464:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:3.0:1746127002.064646:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127002.064650:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127002.064652:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127002.064654:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127002.064656:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127002.064704:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991598464:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 192us (1745us total) trans 17179875563 rc 0/0 00000100:00100000:3.0:1746127002.064711:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21462 00000100:00100000:0.0:1746127002.070635:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.070698:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991598592 00000100:00100000:2.0:1746127002.070705:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991598592 00000100:00100000:2.0:1746127002.070755:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21463 00000100:00100000:2.0:1746127002.070763:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991598592:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:2.0:1746127002.070916:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746127002.070919:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127002.070921:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127002.070922:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127002.070924:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:2.0:1746127002.071277:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991598592:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 513us (647us total) trans 21474842823 rc 0/0 00000100:00100000:2.0:1746127002.071284:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21463 00000100:00100000:0.0:1746127002.076209:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.076795:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991598848 00000100:00100000:2.0:1746127002.076804:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991598848 00000100:00100000:3.0:1746127002.076957:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8545 00000100:00100000:3.0:1746127002.076967:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991598848:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127002.076997:0:29586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.077008:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.077010:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.077014:0:29586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.077024:0:29586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.083341:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.084504:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.085967:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991599104 00000100:00100000:2.0:1746127002.085977:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991599104 00000100:00100000:2.0:1746127002.086028:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991599360 00000100:00100000:2.0:1746127002.086031:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991599360 00000100:00100000:2.0:1746127002.086050:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8546 00000100:00100000:2.0:1746127002.086065:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991599104:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127002.086108:0:20411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.086118:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.086121:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.086125:0:20411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.086150:0:20411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.086756:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8547 00000100:00100000:2.0:1746127002.086764:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2028:x1830945991599360:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127002.086782:0:29588:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.086790:0:29588:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.086791:0:29588:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.086794:0:29588:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.086801:0:29588:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.087991:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.088007:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127002.088452:0:29586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088463:0:29586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088471:0:29586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088477:0:29586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127002.088481:0:29586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088488:0:29586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088502:0:29586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088508:0:29586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f44200/0x34dc807b6ef9717 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.088564:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991598848:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 11598us (12360us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746127002.088572:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8545 00000100:00100000:3.0:1746127002.088591:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991599616 00000100:00100000:3.0:1746127002.088597:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991599616 00000100:00100000:3.0:1746127002.088631:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991599872 00000100:00100000:3.0:1746127002.088634:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991599872 00000100:00100000:2.0:1746127002.088644:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8548 00000100:00100000:2.0:1746127002.088652:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991599616:12345-192.168.203.42@tcp:3:lfs.0 00000100:00100000:3.0:1746127002.088659:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8549 00000100:00100000:3.0:1746127002.088665:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991599872:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127002.088677:0:9618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088678:0:13835:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088686:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.088686:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.088687:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.088688:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.088691:0:13835:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.088691:0:9618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.088700:0:13835:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.088704:0:9618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.094781:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.094822:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.094847:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.094867:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991600128 00000100:00100000:0.0:1746127002.094874:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991600128 00000100:00100000:0.0:1746127002.094921:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991600384 00000100:00100000:0.0:1746127002.094923:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991600384 00000100:00100000:0.0:1746127002.094936:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991600640 00000100:00100000:0.0:1746127002.094937:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991600640 00000100:00100000:0.0:1746127002.094950:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8550 00000100:00100000:0.0:1746127002.094956:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+20:2028:x1830945991600128:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746127002.094981:0:9616:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.094998:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.095000:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.095004:0:9616:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.095015:0:9616:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.095255:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8551 00000100:00100000:3.0:1746127002.095490:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991600384:12345-192.168.203.42@tcp:3:lfs.0 00000100:00100000:0.0:1746127002.095597:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8552 00000100:00100000:0.0:1746127002.095603:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2029:x1830945991600640:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746127002.095616:0:20410:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.095622:0:20410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.095623:0:20410:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.095627:0:20410:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.095634:0:20410:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.095730:0:29584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.095738:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.095739:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.095742:0:29584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.095750:0:29584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.096938:0:20411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.096948:0:20411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.096956:0:20411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.096962:0:20411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f560a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127002.096966:0:20411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.096973:0:20411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.096985:0:20411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.096991:0:20411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f560a00/0x34dc807b6ef971e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.097043:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2028:x1830945991599104:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 10985us (13706us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127002.097050:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8546 00010000:00010000:3.0:1746127002.109850:0:29588:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.109864:0:29588:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.109871:0:29588:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.109877:0:29588:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f561400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127002.109880:0:29588:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.109886:0:29588:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.109902:0:29588:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.109907:0:29588:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f561400/0x34dc807b6ef9725 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.109979:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2028:x1830945991599360:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 23212us (25472us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127002.109989:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8547 00010000:00010000:2.0:1746127002.119789:0:9618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.119803:0:9618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.119810:0:9618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.119816:0:9618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f560600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127002.119820:0:9618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.119827:0:9618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.119841:0:9618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.119847:0:9618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f560600/0x34dc807b6ef972c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.119897:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991599616:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 31243us (31905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127002.119909:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8548 00010000:00010000:3.0:1746127002.120029:0:13835:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.120037:0:13835:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.120043:0:13835:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.120047:0:13835:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bc6e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127002.120050:0:13835:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.120055:0:13835:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.120072:0:13835:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.120083:0:13835:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6e00/0x34dc807b6ef9733 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.120112:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991599872:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 31447us (32103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127002.120118:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8549 00010000:00010000:2.0:1746127002.127877:0:9616:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.127897:0:9616:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.127904:0:9616:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.127911:0:9616:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009665ce00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127002.127914:0:9616:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.127925:0:9616:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.127952:0:9616:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.127959:0:9616:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009665ce00/0x34dc807b6ef973a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.129544:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2028:x1830945991600128:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 34580us (34764us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127002.129556:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8550 00010000:00010000:2.0:1746127002.130552:0:20410:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.130564:0:20410:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.130570:0:20410:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.130576:0:20410:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009665c200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127002.130579:0:20410:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.130586:0:20410:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.130599:0:20410:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.130605:0:20410:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6ef9741 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.130652:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991600640:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 35047us (35802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127002.130659:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8552 00010000:00010000:0.0:1746127002.133544:0:29584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.133558:0:29584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.133565:0:29584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.133571:0:29584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bc7000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127002.133575:0:29584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.133582:0:29584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.133595:0:29584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.133600:0:29584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7000/0x34dc807b6ef9748 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.133680:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991600384:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 38414us (38853us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127002.133689:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8551 00000100:00100000:0.0:1746127002.141467:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.141727:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991600896 00000100:00100000:2.0:1746127002.141735:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991600896 00000100:00100000:2.0:1746127002.141781:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17237 00000100:00100000:2.0:1746127002.141788:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4219:x1830945991600896:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1746127002.141829:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.141855:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8c8e00/0x34dc807b6ef96e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e2e expref: 9 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.141873:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.141877:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127002.141915:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.142356:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.142364:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00010000:2.0:1746127002.142546:0:13448:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093640e00 reply state ffff88009d3eb000 transno 8589938168 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.142559:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.142564:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.142566:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746127002.142569:0:13448:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746127002.142712:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4219:x1830945991600896:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 923us (1250us total) trans 8589938168 rc 0/0 00000100:00100000:2.0:1746127002.142718:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17237 00000100:00100000:0.0:1746127002.145086:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.145434:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991601024 00000100:00100000:2.0:1746127002.145441:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991601024 00000100:00100000:2.0:1746127002.145487:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21464 00000100:00100000:2.0:1746127002.145493:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991601024:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:2.0:1746127002.145584:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746127002.145587:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:2.0:1746127002.145589:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:2.0:1746127002.145591:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:2.0:1746127002.145592:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746127002.145629:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991601024:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 136us (547us total) trans 21474842824 rc 0/0 00000100:00100000:2.0:1746127002.145636:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21464 00000100:00100000:0.0:1746127002.145783:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.145822:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.145850:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.145865:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991601280 00000100:00100000:0.0:1746127002.145868:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991601280 00000100:00100000:1.0:1746127002.145872:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991601536 00000100:00100000:1.0:1746127002.145876:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991601536 00000100:00100000:0.0:1746127002.145883:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991601152 00000100:00100000:0.0:1746127002.145885:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991601152 00000100:00100000:1.0:1746127002.145897:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21465 00000100:00100000:1.0:1746127002.145903:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991601280:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:1.0:1746127002.145963:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127002.145966:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127002.145968:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127002.145969:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127002.145971:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746127002.145994:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2029:x1830945991601280:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 91us (211us total) trans 17179875564 rc 0/0 00000100:00100000:0.0:1746127002.146670:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21466 00000100:00100000:0.0:1746127002.146678:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991601536:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127002.146728:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127002.146731:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146732:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146735:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146736:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746127002.146753:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991601536:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 77us (931us total) trans 21474842825 rc 0/0 00000100:00100000:0.0:1746127002.146759:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21466 00000100:00100000:0.0:1746127002.146771:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21467 00000100:00100000:0.0:1746127002.146775:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2029:x1830945991601152:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127002.146813:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127002.146816:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146818:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146819:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146821:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127002.146836:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2029:x1830945991601152:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 60us (986us total) trans 17179875565 rc 0/0 00000100:00100000:0.0:1746127002.146841:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21467 00000100:00100000:0.0:1746127002.146871:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.146884:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991601408 00000100:00100000:0.0:1746127002.146887:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991601408 00000100:00100000:0.0:1746127002.146900:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21468 00000100:00100000:0.0:1746127002.146904:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991601408:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127002.146940:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127002.146942:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146944:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146945:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.146947:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127002.146964:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991601408:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 57us (90us total) trans 21474842826 rc 0/0 00000100:00100000:0.0:1746127002.146969:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21468 00000100:00100000:1.0:1746127002.147396:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21465 00000100:00100000:0.0:1746127002.147861:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.148228:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991601664 00000100:00100000:1.0:1746127002.148232:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991601664 00000100:00100000:1.0:1746127002.148261:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21469 00000100:00100000:1.0:1746127002.148267:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2029:x1830945991601664:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:1.0:1746127002.148325:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127002.148327:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.148329:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746126999 -> 1746127000 00002000:00010000:1.0:1746127002.148330:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.148332:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746127002.148355:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2029:x1830945991601664:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 88us (493us total) trans 17179875566 rc 0/0 00000100:00100000:1.0:1746127002.148359:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21469 00000100:00100000:0.0:1746127002.149703:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.151725:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991601920 00000100:00100000:1.0:1746127002.151734:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991601920 00000100:00100000:1.0:1746127002.151778:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6557 00000100:00100000:1.0:1746127002.151784:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4219:x1830945991601920:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:1.0:1746127002.151825:0:24187:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9699 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e20 expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.151859:0:24187:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24187 initiator: MDT0 00010000:00010000:1.0:1746127002.151868:0:24187:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.151874:0:24187:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24187 initiator: MDT0 00010000:00010000:1.0:1746127002.151895:0:24187:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.151903:0:24187:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 10 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.151914:0:24187:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24187:1830945994232832:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127002.151998:0:24187:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.156997:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.157401:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991602048 00000100:00100000:3.0:1746127002.157409:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991602048 00010000:00010000:3.0:1746127002.157438:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 11 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.157463:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10040 00000100:00100000:3.0:1746127002.157470:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991602048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.157481:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.157485:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 11 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.157496:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 11 pid: 7258 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.157512:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.157516:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24187 initiator: MDT0 00010000:00010000:3.0:1746127002.157523:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 24187 initiator: MDT0 00010000:00010000:3.0:1746127002.157528:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 24187 initiator: MDT0 00010000:00010000:3.0:1746127002.157541:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.157573:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991602048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 103us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.157578:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10040 00010000:00010000:1.0:1746127002.157741:0:24187:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef96d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e27 expref: 10 pid: 7258 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.157761:0:24187:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24187:1830945994232832:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127002.157776:0:24187:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24187 initiator: MDT0 00010000:00010000:1.0:1746127002.157782:0:24187:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24187 initiator: MDT0 00010000:00010000:1.0:1746127002.157787:0:24187:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24187 initiator: MDT0 00000040:00080000:1.0:1746127002.157996:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1362, 88 off127456 00000004:00080000:1.0:1746127002.158001:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897199870893ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158032:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1384, 88 off129480 00000004:00080000:1.0:1746127002.158036:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897199906345ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.158052:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1385, 88 off129568 00000004:00080000:1.0:1746127002.158055:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897199925535ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.158073:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1363, 88 off127544 00000004:00080000:1.0:1746127002.158076:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897199946532ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158083:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1364, 88 off127632 00000004:00080000:1.0:1746127002.158085:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897199955763ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158092:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1386, 88 off129656 00000004:00080000:1.0:1746127002.158098:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897199965635ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.158107:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1387, 88 off129744 00000004:00080000:1.0:1746127002.158109:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897199980068ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.158116:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1388, 88 off129832 00000004:00080000:1.0:1746127002.158119:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897199989530ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.158126:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1365, 88 off127720 00000004:00080000:1.0:1746127002.158145:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897200015310ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158155:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1389, 88 off129920 00000004:00080000:1.0:1746127002.158157:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897200027555ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.158163:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1366, 88 off127808 00000004:00080000:1.0:1746127002.158166:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897200036288ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158172:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1390, 88 off130008 00000004:00080000:1.0:1746127002.158174:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897200045215ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.158181:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1367, 88 off127896 00000004:00080000:1.0:1746127002.158183:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897200054208ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158190:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1368, 88 off127984 00000004:00080000:1.0:1746127002.158192:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897200062457ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158198:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1369, 88 off128072 00000004:00080000:1.0:1746127002.158201:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897200071325ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158207:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1370, 88 off128160 00000004:00080000:1.0:1746127002.158209:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897200079818ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.158216:0:24187:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1391, 88 off130096 00000004:00080000:1.0:1746127002.158218:0:24187:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897200088865ns, next at 895431202182ns, rc = 0 00000001:00080000:3.0:1746127002.160727:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938169 is committed 00000004:00080000:3.0:1746127002.160736:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1366 committed 00000004:00080000:3.0:1746127002.161843:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1345 committed 00010000:00010000:2.0:1746127002.162306:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.162316:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.162321:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.162326:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f561c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.162329:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.162334:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.162347:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.162349:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.162351:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.162356:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561c00/0x34dc807b6ef974f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127002.162653:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994233088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.162702:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.162725:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994233600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.162738:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.162751:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746127002.162755:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994232960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.162767:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.162777:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994233472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.162788:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.162809:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233088 00000100:00100000:1.0:1746127002.162815:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233088 00000100:00100000:1.0:1746127002.162839:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233600 00000100:00100000:1.0:1746127002.162840:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233600 00000100:00100000:1.0:1746127002.162848:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994232960 00000100:00100000:1.0:1746127002.162849:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994232960 00000100:00100000:1.0:1746127002.162855:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233472 00000100:00100000:1.0:1746127002.162856:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233472 00000100:00100000:1.0:1746127002.162866:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21470 00000100:00100000:1.0:1746127002.162871:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3783:x1830945994233088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127002.162967:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127002.162970:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.162972:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.162974:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.162975:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746127002.162998:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994233088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (297us total) trans 17179875567 rc 0/0 00000100:00100000:1.0:1746127002.163004:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21470 00000100:00100000:1.0:1746127002.163014:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21471 00000100:00100000:1.0:1746127002.163018:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3783:x1830945994233600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127002.163052:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:1.0:1746127002.163054:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746127002.163056:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127002.163072:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746127002.163073:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:1.0:1746127002.163089:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994233600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (350us total) trans 17179875568 rc 0/0 00000100:00100000:1.0:1746127002.163093:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21471 00000100:00100000:1.0:1746127002.163101:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21472 00000100:00100000:1.0:1746127002.163105:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3783:x1830945994232960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127002.163153:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127002.163156:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.163157:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.163159:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.163160:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746127002.163175:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994232960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (407us total) trans 17179875569 rc 0/0 00000100:00100000:1.0:1746127002.163179:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21472 00000100:00100000:1.0:1746127002.163186:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21473 00000100:00100000:1.0:1746127002.163190:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3783:x1830945994233472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.163230:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994233472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (440us total) trans 17179875570 rc 0/0 00000100:00100000:1.0:1746127002.163234:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21473 00000004:00080000:1.0:1746127002.163258:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b79500/2, rc 0, transno 17179875569 00000100:00100000:1.0:1746127002.163262:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994232960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127002.163268:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b79180/2, rc 0, transno 17179875570 00000100:00100000:1.0:1746127002.163271:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994233472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127002.163276:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b7aa00/2, rc 0, transno 17179875567 00000100:00100000:1.0:1746127002.163278:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994233088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127002.163283:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b78a80/2, rc 0, transno 17179875568 00000100:00100000:1.0:1746127002.163286:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994233600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.163352:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.163374:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.163386:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.163399:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.163411:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746127002.163415:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.163425:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.163436:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.163445:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.163462:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233216 00000100:00100000:2.0:1746127002.163464:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233216 00000100:00100000:2.0:1746127002.163478:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233728 00000100:00100000:2.0:1746127002.163479:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233728 00000100:00100000:2.0:1746127002.163484:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233344 00000100:00100000:2.0:1746127002.163485:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233344 00000100:00100000:2.0:1746127002.163490:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233856 00000100:00100000:2.0:1746127002.163492:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233856 00000100:00100000:2.0:1746127002.163499:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21474 00000100:00100000:2.0:1746127002.163503:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994233216:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127002.163545:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1344 committed 00000004:00080000:3.0:1746127002.163548:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1343 committed 00002000:00010000:2.0:1746127002.163549:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:3.0:1746127002.163550:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1342 committed 00000004:00080000:3.0:1746127002.163551:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1365 committed 00002000:00010000:2.0:1746127002.163551:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:2.0:1746127002.163552:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00000004:00080000:3.0:1746127002.163553:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1341 committed 00000004:00080000:3.0:1746127002.163554:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1364 committed 00002000:00010000:2.0:1746127002.163554:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:2.0:1746127002.163555:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000004:00080000:3.0:1746127002.163556:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1340 committed 00000004:00080000:3.0:1746127002.163557:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1363 committed 00000004:00080000:3.0:1746127002.163558:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1362 committed 00000004:00080000:3.0:1746127002.163560:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1361 committed 00000004:00080000:3.0:1746127002.163561:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1339 committed 00000004:00080000:3.0:1746127002.163562:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1338 committed 00000004:00080000:3.0:1746127002.163564:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1360 committed 00000004:00080000:3.0:1746127002.163565:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1359 committed 00000004:00080000:3.0:1746127002.163569:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1337 committed 00000100:00100000:2.0:1746127002.163574:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3784:x1830945994233216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (200us total) trans 17179875571 rc 0/0 00000100:00100000:2.0:1746127002.163582:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21474 00000100:00100000:2.0:1746127002.163591:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21475 00000100:00100000:3.0:1746127002.163595:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21476 00000100:00100000:2.0:1746127002.163595:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994233728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127002.163602:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994233344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.163639:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21477 00000100:00100000:2.0:1746127002.163643:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994233728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (243us total) trans 17179875572 rc 0/0 00000100:00100000:0.0:1746127002.163646:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994233856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.163648:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21475 00002000:00010000:3.0:1746127002.163649:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127002.163651:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127002.163653:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127002.163655:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127002.163658:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000004:00080000:2.0:1746127002.163668:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b78700/2, rc 0, transno 17179875571 00000100:00100000:2.0:1746127002.163671:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233216:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127002.163677:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b7bb80/2, rc 0, transno 17179875572 00000100:00100000:2.0:1746127002.163679:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127002.163680:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3784:x1830945994233344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (253us total) trans 17179875573 rc 0/0 00000100:00100000:3.0:1746127002.163686:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21476 00000004:00080000:2.0:1746127002.163686:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b7b800/2, rc 0, transno 17179875573 00000100:00100000:2.0:1746127002.163689:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.163711:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3784:x1830945994233856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (264us total) trans 17179875574 rc 0/0 00000100:00100000:0.0:1746127002.163716:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21477 00000100:00100000:3.0:1746127002.163727:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994233984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.163728:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746127002.163735:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994234368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127002.163747:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.163754:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994234752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.163760:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994233984 00000100:00100000:0.0:1746127002.163762:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994233984 00000100:00100000:3.0:1746127002.163766:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994234496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.163769:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.163887:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994234752 00000100:00100000:0.0:1746127002.163889:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994234752 00000100:00100000:3.0:1746127002.163891:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21478 00000100:00100000:3.0:1746127002.163896:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3782:x1830945994233984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.163901:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21479 00000100:00100000:0.0:1746127002.163905:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3784:x1830945994234752:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127002.163906:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b78e00/2, rc 0, transno 17179875574 00000100:00100000:2.0:1746127002.163909:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994233856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.163915:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746127002.163919:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994234880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.163933:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127002.163945:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994234880 00000100:00100000:2.0:1746127002.163946:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994234112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127002.163948:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994234880 00002000:00010000:0.0:1746127002.163950:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127002.163953:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127002.163955:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127002.163956:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00000100:00100000:2.0:1746127002.163957:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746127002.163958:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:3.0:1746127002.163962:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994234112 00000100:00100000:3.0:1746127002.163964:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994234112 00000100:00100000:2.0:1746127002.163965:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994234624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127002.163972:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21480 00000100:00100000:3.0:1746127002.163976:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3784:x1830945994234880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.163977:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.163978:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3784:x1830945994234752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (208us total) trans 21474842828 rc 0/0 00000100:00100000:0.0:1746127002.163982:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21479 00000100:00100000:2.0:1746127002.163991:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994234624 00000100:00100000:2.0:1746127002.163993:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994234624 00000100:00100000:0.0:1746127002.163993:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21481 00000100:00100000:0.0:1746127002.163996:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3783:x1830945994234112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.164004:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21482 00000100:00100000:2.0:1746127002.164008:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3783:x1830945994234624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127002.164015:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:3.0:1746127002.164017:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127002.164019:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127002.164021:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127002.164023:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00002000:00010000:0.0:1746127002.164027:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127002.164029:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.164031:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.164032:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:0.0:1746127002.164034:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746127002.164042:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3784:x1830945994234880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (108us total) trans 21474842829 rc 0/0 00000100:00100000:3.0:1746127002.164047:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21480 00000100:00100000:0.0:1746127002.164050:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3783:x1830945994234112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (92us total) trans 21474842830 rc 0/0 00000100:00100000:0.0:1746127002.164055:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21481 00000100:00100000:2.0:1746127002.164071:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3783:x1830945994234624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (92us total) trans 21474842831 rc 0/0 00000100:00100000:2.0:1746127002.164075:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21482 00000100:00100000:0.0:1746127002.164085:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746127002.164086:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746127002.164088:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:3.0:1746127002.164090:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:3.0:1746127002.164092:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:3.0:1746127002.164094:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000004:00080000:2.0:1746127002.164095:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122387100/2, rc 0, transno 21474842830 00000100:00100000:0.0:1746127002.164098:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994234240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.164101:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994234112:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127002.164107:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122384700/2, rc 0, transno 21474842831 00000100:00100000:2.0:1746127002.164109:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994234624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127002.164113:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3782:x1830945994233984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (366us total) trans 21474842827 rc 0/0 00000100:00100000:0.0:1746127002.164114:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127002.164118:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21478 00000100:00100000:2.0:1746127002.164118:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994234368 00000100:00100000:2.0:1746127002.164120:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994234368 00000100:00100000:3.0:1746127002.164145:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994234240 00000100:00100000:3.0:1746127002.164147:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994234240 00000100:00100000:2.0:1746127002.164147:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21483 00000100:00100000:2.0:1746127002.164151:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994234368:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127002.164151:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122384a80/2, rc 0, transno 21474842829 00000100:00100000:0.0:1746127002.164155:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994234880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127002.164160:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21484 00000004:00080000:0.0:1746127002.164161:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122386a00/2, rc 0, transno 21474842828 00000100:00100000:3.0:1746127002.164164:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994234240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.164164:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994234752:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127002.164186:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746127002.164188:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127002.164190:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127002.164192:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127002.164193:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00002000:00010000:3.0:1746127002.164199:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:3.0:1746127002.164201:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:3.0:1746127002.164203:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:3.0:1746127002.164204:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:3.0:1746127002.164206:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000004:00010000:0.0:1746127002.164208:0:24187:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093640380 reply state ffff8800a6391400 transno 8589938169 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24187 initiator: MDT0 00000100:00100000:2.0:1746127002.164214:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994234368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (129us total) trans 21474842832 rc 0/0 00000100:00100000:2.0:1746127002.164218:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21483 00010000:00010000:0.0:1746127002.164221:0:24187:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24187 initiator: MDT0 00000100:00100000:3.0:1746127002.164223:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994234240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (108us total) trans 21474842833 rc 0/0 00000100:00100000:3.0:1746127002.164228:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21484 00010000:00010000:0.0:1746127002.164229:0:24187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127002.164231:0:24187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746127002.164234:0:24187:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746127002.164238:0:24187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127002.164240:0:24187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:2.0:1746127002.164244:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1746127002.164245:0:24187:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009914ba00/0x34dc807b6ef9699 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e20 expref: 7 pid: 7258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.164249:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994235008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.164263:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127002.164270:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994235008 00000100:00100000:3.0:1746127002.164272:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994235008 00000100:00100000:2.0:1746127002.164277:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127002.164283:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994234496 00000100:00100000:3.0:1746127002.164285:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994234496 00000100:00100000:3.0:1746127002.164293:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21485 00000100:00100000:3.0:1746127002.164296:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3783:x1830945994235008:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:0.0:1746127002.164302:0:24187:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746127002.164310:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4219:x1830945991601920:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 12526us (14609us total) trans 8589938169 rc 0/0 00000100:00100000:0.0:1746127002.164316:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6557 00000100:00100000:1.0:1746127002.164318:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21486 00000100:00100000:1.0:1746127002.164323:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3782:x1830945994234496:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127002.164334:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122387480/2, rc 0, transno 21474842832 00000100:00100000:0.0:1746127002.164337:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994234368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127002.164342:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122387b80/2, rc 0, transno 21474842833 00000100:00100000:0.0:1746127002.164344:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994234240:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746127002.164367:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746127002.164373:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746127002.164378:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746127002.164383:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8dd600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127002.164386:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746127002.164392:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746127002.164399:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127002.164401:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127002.164404:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24187 initiator: MDT0 00010000:00010000:0.0:1746127002.164409:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef9756 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24187 initiator: MDT0 00000004:00080000:2.0:1746127002.164518:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122385f80/2, rc 0, transno 21474842827 00000100:00100000:3.0:1746127002.164521:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3783:x1830945994235008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (257us total) trans 21474842834 rc 0/0 00000100:00100000:2.0:1746127002.164522:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994233984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127002.164525:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21485 00000004:00080000:3.0:1746127002.164542:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d3800/2, rc 0, transno 21474842834 00000100:00100000:3.0:1746127002.164546:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994235008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.164780:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3782:x1830945994234496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 456us (500us total) trans 21474842835 rc 0/0 00000100:00100000:1.0:1746127002.164785:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21486 00000004:00080000:2.0:1746127002.166286:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122384000/2, rc 0, transno 21474842835 00000100:00100000:2.0:1746127002.166294:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994234496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.167394:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.168109:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991602176 00000100:00100000:2.0:1746127002.168115:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991602176 00000100:00100000:2.0:1746127002.168178:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17238 00000100:00100000:2.0:1746127002.168185:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4219:x1830945991602176:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127002.168202:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.168217:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e5f expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.168259:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.168269:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.168282:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.168285:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127002.168287:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3aa00, rc 0) 00000100:00100000:2.0:1746127002.168340:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4219:x1830945991602176:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 156us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.168345:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17238 00000100:00100000:1.0:1746127002.175692:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.175769:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991602432 00000100:00100000:0.0:1746127002.175776:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991602432 00000100:00100000:0.0:1746127002.175824:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6558 00000100:00100000:0.0:1746127002.175831:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4219:x1830945991602432:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1746127002.175975:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4219:x1830945991602432:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 144us (289us total) trans 8589938170 rc 0/0 00000100:00100000:0.0:1746127002.175982:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6558 00000100:00100000:0.0:1746127002.205647:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.205715:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991602688 00000100:00100000:2.0:1746127002.205722:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991602688 00000100:00100000:2.0:1746127002.205771:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17239 00000100:00100000:2.0:1746127002.205779:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4226:x1830945991602688:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127002.205798:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.205811:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a000/0x34dc807b6ef9764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e66 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.205867:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205877:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205886:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205897:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205902:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205908:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205984:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205991:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.205996:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127002.206003:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127002.206052:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206088:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206093:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206098:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099191200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.206100:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206106:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206115:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127002.206117:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.206121:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206125:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191200/0x34dc807b6ef976b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206172:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206177:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206181:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206185:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099191800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.206187:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206195:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206200:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829a00) 00010000:00010000:2.0:1746127002.206202:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.206204:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206208:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191800/0x34dc807b6ef9772 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.206236:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a000/0x34dc807b6ef9764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.206245:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.206251:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.206253:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127002.206255:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191e00, rc 0) 00000100:00100000:2.0:1746127002.206295:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4226:x1830945991602688:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 516us (655us total) trans 8589938171 rc 0/0 00000100:00100000:2.0:1746127002.206301:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17239 00000100:00100000:0.0:1746127002.219862:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.219994:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991602944 00000100:00100000:2.0:1746127002.220001:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991602944 00000100:00100000:0.0:1746127002.220392:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.220889:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991603072 00000100:00100000:1.0:1746127002.220894:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991603072 00000100:00100000:2.0:1746127002.221332:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17240 00000100:00100000:2.0:1746127002.221340:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4231:x1830945991602944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.221358:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.221372:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099191000/0x34dc807b6ef9787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e6d expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.221424:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.221433:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.221441:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.221449:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.221454:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.221458:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127002.222516:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21487 00000100:00100000:1.0:1746127002.222524:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4228:x1830945991603072:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.222533:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.222543:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e74 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.222559:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.222561:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.222567:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.222578:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.222586:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967bf800, rc 0) 00000100:00100000:1.0:1746127002.222755:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4228:x1830945991603072:12345-192.168.203.42@tcp:101:cat.0 Request processed in 232us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.222762:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21487 00000100:00080000:0.0:1746127002.222784:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746127002.224054:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.224079:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.224087:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127002.224097:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127002.225212:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225219:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225226:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225230:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099191400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.225233:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225239:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225249:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127002.225251:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.225254:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225259:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191400/0x34dc807b6ef978e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225694:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225700:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225705:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225709:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099190400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.225711:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225716:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225726:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829a00) 00010000:00010000:2.0:1746127002.225728:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.225730:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225734:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099190400/0x34dc807b6ef9795 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.225774:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191000/0x34dc807b6ef9787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.225784:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.225790:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.225792:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127002.225794:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191600, rc 0) 00000100:00100000:2.0:1746127002.225980:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4231:x1830945991602944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4640us (6122us total) trans 8589938172 rc 0/0 00000100:00100000:2.0:1746127002.225987:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17240 00000100:00100000:0.0:1746127002.230173:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.230225:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991603584 00000100:00100000:2.0:1746127002.230234:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991603584 00002000:00100000:2.0:1746127002.230272:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880093642a00 x1830945991603584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.230280:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093642a00 with x1830945991603584 ext(0->1048575) 00002000:00010000:2.0:1746127002.230285:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093642a00 00000100:00100000:2.0:1746127002.230378:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8553 00000100:00100000:2.0:1746127002.230384:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991603584:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127002.233920:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.234041:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991603456 00000100:00100000:2.0:1746127002.234049:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991603456 00000100:00100000:2.0:1746127002.234107:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6559 00000100:00100000:2.0:1746127002.234113:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4231:x1830945991603456:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127002.234651:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4231:x1830945991603456:12345-192.168.203.42@tcp:35:cat.0 Request processed in 536us (737us total) trans 8589938173 rc 0/0 00000100:00100000:2.0:1746127002.234658:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6559 00000100:00100000:2.0:1746127002.241051:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991603584:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10659us (10877us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127002.241076:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8553 00002000:00100000:2.0:1746127002.241087:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880093642a00 x1830945991603584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.241096:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093642a00 with x1830945991603584 ext(0->1048575) 00002000:00010000:2.0:1746127002.241100:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093642a00 00000100:00100000:0.0:1746127002.241609:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.241684:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991603712 00000100:00100000:1.0:1746127002.241690:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991603712 00000100:00100000:1.0:1746127002.241732:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21488 00000100:00100000:1.0:1746127002.241739:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4231:x1830945991603712:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.241751:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.241764:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e7b expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.241781:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.241783:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.241789:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 14 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.241809:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 14 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.241819:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967bec00, rc 0) 00000100:00100000:1.0:1746127002.242035:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4231:x1830945991603712:12345-192.168.203.42@tcp:101:cat.0 Request processed in 296us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.242040:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21488 00000100:00100000:0.0:1746127002.243302:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.243347:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991603968 00000100:00100000:2.0:1746127002.243353:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991603968 00000100:00100000:2.0:1746127002.243790:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17241 00000100:00100000:2.0:1746127002.243798:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4229:x1830945991603968:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127002.243818:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.243830:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099190800/0x34dc807b6ef97b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e82 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.243894:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.243903:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.243907:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.243911:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127002.243928:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.243934:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 12 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.243941:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994235136:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.244008:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.244015:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 28 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.244022:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994235264:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.244039:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.247191:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.247292:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994235136:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.247300:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994235264:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.247317:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127002.247581:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991604224 00000100:00100000:1.0:1746127002.247588:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991604224 00010000:00010000:1.0:1746127002.247614:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.247655:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10041 00000100:00100000:1.0:1746127002.247661:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991604224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.247672:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.247678:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.247686:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.247704:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191e00/0x34dc807b6ef9779 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e66 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.247718:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.247723:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127002.247729:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127002.247735:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.247765:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991604224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 104us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.247770:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10041 00000100:00100000:2.0:1746127002.248073:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.248092:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.248141:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991604096 00000100:00100000:3.0:1746127002.248144:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991604096 00010000:00010000:3.0:1746127002.248157:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 13 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.248169:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10042 00000100:00100000:3.0:1746127002.248173:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991604096:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.248179:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.248182:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 13 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.248188:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 13 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.248197:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191600/0x34dc807b6ef97a3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e6d expref: 13 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.248205:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.248208:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127002.248213:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127002.248218:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127002.248229:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.248245:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991604096:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.248251:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10042 00010000:00010000:3.0:1746127002.248265:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127002.248270:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127002.248282:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127002.248377:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099190800/0x34dc807b6ef97b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.248388:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.248394:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.248396:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127002.248398:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191a00, rc 0) 00000100:00100000:3.0:1746127002.248415:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4229:x1830945991603968:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4619us (5117us total) trans 8589938174 rc 0/0 00000100:00100000:3.0:1746127002.248420:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17241 00000100:00100000:0.0:1746127002.249971:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991604480 00000100:00100000:0.0:1746127002.249978:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991604480 00002000:00100000:0.0:1746127002.250007:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880095c05c00 x1830945991604480/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.250015:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c05c00 with x1830945991604480 ext(0->1048575) 00002000:00010000:0.0:1746127002.250019:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c05c00 00000100:00100000:0.0:1746127002.250034:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8554 00000100:00100000:0.0:1746127002.250039:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991604480:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127002.257999:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.260682:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991604608 00000100:00100000:2.0:1746127002.260693:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991604608 00000100:00100000:2.0:1746127002.260764:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21489 00000100:00100000:2.0:1746127002.260772:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4228:x1830945991604608:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.260787:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.260801:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e89 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.260821:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.260823:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.260829:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.260841:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.260851:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801361ec200, rc 0) 00000100:00100000:2.0:1746127002.260893:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4228:x1830945991604608:12345-192.168.203.42@tcp:101:cat.0 Request processed in 122us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.260898:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21489 00000100:00100000:1.0:1746127002.261190:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991604480:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11150us (13095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127002.261198:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8554 00002000:00100000:1.0:1746127002.261206:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880095c05c00 x1830945991604480/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.261213:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c05c00 with x1830945991604480 ext(0->1048575) 00002000:00010000:1.0:1746127002.261217:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c05c00 00000100:00080000:0.0:1746127002.261335:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746127002.270503:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.270659:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.270744:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991604736 00000100:00100000:2.0:1746127002.270752:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991604736 00000100:00100000:0.0:1746127002.274829:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.275424:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991604864 00000100:00100000:3.0:1746127002.275432:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991604864 00000100:00100000:3.0:1746127002.275470:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21490 00000100:00100000:3.0:1746127002.275477:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4231:x1830945991604864:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.275491:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.275505:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e97 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.275529:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.275531:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.275538:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 18 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.275549:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 18 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.275557:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc6800, rc 0) 00000100:00100000:3.0:1746127002.275592:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4231:x1830945991604864:12345-192.168.203.42@tcp:101:cat.0 Request processed in 116us (4932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.275597:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21490 00000100:00100000:2.0:1746127002.276768:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991604992 00000100:00100000:2.0:1746127002.276774:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991604992 00000100:00100000:2.0:1746127002.276802:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17242 00000100:00100000:2.0:1746127002.276809:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4228:x1830945991604736:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.276824:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.276835:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e90 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.276872:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.276881:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.276893:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.276895:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127002.276898:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801361ed400, rc 0) 00000100:00100000:2.0:1746127002.276926:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4228:x1830945991604736:12345-192.168.203.42@tcp:101:cat.0 Request processed in 118us (6431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.276931:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17242 00000100:00100000:2.0:1746127002.276942:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17243 00000100:00100000:2.0:1746127002.276947:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4229:x1830945991604992:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127002.276954:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.276960:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801361eca00/0x34dc807b6ef97e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52e9e expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.276978:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801361eca00/0x34dc807b6ef97e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e9e expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.276985:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361eca00/0x34dc807b6ef97e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e9e expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.276993:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.276995:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127002.276997:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801361eca00, rc 0) 00000100:00100000:2.0:1746127002.277011:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4229:x1830945991604992:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 63us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.277015:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17243 00000100:00100000:0.0:1746127002.285181:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.285241:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.285308:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991605376 00000100:00100000:1.0:1746127002.285316:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991605376 00000100:00100000:1.0:1746127002.285366:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991605248 00000100:00100000:1.0:1746127002.285369:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991605248 00000100:00100000:1.0:1746127002.285385:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17244 00000100:00100000:1.0:1746127002.285392:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4229:x1830945991605376:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127002.285408:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.285410:0:7258:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746127002.285431:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361eca00/0x34dc807b6ef97e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e9e expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285446:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.285449:0:7258:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127002.285458:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6ef97e9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ea5 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285493:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.285503:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285510:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285517:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.285538:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285546:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 28 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.285557:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994235392:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127002.285625:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285632:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 7 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.285640:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994235520:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127002.285656:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.285752:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17245 00000100:00100000:1.0:1746127002.285758:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4231:x1830945991605248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.285764:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.285770:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52eac expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285792:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.285801:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285810:0:13448:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.285818:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.285828:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.285830:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746127002.285832:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.285837:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7200, rc 0) 00000100:00100000:1.0:1746127002.285857:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4231:x1830945991605248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 99us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.285863:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17245 00000100:00100000:0.0:1746127002.286701:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.286868:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991605632 00000100:00100000:1.0:1746127002.286871:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991605632 00002000:00100000:1.0:1746127002.286894:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88011dc61f80 x1830945991605632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.286903:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc61f80 with x1830945991605632 ext(1048576->2097151) 00002000:00010000:1.0:1746127002.286907:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc61f80 00000100:00100000:1.0:1746127002.286918:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8555 00000100:00100000:1.0:1746127002.286922:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991605632:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127002.292273:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.292383:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991605760 00000100:00100000:2.0:1746127002.292391:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991605760 00010000:00010000:2.0:1746127002.292421:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.292516:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994235392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127002.292527:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994235520:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.292574:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10043 00000100:00100000:2.0:1746127002.292582:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991605760:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.292592:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.292600:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.292609:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.292626:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801361ed400/0x34dc807b6ef97db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e90 expref: 29 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.292645:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.292648:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.292656:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.292659:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.292687:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991605760:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 108us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.292692:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10043 00000100:00100000:0.0:1746127002.292998:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.293030:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991605888 00000100:00100000:3.0:1746127002.293034:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991605888 00010000:00010000:3.0:1746127002.293049:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 8 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.293078:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10044 00000100:00100000:3.0:1746127002.293083:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2028:x1830945991605888:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.293090:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.293093:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 8 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.293100:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 8 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.293111:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6ef975d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e5f expref: 8 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.293121:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.293124:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.293148:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.293153:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.293161:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.293174:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.293191:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2028:x1830945991605888:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 108us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.293196:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10044 00010000:00010000:1.0:1746127002.293290:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.293297:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.293302:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7258 initiator: MDT0 00000040:00080000:1.0:1746127002.293807:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1371, 88 off128248 00000004:00080000:1.0:1746127002.293812:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335682834ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293834:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1392, 88 off130184 00000004:00080000:1.0:1746127002.293837:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335707531ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.293857:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1393, 88 off130272 00000004:00080000:1.0:1746127002.293860:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335730399ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.293867:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1372, 88 off128336 00000004:00080000:1.0:1746127002.293869:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335739624ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293875:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1373, 88 off128424 00000004:00080000:1.0:1746127002.293877:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335747614ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293882:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1394, 88 off130360 00000004:00080000:1.0:1746127002.293884:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335755246ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.293890:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1395, 88 off130448 00000004:00080000:1.0:1746127002.293892:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335762736ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.293898:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1396, 88 off130536 00000004:00080000:1.0:1746127002.293901:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335771271ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.293907:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1374, 88 off128512 00000004:00080000:1.0:1746127002.293910:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335780329ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293917:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1397, 88 off130624 00000004:00080000:1.0:1746127002.293920:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335790349ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.293926:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1375, 88 off128600 00000004:00080000:1.0:1746127002.293929:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335799270ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293936:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1398, 88 off130712 00000004:00080000:1.0:1746127002.293938:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335808619ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127002.293945:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1376, 88 off128688 00000004:00080000:1.0:1746127002.293948:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335818652ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293955:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1377, 88 off128776 00000004:00080000:1.0:1746127002.293957:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335828165ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293964:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1378, 88 off128864 00000004:00080000:1.0:1746127002.293967:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335837426ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293975:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1379, 88 off128952 00000004:00080000:1.0:1746127002.293977:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897335847700ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127002.293985:0:7258:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1399, 88 off130800 00000004:00080000:1.0:1746127002.293987:0:7258:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897335857665ns, next at 895431202182ns, rc = 0 00000100:00100000:0.0:1746127002.299018:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991605632:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12083us (12306us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127002.299031:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8555 00002000:00100000:0.0:1746127002.299042:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88011dc61f80 x1830945991605632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.299052:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc61f80 with x1830945991605632 ext(1048576->2097151) 00002000:00010000:0.0:1746127002.299067:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc61f80 00000001:00080000:3.0:1746127002.300547:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938175 is committed 00000004:00080000:3.0:1746127002.300556:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1374 committed 00000004:00080000:3.0:1746127002.300564:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1354 committed 00000004:00080000:3.0:1746127002.300582:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1353 committed 00000004:00080000:3.0:1746127002.300584:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1352 committed 00000004:00080000:3.0:1746127002.300585:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1351 committed 00000004:00080000:3.0:1746127002.300587:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1373 committed 00000004:00080000:3.0:1746127002.300589:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1350 committed 00000004:00080000:3.0:1746127002.300590:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1372 committed 00000004:00080000:3.0:1746127002.300591:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1349 committed 00000004:00080000:3.0:1746127002.300593:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1371 committed 00000004:00080000:3.0:1746127002.300594:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1370 committed 00000004:00080000:3.0:1746127002.300597:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1369 committed 00000004:00080000:3.0:1746127002.300598:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1348 committed 00000004:00080000:3.0:1746127002.300600:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1347 committed 00000004:00080000:3.0:1746127002.300601:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1368 committed 00000004:00080000:3.0:1746127002.300602:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1367 committed 00000004:00080000:3.0:1746127002.300604:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1346 committed 00000001:00080000:3.0:1746127002.300614:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938171 is committed 00000001:00080000:3.0:1746127002.300618:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938170 is committed 00010000:00010000:1.0:1746127002.300731:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 12 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.300744:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.300747:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746127002.300751:0:7258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.300758:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236032:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746127002.300761:0:7258:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.300767:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.300804:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.300827:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.300840:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.300857:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746127002.300861:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994235648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.300874:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.300891:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.300902:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746127002.300902:0:7258:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.300914:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994236672:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127002.300924:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994236032 00000100:00100000:2.0:1746127002.300929:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994236032 00000100:00100000:1.0:1746127002.300935:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994236544 00000100:00100000:1.0:1746127002.300940:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994236544 00000100:00100000:2.0:1746127002.300958:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994235648 00000100:00100000:2.0:1746127002.300960:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994235648 00000100:00100000:1.0:1746127002.300967:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21491 00000100:00100000:1.0:1746127002.300975:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3782:x1830945994236032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.300980:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994236160 00000100:00100000:2.0:1746127002.300982:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994236160 00000100:00100000:2.0:1746127002.300995:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21492 00000100:00100000:2.0:1746127002.301000:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3782:x1830945994236544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.301098:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21493 00000100:00100000:1.0:1746127002.301103:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3782:x1830945994235648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127002.301113:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:2.0:1746127002.301116:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127002.301118:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127002.301120:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127002.301122:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:2.0:1746127002.301169:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3782:x1830945994236544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (326us total) trans 21474842836 rc 0/0 00000100:00100000:2.0:1746127002.301175:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21492 00002000:00010000:1.0:1746127002.301183:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746127002.301186:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00000100:00100000:2.0:1746127002.301188:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21494 00002000:00010000:1.0:1746127002.301188:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.301190:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.301192:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746127002.301193:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3782:x1830945994236160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.301231:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3782:x1830945994235648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (355us total) trans 21474842838 rc 0/0 00000100:00100000:1.0:1746127002.301237:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21493 00000100:00100000:2.0:1746127002.301247:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3782:x1830945994236160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (343us total) trans 21474842839 rc 0/0 00000100:00100000:2.0:1746127002.301252:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21494 00002000:00010000:1.0:1746127002.301266:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746127002.301268:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127002.301270:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127002.301271:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127002.301273:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000004:00080000:2.0:1746127002.301286:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c05880/2, rc 0, transno 21474842838 00000100:00100000:1.0:1746127002.301292:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3782:x1830945994236032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 319us (488us total) trans 21474842837 rc 0/0 00000100:00100000:2.0:1746127002.301293:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994235648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.301298:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21491 00000004:00080000:2.0:1746127002.301301:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede0700/2, rc 0, transno 21474842839 00000100:00100000:2.0:1746127002.301303:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236160:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127002.301311:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede1c00/2, rc 0, transno 21474842837 00000100:00100000:2.0:1746127002.301314:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236032:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127002.301320:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede2300/2, rc 0, transno 21474842836 00000100:00100000:2.0:1746127002.301322:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.301344:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746127002.301348:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.301357:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.301366:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.301383:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994236800 00000100:00100000:1.0:1746127002.301386:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994236800 00000100:00100000:0.0:1746127002.301641:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994235776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.301664:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.301975:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994235776 00000100:00100000:1.0:1746127002.301979:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994235776 00000100:00100000:2.0:1746127002.301981:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21495 00000100:00100000:0.0:1746127002.301986:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994236288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.301987:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3782:x1830945994236800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.301999:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21496 00000100:00100000:0.0:1746127002.302002:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.302004:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3784:x1830945994235776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.302015:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746127002.302019:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994235904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.302032:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.302043:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994236416:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.302047:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3782:x1830945994236800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (680us total) trans 21474842840 rc 0/0 00000100:00100000:2.0:1746127002.302052:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21495 00002000:00010000:1.0:1746127002.302052:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127002.302055:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00000100:00100000:0.0:1746127002.302068:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746127002.302070:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00000100:00100000:2.0:1746127002.302078:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994236288 00000100:00100000:2.0:1746127002.302081:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994236288 00002000:00010000:1.0:1746127002.302081:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302083:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746127002.302100:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994235904 00000100:00100000:2.0:1746127002.302102:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994235904 00000100:00100000:1.0:1746127002.302109:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994235776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (444us total) trans 21474842841 rc 0/0 00000100:00100000:1.0:1746127002.302115:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21496 00000100:00100000:2.0:1746127002.302117:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994236416 00000100:00100000:2.0:1746127002.302119:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994236416 00000100:00100000:1.0:1746127002.302148:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21497 00000100:00100000:1.0:1746127002.302154:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994236288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127002.302158:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21498 00000100:00100000:2.0:1746127002.302163:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994235904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.302222:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3784:x1830945994236288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (219us total) trans 21474842842 rc 0/0 00000100:00100000:0.0:1746127002.302236:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21499 00000100:00100000:0.0:1746127002.302242:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3784:x1830945994236416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127002.302288:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127002.302290:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127002.302292:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127002.302294:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127002.302296:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:0.0:1746127002.302314:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3784:x1830945994236416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (257us total) trans 21474842844 rc 0/0 00000100:00100000:0.0:1746127002.302319:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21499 00000100:00100000:0.0:1746127002.302340:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994237056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.302357:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.302367:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994237568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.302378:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127002.302386:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746127002.302390:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994236928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.302401:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.302427:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21497 00000100:00100000:2.0:1746127002.302430:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994237056 00000100:00100000:3.0:1746127002.302433:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994237568 00000100:00100000:2.0:1746127002.302433:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994237056 00000100:00100000:3.0:1746127002.302436:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994237568 00000100:00100000:1.0:1746127002.302439:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994236928 00000100:00100000:1.0:1746127002.302441:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994236928 00000100:00100000:2.0:1746127002.302449:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21500 00000100:00100000:3.0:1746127002.302454:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21501 00000100:00100000:2.0:1746127002.302455:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3785:x1830945994237056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127002.302458:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3785:x1830945994237568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.302460:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21502 00000100:00100000:1.0:1746127002.302465:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3785:x1830945994236928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127002.302503:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237312:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127002.302515:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127002.302518:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302518:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127002.302519:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:2.0:1746127002.302521:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00000100:00100000:3.0:1746127002.302522:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746127002.302522:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746127002.302522:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302524:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302525:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302527:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746127002.302531:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127002.302547:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.302548:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3785:x1830945994237056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (190us total) trans 17179875575 rc 0/0 00000100:00100000:2.0:1746127002.302554:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21500 00000100:00100000:1.0:1746127002.302554:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3785:x1830945994236928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (151us total) trans 17179875577 rc 0/0 00000100:00100000:3.0:1746127002.302555:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746127002.302559:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.302560:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21502 00000100:00100000:2.0:1746127002.302563:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994237312 00000100:00100000:2.0:1746127002.302565:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994237312 00000100:00100000:1.0:1746127002.302568:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994237824 00000100:00100000:1.0:1746127002.302571:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994237824 00000100:00100000:3.0:1746127002.302574:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127002.302575:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21503 00000100:00100000:3.0:1746127002.302580:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.302580:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3783:x1830945994237312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.302581:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994237184 00000100:00100000:1.0:1746127002.302583:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994237184 00000100:00100000:3.0:1746127002.302591:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127002.302592:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21504 00000100:00100000:1.0:1746127002.302597:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3783:x1830945994237824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.302610:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994237696 00000100:00100000:1.0:1746127002.302613:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994237696 00002000:00010000:2.0:1746127002.302617:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127002.302618:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:2.0:1746127002.302619:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127002.302620:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127002.302621:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127002.302622:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746127002.302622:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21505 00002000:00010000:2.0:1746127002.302623:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127002.302624:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127002.302625:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:1.0:1746127002.302625:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3783:x1830945994237184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127002.302626:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1746127002.302644:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3785:x1830945994237568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (265us total) trans 17179875576 rc 0/0 00000100:00100000:2.0:1746127002.302647:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3783:x1830945994237312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (124us total) trans 17179875578 rc 0/0 00000100:00100000:3.0:1746127002.302651:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21501 00000100:00100000:2.0:1746127002.302654:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21503 00000100:00100000:3.0:1746127002.302661:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21506 00000100:00100000:3.0:1746127002.302666:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994237696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127002.302667:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127002.302669:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302671:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302673:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302675:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000004:00080000:2.0:1746127002.302685:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8ee9180/2, rc 0, transno 21474842840 00000100:00100000:2.0:1746127002.302688:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994236800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127002.302692:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994237184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (118us total) trans 17179875579 rc 0/0 00000100:00100000:1.0:1746127002.302697:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21505 00000100:00100000:3.0:1746127002.302722:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994237696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (129us total) trans 17179875580 rc 0/0 00002000:00010000:1.0:1746127002.302726:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00000100:00100000:3.0:1746127002.302727:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21506 00002000:00010000:1.0:1746127002.302728:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302730:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302731:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127000 -> 1746127000 00002000:00010000:1.0:1746127002.302733:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000004:00080000:3.0:1746127002.302748:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c5bc700/2, rc 0, transno 17179875579 00000100:00100000:3.0:1746127002.302751:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.302754:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3784:x1830945994235904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 591us (721us total) trans 21474842843 rc 0/0 00000004:00080000:3.0:1746127002.302757:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c5bd500/2, rc 0, transno 17179875580 00000100:00100000:2.0:1746127002.302757:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994237824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (209us total) trans 17179875581 rc 0/0 00000100:00100000:1.0:1746127002.302759:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21498 00000100:00100000:3.0:1746127002.302760:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127002.302762:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21504 00000004:00080000:3.0:1746127002.302765:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c5be300/2, rc 0, transno 17179875578 00000100:00100000:3.0:1746127002.302768:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237312:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127002.302773:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c5bed80/2, rc 0, transno 17179875581 00000100:00100000:3.0:1746127002.302775:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994237824:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127002.302888:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c05f80/2, rc 0, transno 21474842843 00000100:00100000:1.0:1746127002.302892:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994235904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127002.302900:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede1180/2, rc 0, transno 21474842844 00000100:00100000:1.0:1746127002.302902:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994236416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127002.302908:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c06a00/2, rc 0, transno 21474842841 00000100:00100000:1.0:1746127002.302910:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994235776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127002.302916:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede3b80/2, rc 0, transno 21474842842 00000100:00100000:1.0:1746127002.302918:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994236288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127002.304659:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994237440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.304697:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746127002.304727:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dc62680/2, rc 0, transno 17179875575 00000100:00100000:0.0:1746127002.304732:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994237056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127002.304739:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c5be680/2, rc 0, transno 17179875576 00000100:00100000:0.0:1746127002.304741:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994237568:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127002.304751:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dc61c00/2, rc 0, transno 17179875577 00000100:00100000:0.0:1746127002.304754:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994236928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.304779:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994237440 00000100:00100000:0.0:1746127002.304783:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994237440 00000100:00100000:0.0:1746127002.304818:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21507 00000100:00100000:0.0:1746127002.304827:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994237440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127002.304916:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3785:x1830945994237440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (218us total) trans 17179875582 rc 0/0 00000100:00100000:0.0:1746127002.304921:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21507 00000004:00080000:0.0:1746127002.304940:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c5bce00/2, rc 0, transno 17179875582 00000100:00100000:0.0:1746127002.304942:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994237440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127002.306216:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.306537:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991606016 00000100:00100000:2.0:1746127002.306544:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991606016 00000100:00100000:2.0:1746127002.306587:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21508 00000100:00100000:2.0:1746127002.306593:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4228:x1830945991606016:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.306609:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127002.306847:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994236672:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127002.306878:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6ef97e9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 12 pid: 7258 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746127002.306903:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.306927:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450c800, rc 0) 00000100:00100000:0.0:1746127002.306961:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4229:x1830945991605376:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 21570us (21786us total) trans 8589938175 rc 0/0 00000100:00100000:0.0:1746127002.306967:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17244 00010000:00010000:2.0:1746127002.307044:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52eb3 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.307084:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.307086:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.307095:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 39 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.307109:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 39 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.307123:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfcc00, rc 0) 00000100:00100000:2.0:1746127002.307190:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4228:x1830945991606016:12345-192.168.203.42@tcp:101:cat.0 Request processed in 597us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.307197:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21508 00000100:00100000:0.0:1746127002.309018:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.309052:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.309156:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991606144 00000100:00100000:1.0:1746127002.309166:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991606144 00000100:00100000:1.0:1746127002.309210:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991606272 00000100:00100000:1.0:1746127002.309213:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991606272 00000100:00100000:1.0:1746127002.309231:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6560 00000100:00100000:1.0:1746127002.309237:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4231:x1830945991606144:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:3.0:1746127002.309251:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6561 00000100:00100000:3.0:1746127002.309263:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4229:x1830945991606272:12345-192.168.203.42@tcp:49:multiop.0 00000100:00100000:1.0:1746127002.309337:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4231:x1830945991606144:12345-192.168.203.42@tcp:49:cat.0 Request processed in 100us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.309343:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6560 00000100:00100000:3.0:1746127002.309347:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4229:x1830945991606272:12345-192.168.203.42@tcp:49:multiop.0 Request processed in 87us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.309353:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6561 00000100:00100000:0.0:1746127002.310641:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.310921:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991606400 00000100:00100000:1.0:1746127002.310930:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991606400 00000100:00100000:1.0:1746127002.310975:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17246 00000100:00100000:1.0:1746127002.310981:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4228:x1830945991606400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.310995:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.311020:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52eba expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.311072:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 28 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.311085:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 28 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.311099:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.311102:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746127002.311105:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d000, rc 0) 00000100:00100000:1.0:1746127002.311170:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4228:x1830945991606400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 189us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.311175:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17246 00000100:00100000:0.0:1746127002.321499:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.321596:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991606528 00000100:00100000:2.0:1746127002.321609:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991606528 00000100:00100000:2.0:1746127002.321677:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21509 00000100:00100000:2.0:1746127002.321687:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4229:x1830945991606528:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127002.321707:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.321725:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ec1 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.321757:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 14 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.321766:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 15 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.321774:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 30 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.321780:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.321781:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.321785:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [827392->1048575] (req 827392->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 15 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.321827:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 30 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.321839:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 30 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.321852:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994237952:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.321970:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 15 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.321978:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 15 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.321986:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994238080:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.322010:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 14 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.322017:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 14 pid: 11152 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127002.322031:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994238208:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.322049:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.327657:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.327692:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.328443:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991606784 00000100:00100000:3.0:1746127002.328452:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991606784 00000100:00100000:2.0:1746127002.328457:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991607040 00000100:00100000:2.0:1746127002.328468:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991607040 00002000:00100000:3.0:1746127002.328491:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88008c5bd880 x1830945991606784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.328505:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bd880 with x1830945991606784 ext(1048576->2097151) 00002000:00100000:2.0:1746127002.328508:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094e6fb80 x1830945991607040/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:3.0:1746127002.328511:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c5bd880 00002000:00100000:2.0:1746127002.328517:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6fb80 with x1830945991607040 ext(1048576->2097151) 00002000:00010000:2.0:1746127002.328522:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6fb80 00000100:00100000:0.0:1746127002.328523:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994237952:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127002.328534:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994238080:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.328535:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8556 00000100:00100000:3.0:1746127002.328541:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991606784:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127002.328541:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994238208:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.328559:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8557 00000100:00100000:2.0:1746127002.328566:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991607040:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:0.0:1746127002.328571:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [827392->1048575] (req 827392->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 15 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.328586:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfc800, rc 0) 00000100:00100000:0.0:1746127002.328631:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4229:x1830945991606528:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6945us (7137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.328637:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21509 00000100:00100000:0.0:1746127002.329125:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.329165:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.329184:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.329205:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991607296 00000100:00100000:0.0:1746127002.329208:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991607296 00010000:00010000:0.0:1746127002.329224:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 15 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.329241:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991607168 00000100:00100000:0.0:1746127002.329243:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991607168 00010000:00010000:0.0:1746127002.329250:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.329259:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991607424 00000100:00100000:0.0:1746127002.329261:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991607424 00010000:00010000:0.0:1746127002.329268:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 15 pid: 11152 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746127002.329283:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10045 00000100:00100000:0.0:1746127002.329288:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991607296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127002.329296:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127002.329309:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 15 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.329317:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 15 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.329336:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967bec00/0x34dc807b6ef97b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e7b expref: 15 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.329350:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.329355:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10046 00000100:00100000:1.0:1746127002.329366:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991607168:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127002.329367:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991607296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.329373:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10045 00010000:00010000:1.0:1746127002.329376:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.329393:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.329405:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.329407:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10047 00000100:00100000:0.0:1746127002.329412:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991607424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127002.329417:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.329428:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967bf800/0x34dc807b6ef979c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e74 expref: 31 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.331171:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 15 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127002.331184:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 15 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127002.331204:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008a408a00/0x34dc807b6ef96ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e35 expref: 15 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127002.331215:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.331217:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.331222:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.331229:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.331257:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.331268:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994238336:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127002.331329:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746127002.332041:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.332107:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991607168:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2738us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.332119:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10046 00000100:00100000:0.0:1746127002.341742:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.341822:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994238336:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127002.341846:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.341904:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991607424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 12491us (12718us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.341911:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991607040:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 13343us (14216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127002.341915:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10047 00000100:00100000:0.0:1746127002.341921:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8557 00002000:00100000:0.0:1746127002.341931:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094e6fb80 x1830945991607040/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.341939:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6fb80 with x1830945991607040 ext(1048576->2097151) 00002000:00010000:0.0:1746127002.341944:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6fb80 00000100:00100000:0.0:1746127002.341963:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991607680 00000100:00100000:0.0:1746127002.341969:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991607680 00002000:00100000:0.0:1746127002.341990:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (827392->831487) req@ffff880094e6d180 x1830945991607680/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.341997:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d180 with x1830945991607680 ext(827392->831487) 00002000:00010000:0.0:1746127002.342000:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6d180 00000100:00100000:0.0:1746127002.342763:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8558 00000100:00100000:0.0:1746127002.342772:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991607680:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127002.343044:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991607680:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 273us (1309us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127002.343051:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8558 00002000:00100000:0.0:1746127002.343069:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (827392->831487) req@ffff880094e6d180 x1830945991607680/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.343076:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d180 with x1830945991607680 ext(827392->831487) 00002000:00010000:0.0:1746127002.343080:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6d180 00000100:00100000:3.0:1746127002.344583:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991606784:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16037us (16929us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127002.344592:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8556 00002000:00100000:3.0:1746127002.344599:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88008c5bd880 x1830945991606784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.344607:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bd880 with x1830945991606784 ext(1048576->2097151) 00002000:00010000:3.0:1746127002.344611:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c5bd880 00000100:00100000:0.0:1746127002.350228:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.350661:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991607808 00000100:00100000:2.0:1746127002.350674:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991607808 00000100:00100000:2.0:1746127002.350742:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21510 00000100:00100000:2.0:1746127002.350750:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4228:x1830945991607808:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.350770:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.350791:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ec8 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.350819:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.350821:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.350829:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.350844:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 31 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.350859:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10600, rc 0) 00000100:00100000:2.0:1746127002.350911:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4228:x1830945991607808:12345-192.168.203.42@tcp:101:cat.0 Request processed in 162us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.350917:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21510 00000100:00100000:0.0:1746127002.355472:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.365957:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.365993:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.366027:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991607936 00000100:00100000:0.0:1746127002.366035:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991607936 00000100:00100000:0.0:1746127002.366089:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21511 00000100:00100000:0.0:1746127002.366097:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4231:x1830945991607936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.366113:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127002.366141:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991608064 00000100:00100000:2.0:1746127002.366146:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991608064 00010000:00010000:0.0:1746127002.366147:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ecf expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.366177:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21512 00010000:00010000:0.0:1746127002.366178:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.366180:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127002.366183:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4229:x1830945991608064:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127002.366187:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.366190:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.366208:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ed6 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.366211:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.366220:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e88e600, rc 0) 00010000:00010000:2.0:1746127002.366226:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 17 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.366234:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 21 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.366241:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.366247:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.366248:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.366251:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 21 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.366260:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4231:x1830945991607936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 164us (10849us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.366266:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21511 00010000:00010000:2.0:1746127002.366284:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.366295:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 38 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.366307:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994238464:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.366368:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991608320 00000100:00100000:2.0:1746127002.366371:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991608320 00002000:00100000:2.0:1746127002.366397:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094e6f800 x1830945991608320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.366407:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6f800 with x1830945991608320 ext(1048576->2097151) 00002000:00010000:2.0:1746127002.366410:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6f800 00000100:00100000:2.0:1746127002.366423:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8559 00000100:00100000:2.0:1746127002.366428:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991608320:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127002.367171:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 20 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.367181:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 20 pid: 9612 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.367189:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994238592:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.367225:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 17 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.367233:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 17 pid: 11152 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127002.367240:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994238720:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.367257:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.394494:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.394559:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994238464:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.394569:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994238592:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.396218:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991608448 00000100:00100000:2.0:1746127002.396228:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991608448 00000100:00100000:1.0:1746127002.396235:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127002.396267:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 39 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.396276:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.396293:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991608960 00000100:00100000:2.0:1746127002.396295:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991608960 00010000:00010000:2.0:1746127002.396305:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 18 pid: 11152 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.396332:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994238720:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.396361:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.396364:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991608704 00000100:00100000:0.0:1746127002.396368:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991608704 00010000:00010000:3.0:1746127002.396375:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11400, rc 0) 00002000:00100000:0.0:1746127002.396394:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012cc9c700 x1830945991608704/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.396402:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c700 with x1830945991608704 ext(1048576->2097151) 00002000:00010000:0.0:1746127002.396406:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9c700 00000100:00100000:3.0:1746127002.396416:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4229:x1830945991608064:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 30232us (30468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.396420:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8560 00000100:00100000:3.0:1746127002.396423:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21512 00000100:00100000:0.0:1746127002.396426:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2028:x1830945991608704:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127002.396463:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.396687:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991608320:12345-192.168.203.42@tcp:3:cat.0 Request processed in 30258us (30692us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127002.396693:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8559 00002000:00100000:3.0:1746127002.396698:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094e6f800 x1830945991608320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.396705:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6f800 with x1830945991608320 ext(1048576->2097151) 00002000:00010000:3.0:1746127002.396709:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6f800 00000100:00100000:1.0:1746127002.396824:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991608832 00000100:00100000:1.0:1746127002.396828:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991608832 00000100:00100000:2.0:1746127002.396834:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10048 00000100:00100000:2.0:1746127002.396841:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991608448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.396843:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 22 pid: 9612 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.396849:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127002.396861:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10049 00010000:00010000:2.0:1746127002.396863:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 39 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.396867:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991608960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.396873:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 39 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.396873:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.396881:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 18 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.396894:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801361ec200/0x34dc807b6ef97cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e89 expref: 39 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.396896:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 18 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.396910:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef96f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e3c expref: 18 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.396911:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127002.396924:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.396933:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991608448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 94us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.396939:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10048 00000100:00100000:2.0:1746127002.396950:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10050 00000100:00100000:2.0:1746127002.396954:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991608832:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.396960:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.396966:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 22 pid: 9612 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.396972:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991608960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 104us (694us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127002.396974:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 22 pid: 9612 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.396977:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10049 00010000:00010000:2.0:1746127002.396985:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136bc6800/0x34dc807b6ef97d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e97 expref: 22 pid: 9612 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.396993:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.396994:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.397001:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 21 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.397008:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 21 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.397035:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 21 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.397047:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994238848:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127002.397114:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.410392:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.410999:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991609088 00000100:00100000:3.0:1746127002.411007:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991609088 00000100:00100000:3.0:1746127002.411089:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21513 00000100:00100000:3.0:1746127002.411098:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4226:x1830945991609088:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127002.411117:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.411161:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52edd expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.411189:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.411197:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.411199:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.411202:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [188416->1048575] (req 188416->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.411234:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.411245:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 13 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.411258:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994238976:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.411358:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.415813:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.415886:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991609344 00000100:00100000:1.0:1746127002.415895:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991609344 00002000:00100000:1.0:1746127002.415941:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1212416->1216511) req@ffff880094e6ed80 x1830945991609344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.415952:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6ed80 with x1830945991609344 ext(1212416->1216511) 00002000:00010000:1.0:1746127002.415958:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6ed80 00000100:00100000:2.0:1746127002.416053:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994238848:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127002.416083:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.416142:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991608832:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 19170us (19661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.416151:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10050 00000100:00100000:0.0:1746127002.416842:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991608704:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 20414us (20607us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127002.416848:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8560 00002000:00100000:0.0:1746127002.416854:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012cc9c700 x1830945991608704/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.416861:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c700 with x1830945991608704 ext(1048576->2097151) 00002000:00010000:0.0:1746127002.416865:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9c700 00000100:00100000:0.0:1746127002.416881:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8561 00000100:00100000:0.0:1746127002.416886:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991609344:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127002.416969:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991609344:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 83us (1165us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127002.416973:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8561 00002000:00100000:0.0:1746127002.416977:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1212416->1216511) req@ffff880094e6ed80 x1830945991609344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.416983:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6ed80 with x1830945991609344 ext(1212416->1216511) 00002000:00010000:0.0:1746127002.416986:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6ed80 00000100:00100000:3.0:1746127002.417921:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994238976:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.417944:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [188416->1048575] (req 188416->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.417968:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc7a00, rc 0) 00000100:00100000:3.0:1746127002.417996:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4226:x1830945991609088:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6900us (7616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.418003:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21513 00000100:00100000:0.0:1746127002.418516:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.419252:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.419268:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.419282:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991609600 00000100:00100000:0.0:1746127002.419287:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991609600 00000100:00100000:0.0:1746127002.419312:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991609856 00000100:00100000:0.0:1746127002.419314:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991609856 00000100:00100000:0.0:1746127002.419324:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21514 00000100:00100000:0.0:1746127002.419328:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991609600:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.419342:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.419356:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6ef982f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ee4 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.419401:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994239104:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.419511:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.419525:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21515 00000100:00100000:0.0:1746127002.419530:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991609856:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.419535:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.419542:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ef2 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.419551:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.419553:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.419560:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.419572:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.419580:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f121e00, rc 0) 00000100:00100000:0.0:1746127002.419594:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991609856:12345-192.168.203.42@tcp:101:cat.0 Request processed in 64us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.419598:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21515 00000100:00100000:0.0:1746127002.419623:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.419633:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991609728 00000100:00100000:0.0:1746127002.419635:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991609728 00000100:00100000:0.0:1746127002.419647:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21516 00000100:00100000:0.0:1746127002.419650:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991609728:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.419658:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.419666:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f120800/0x34dc807b6ef983d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52eeb expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.419687:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994239232:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.419701:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.419737:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.419745:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991609984 00000100:00100000:0.0:1746127002.419747:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991609984 00000100:00100000:1.0:1746127002.420141:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991609472 00000100:00100000:1.0:1746127002.420145:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991609472 00002000:00100000:1.0:1746127002.420171:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (827392->1048575) req@ffff880094e6c000 x1830945991609472/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.420179:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6c000 with x1830945991609472 ext(827392->1048575) 00010000:00010000:1.0:1746127002.420184:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 14 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.420195:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 14 pid: 16295 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746127002.420201:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e6c000 00000100:00100000:1.0:1746127002.420212:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1882 00000100:00100000:1.0:1746127002.420216:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991609472:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127002.423022:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21517 00000100:00100000:3.0:1746127002.423036:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991609984:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.423062:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.423080:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ef9 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.423102:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.423104:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.423112:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 41 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.423138:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 41 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.423154:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc7400, rc 0) 00000100:00100000:3.0:1746127002.423194:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991609984:12345-192.168.203.42@tcp:101:cat.0 Request processed in 163us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.423200:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21517 00000100:00100000:0.0:1746127002.424383:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.424517:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991610112 00000100:00100000:1.0:1746127002.424525:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991610112 00000100:00100000:1.0:1746127002.424563:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21518 00000100:00100000:1.0:1746127002.424570:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4231:x1830945991610112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.424581:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.424592:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f00 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.424608:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.424609:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.424615:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 17 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.424626:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 17 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.424634:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094504800, rc 0) 00000100:00100000:1.0:1746127002.424657:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4231:x1830945991610112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.424662:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21518 00002000:00010000:2.0:1746127002.426477:0:12340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746127000 -> 1746127001 00002000:00010000:2.0:1746127002.426483:0:12340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127000 -> 1746127001 00002000:00010000:2.0:1746127002.426485:0:12340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746127000 -> 1746127001 00000100:00100000:2.0:1746127002.426501:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994239104:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.426530:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6ef982f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ee4 expref: 34 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.426541:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6ef982f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ee4 expref: 34 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.426766:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450cc00, rc 0) 00000100:00100000:2.0:1746127002.426806:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991609600:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7476us (7552us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.426813:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21514 00002000:00010000:2.0:1746127002.429628:0:16295:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127000 -> 1746127001 00002000:00010000:2.0:1746127002.429635:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127000 -> 1746127001 00002000:00010000:2.0:1746127002.429637:0:16295:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127000 -> 1746127001 00000100:00100000:2.0:1746127002.429659:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994239232:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.429692:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f120800/0x34dc807b6ef983d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eeb expref: 40 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.429704:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f120800/0x34dc807b6ef983d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eeb expref: 40 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.429725:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f120800, rc 0) 00000100:00100000:2.0:1746127002.429773:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991609728:12345-192.168.203.42@tcp:101:cat.0 Request processed in 10119us (10147us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.429781:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21516 00000100:00100000:1.0:1746127002.432972:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991609472:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 12745us (14447us total) trans 21474842845 rc 0/0 00000100:00100000:1.0:1746127002.432983:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1882 00002000:00100000:1.0:1746127002.432994:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (827392->1048575) req@ffff880094e6c000 x1830945991609472/t21474842845(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.433004:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6c000 with x1830945991609472 ext(827392->1048575) 00010000:00010000:1.0:1746127002.433014:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 17 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.433028:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 17 pid: 16295 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746127002.433034:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e6c000 00000100:00100000:0.0:1746127002.435321:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.446496:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991610368 00000100:00100000:1.0:1746127002.446509:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991610368 00002000:00100000:1.0:1746127002.446556:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800997d9c00 x1830945991610368/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.446566:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9c00 with x1830945991610368 ext(1048576->2097151) 00002000:00010000:1.0:1746127002.446571:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997d9c00 00000100:00100000:0.0:1746127002.446591:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.446600:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8562 00000100:00100000:1.0:1746127002.446607:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991610368:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127002.446666:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.446685:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991610752 00000100:00100000:1.0:1746127002.446687:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991610752 00002000:00100000:1.0:1746127002.446702:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800997dad80 x1830945991610752/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.446714:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dad80 with x1830945991610752 ext(2097152->4194303) 00002000:00010000:1.0:1746127002.446717:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997dad80 00000100:00100000:1.0:1746127002.446729:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8563 00000100:00100000:1.0:1746127002.446734:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991610752:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127002.453587:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991610496 00000100:00100000:2.0:1746127002.453603:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991610496 00010000:00010000:2.0:1746127002.453647:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.453699:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10051 00000100:00100000:2.0:1746127002.453706:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991610496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.453720:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.453746:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.453759:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.453783:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfc800/0x34dc807b6ef980c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 827392->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec1 expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.453803:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.453805:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.453811:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.453820:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.453855:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.453869:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994239360:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127002.453967:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.454801:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.454848:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991611008 00000100:00100000:3.0:1746127002.454853:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991611008 00002000:00100000:3.0:1746127002.454885:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800997dbb80 x1830945991611008/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.454894:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dbb80 with x1830945991611008 ext(2097152->4194303) 00002000:00010000:3.0:1746127002.454898:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997dbb80 00000100:00100000:3.0:1746127002.454914:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8564 00000100:00100000:3.0:1746127002.454919:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991611008:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127002.458449:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994239360:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127002.458475:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.458515:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991610496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4808us (11922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.458527:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10051 00000100:00100000:2.0:1746127002.469683:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.469937:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991610752:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23201us (23269us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127002.469958:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8563 00002000:00100000:2.0:1746127002.469970:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800997dad80 x1830945991610752/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.469979:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dad80 with x1830945991610752 ext(2097152->4194303) 00002000:00010000:2.0:1746127002.469985:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997dad80 00000100:00100000:2.0:1746127002.470009:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991611264 00000100:00100000:2.0:1746127002.470015:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991611264 00002000:00100000:2.0:1746127002.470042:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (188416->192511) req@ffff8800a8ee8380 x1830945991611264/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.470065:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee8380 with x1830945991611264 ext(188416->192511) 00002000:00010000:2.0:1746127002.470068:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee8380 00000100:00100000:2.0:1746127002.470093:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8565 00000100:00100000:2.0:1746127002.470100:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991611264:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127002.470222:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991611264:12345-192.168.203.42@tcp:3:cat.0 Request processed in 123us (551us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127002.470228:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8565 00002000:00100000:2.0:1746127002.470232:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (188416->192511) req@ffff8800a8ee8380 x1830945991611264/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.470238:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee8380 with x1830945991611264 ext(188416->192511) 00002000:00010000:2.0:1746127002.470240:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee8380 00000100:00100000:1.0:1746127002.477520:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991610368:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 30902us (42197us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127002.477536:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8562 00002000:00100000:1.0:1746127002.477547:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800997d9c00 x1830945991610368/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.477557:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9c00 with x1830945991610368 ext(1048576->2097151) 00002000:00010000:1.0:1746127002.477562:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997d9c00 00000100:00100000:0.0:1746127002.483127:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.483599:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.483629:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.483688:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991611392 00000100:00100000:3.0:1746127002.483697:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991611392 00000100:00100000:3.0:1746127002.483742:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991611520 00000100:00100000:3.0:1746127002.483745:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991611520 00000100:00100000:3.0:1746127002.483755:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991611648 00000100:00100000:3.0:1746127002.483757:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991611648 00000100:00100000:3.0:1746127002.483774:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21519 00000100:00100000:3.0:1746127002.483781:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991611392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.483800:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.483818:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9852 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f07 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.483873:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994239488:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127002.483961:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.483986:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21520 00000100:00100000:3.0:1746127002.483991:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991611520:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.483998:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.484005:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f0e expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.484016:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.484018:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.484026:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 19 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.484042:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 19 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.484052:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450dc00, rc 0) 00000100:00100000:3.0:1746127002.484088:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991611520:12345-192.168.203.42@tcp:101:cat.0 Request processed in 95us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.484093:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21520 00000100:00100000:3.0:1746127002.484112:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21521 00000100:00100000:3.0:1746127002.484143:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991611648:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.484152:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.484162:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f15 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.484173:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.484175:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.484179:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 20 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.484189:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 20 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.484196:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450cc00, rc 0) 00000100:00100000:3.0:1746127002.484213:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991611648:12345-192.168.203.42@tcp:101:cat.0 Request processed in 96us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.484218:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21521 00000100:00100000:2.0:1746127002.485545:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991611008:12345-192.168.203.42@tcp:3:cat.0 Request processed in 30619us (30739us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127002.485556:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8564 00002000:00100000:2.0:1746127002.485567:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800997dbb80 x1830945991611008/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.485577:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997dbb80 with x1830945991611008 ext(2097152->4194303) 00002000:00010000:2.0:1746127002.485582:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997dbb80 00000100:00100000:0.0:1746127002.491874:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.492262:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994239488:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127002.492296:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9852 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f07 expref: 18 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.492311:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9852 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f07 expref: 18 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.492341:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfce00, rc 0) 00000100:00100000:3.0:1746127002.492388:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991611392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8606us (9271us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127002.492396:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21519 00000100:00100000:3.0:1746127002.492422:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991611776 00000100:00100000:3.0:1746127002.492428:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991611776 00000100:00100000:3.0:1746127002.492456:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21522 00000100:00100000:3.0:1746127002.492461:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4226:x1830945991611776:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127002.492475:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.492491:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f1c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.492536:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 19 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.492543:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.492545:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.492548:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->1212415] (req 1048576->1212415) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.492576:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 19 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.492588:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 19 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.492601:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994239616:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.492654:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.502723:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994239616:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.502757:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->1212415] (req 1048576->1212415) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.505224:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfc800, rc 0) 00000100:00100000:3.0:1746127002.505303:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4226:x1830945991611776:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 12837us (13434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.505313:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21522 00000100:00100000:0.0:1746127002.512722:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.512776:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.512790:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991612288 00000100:00100000:2.0:1746127002.512801:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991612288 00002000:00100000:2.0:1746127002.512849:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800997d8a80 x1830945991612288/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.512859:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d8a80 with x1830945991612288 ext(2097152->4194303) 00002000:00010000:2.0:1746127002.512866:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d8a80 00000100:00100000:2.0:1746127002.512897:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991611904 00000100:00100000:2.0:1746127002.512900:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991611904 00002000:00100000:2.0:1746127002.512911:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1216511) req@ffff8800997da680 x1830945991611904/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.512918:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997da680 with x1830945991611904 ext(1048576->1216511) 00010000:00010000:2.0:1746127002.512926:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 21 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.512938:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 21 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746127002.512944:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800997da680 00000100:00100000:2.0:1746127002.512970:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1883 00000100:00100000:2.0:1746127002.512977:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991611904:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127002.513006:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8566 00000100:00100000:0.0:1746127002.513012:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991612288:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127002.513684:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.513745:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991612416 00000100:00100000:1.0:1746127002.513750:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991612416 00002000:00100000:1.0:1746127002.513769:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800997daa00 x1830945991612416/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.513776:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997daa00 with x1830945991612416 ext(2097152->4194303) 00002000:00010000:1.0:1746127002.513779:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997daa00 00000100:00100000:1.0:1746127002.513805:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8567 00000100:00100000:1.0:1746127002.513810:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991612416:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127002.521653:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.521704:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991612544 00000100:00100000:0.0:1746127002.521713:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991612544 00000100:00100000:0.0:1746127002.521762:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21523 00000100:00100000:0.0:1746127002.521771:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991612544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.521789:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.521808:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef986e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f23 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.521859:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994239744:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.522088:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.527458:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994239744:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127002.527498:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef986e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f23 expref: 41 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.527511:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01000/0x34dc807b6ef986e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f23 expref: 41 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.527542:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01000, rc 0) 00000100:00100000:0.0:1746127002.527587:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991612544:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5816us (5944us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127002.527595:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21523 00000100:00100000:2.0:1746127002.527920:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991611904:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 14942us (15142us total) trans 17179875583 rc 0/0 00000100:00100000:2.0:1746127002.527930:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1883 00002000:00100000:2.0:1746127002.527938:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1216511) req@ffff8800997da680 x1830945991611904/t17179875583(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.527947:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997da680 with x1830945991611904 ext(1048576->1216511) 00010000:00010000:2.0:1746127002.527955:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 24 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.527967:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 24 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746127002.527975:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800997da680 00000100:00100000:0.0:1746127002.532532:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.534733:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991612672 00000100:00100000:3.0:1746127002.534746:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991612672 00010000:00010000:3.0:1746127002.534787:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 24 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.534822:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10052 00000100:00100000:3.0:1746127002.534829:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991612672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.534842:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.534862:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 24 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.534873:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 24 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.534896:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6ef9821 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ed6 expref: 24 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.534964:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.534967:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.534975:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.534988:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.535023:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.535035:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994239872:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127002.535643:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.537246:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.537301:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991612928 00000100:00100000:2.0:1746127002.537310:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991612928 00002000:00100000:2.0:1746127002.537356:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800997db800 x1830945991612928/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.537365:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997db800 with x1830945991612928 ext(4194304->4829183) 00002000:00010000:2.0:1746127002.537370:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997db800 00000100:00100000:2.0:1746127002.537396:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8568 00000100:00100000:2.0:1746127002.537402:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991612928:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127002.543397:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994239872:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127002.543421:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.543467:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991612672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8637us (10942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.543479:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10052 00000100:00100000:1.0:1746127002.543695:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991612416:12345-192.168.203.42@tcp:3:cat.0 Request processed in 29884us (30011us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127002.543704:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8567 00002000:00100000:1.0:1746127002.543719:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800997daa00 x1830945991612416/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.543728:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997daa00 with x1830945991612416 ext(2097152->4194303) 00002000:00010000:1.0:1746127002.543733:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997daa00 00000100:00100000:0.0:1746127002.546611:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.546711:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991613184 00000100:00100000:1.0:1746127002.546719:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991613184 00002000:00100000:1.0:1746127002.546760:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1208320->1212415) req@ffff8800997d8380 x1830945991613184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.546776:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d8380 with x1830945991613184 ext(1208320->1212415) 00002000:00010000:1.0:1746127002.546781:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d8380 00000100:00100000:1.0:1746127002.546810:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8569 00000100:00100000:1.0:1746127002.546816:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991613184:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127002.547485:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991613184:12345-192.168.203.42@tcp:3:cat.0 Request processed in 666us (880us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127002.547492:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8569 00002000:00100000:1.0:1746127002.547498:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1208320->1212415) req@ffff8800997d8380 x1830945991613184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.547505:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d8380 with x1830945991613184 ext(1208320->1212415) 00002000:00010000:1.0:1746127002.547508:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d8380 00000100:00100000:2.0:1746127002.558586:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991612288:12345-192.168.203.42@tcp:3:cat.0 Request processed in 45562us (45861us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127002.558599:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8566 00002000:00100000:2.0:1746127002.558611:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800997d8a80 x1830945991612288/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.558619:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d8a80 with x1830945991612288 ext(2097152->4194303) 00002000:00010000:2.0:1746127002.558626:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d8a80 00000100:00100000:0.0:1746127002.558839:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.558954:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991613440 00000100:00100000:1.0:1746127002.558962:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991613440 00000100:00100000:1.0:1746127002.559011:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17247 00000100:00100000:1.0:1746127002.559017:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4234:x1830945991613440:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127002.559036:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.559063:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a17e9c00/0x34dc807b6ef9875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f2a expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.559163:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.559946:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.559960:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.559975:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.559981:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.559985:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560099:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560108:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560113:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127002.560122:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127002.560220:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560226:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560232:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560238:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560243:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012341b200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127002.560247:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560257:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560268:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127002.560270:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127002.560275:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560279:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b200/0x34dc807b6ef987c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560308:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560314:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560318:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560322:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012341ac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127002.560324:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560328:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560334:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58af00) 00010000:00010000:1.0:1746127002.560336:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127002.560338:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560341:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9883 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.560382:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a17e9c00/0x34dc807b6ef9875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 14 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.560395:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 13 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.560401:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.560403:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127002.560405:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341b000, rc 0) 00000100:00100000:1.0:1746127002.560450:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4234:x1830945991613440:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1432us (1611us total) trans 8589938176 rc 0/0 00000100:00100000:1.0:1746127002.560456:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17247 00000100:00100000:0.0:1746127002.566528:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991612928:12345-192.168.203.42@tcp:3:cat.0 Request processed in 29114us (29276us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746127002.566542:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8568 00002000:00100000:0.0:1746127002.566553:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800997db800 x1830945991612928/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.566563:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997db800 with x1830945991612928 ext(4194304->4829183) 00002000:00010000:0.0:1746127002.566569:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997db800 00000100:00100000:0.0:1746127002.567583:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.567630:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.567651:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991613696 00000100:00100000:0.0:1746127002.567660:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991613696 00000100:00100000:0.0:1746127002.567706:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991613568 00000100:00100000:0.0:1746127002.567709:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991613568 00000100:00100000:0.0:1746127002.567725:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21524 00000100:00100000:0.0:1746127002.567732:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991613696:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.567749:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.567768:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01200/0x34dc807b6ef9898 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f38 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.567827:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994240000:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.567966:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21525 00000100:00100000:0.0:1746127002.567972:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991613568:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.567981:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.567991:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd00600/0x34dc807b6ef989f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f31 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.568015:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994240128:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.569244:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.569320:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.569631:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.569667:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.569699:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991613952 00000100:00100000:0.0:1746127002.569706:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991613952 00000100:00100000:0.0:1746127002.569743:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991614208 00000100:00100000:0.0:1746127002.569745:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991614208 00000100:00100000:0.0:1746127002.569771:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6562 00000100:00100000:0.0:1746127002.569777:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4234:x1830945991613952:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746127002.570015:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4234:x1830945991613952:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 237us (385us total) trans 8589938177 rc 0/0 00000100:00100000:0.0:1746127002.570021:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6562 00000100:00100000:0.0:1746127002.570035:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6563 00000100:00100000:0.0:1746127002.570040:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4226:x1830945991614208:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746127002.570104:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4226:x1830945991614208:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 63us (436us total) trans 8589938178 rc 0/0 00000100:00100000:0.0:1746127002.570109:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6563 00000100:00100000:2.0:1746127002.578618:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994240128:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.578658:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd00600/0x34dc807b6ef989f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f31 expref: 18 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.578671:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd00600/0x34dc807b6ef989f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f31 expref: 18 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127002.579319:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994240000:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127002.579336:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01200/0x34dc807b6ef9898 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f38 expref: 22 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.579344:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01200/0x34dc807b6ef9898 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f38 expref: 22 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.579357:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01200, rc 0) 00010000:00010000:2.0:1746127002.580571:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00600, rc 0) 00000100:00100000:0.0:1746127002.580751:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991613696:12345-192.168.203.42@tcp:101:cat.0 Request processed in 13014us (13165us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127002.580760:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21524 00000100:00100000:2.0:1746127002.580847:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991613568:12345-192.168.203.42@tcp:101:cat.0 Request processed in 12874us (13215us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.580853:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21525 00000100:00100000:0.0:1746127002.592363:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.592718:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991614464 00000100:00100000:2.0:1746127002.592728:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991614464 00002000:00100000:2.0:1746127002.592773:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094824a80 x1830945991614464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.592783:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824a80 with x1830945991614464 ext(4194304->4829183) 00002000:00010000:2.0:1746127002.592788:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094824a80 00000100:00100000:2.0:1746127002.592815:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8570 00000100:00100000:2.0:1746127002.592822:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991614464:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127002.608572:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991614464:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15739us (16210us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127002.608585:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8570 00002000:00100000:2.0:1746127002.608598:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094824a80 x1830945991614464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.608608:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824a80 with x1830945991614464 ext(4194304->4829183) 00002000:00010000:2.0:1746127002.608614:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094824a80 00000100:00100000:0.0:1746127002.614249:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.614306:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.615927:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991614720 00000100:00100000:2.0:1746127002.615938:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991614720 00000100:00100000:2.0:1746127002.615978:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991614592 00000100:00100000:2.0:1746127002.615980:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991614592 00000100:00100000:2.0:1746127002.615999:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21526 00000100:00100000:2.0:1746127002.616006:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991614720:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.616025:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.616043:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6ef98a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f46 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.616106:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994240256:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127002.616207:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.616233:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21527 00000100:00100000:2.0:1746127002.616239:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991614592:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.616247:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.616257:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6ef98ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f3f expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.616283:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240384:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127002.616303:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.622555:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994240256:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.622594:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6ef98a6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f46 expref: 22 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.622609:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6ef98a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f46 expref: 22 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.622624:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6800, rc 0) 00000100:00100000:2.0:1746127002.622679:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991614720:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6672us (8439us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.622691:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21526 00000100:00100000:3.0:1746127002.622979:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240384:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127002.623001:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6ef98ad lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f3f expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.623012:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6ef98ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f3f expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.623024:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7e00, rc 0) 00000100:00100000:3.0:1746127002.623045:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991614592:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6805us (8738us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127002.623051:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21527 00000100:00100000:0.0:1746127002.625030:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.625159:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991614848 00000100:00100000:3.0:1746127002.625165:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991614848 00000100:00100000:3.0:1746127002.625507:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21528 00000100:00100000:3.0:1746127002.625514:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4234:x1830945991614848:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127002.625529:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.625544:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f4d expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.625569:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 13 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.625577:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 18 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.625583:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.625588:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.625590:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.625592:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3944448->4194303] (req 3944448->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 18 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.625618:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.625627:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 32 pid: 12333 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.625643:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240512:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.627030:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 18 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.627040:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 18 pid: 9611 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.627049:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240640:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.627093:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 13 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.627101:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 13 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.627109:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240768:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.627125:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.627683:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.627784:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.627831:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991615104 00000100:00100000:0.0:1746127002.627835:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991615104 00000100:00100000:0.0:1746127002.627868:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991614976 00000100:00100000:0.0:1746127002.627873:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991614976 00000100:00100000:0.0:1746127002.627886:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21529 00000100:00100000:0.0:1746127002.627892:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991615104:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.627904:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127002.627906:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21530 00000100:00100000:3.0:1746127002.627914:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991614976:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.627916:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00000/0x34dc807b6ef98bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f5b expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.627922:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.627930:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc10000/0x34dc807b6ef98c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f54 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.627949:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994240896:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.627986:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.628123:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994241024:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127002.628758:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.630501:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.630578:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991615232 00000100:00100000:1.0:1746127002.630584:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994240896:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127002.630585:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991615232 00010000:00010000:1.0:1746127002.630614:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00000/0x34dc807b6ef98bb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f5b expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.630617:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 14 pid: 9612 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.630627:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00000/0x34dc807b6ef98bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f5b expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127002.630641:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10053 00010000:00010000:1.0:1746127002.630643:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00000, rc 0) 00000100:00100000:2.0:1746127002.630647:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991615232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.630658:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.630672:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 14 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127002.630680:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991615104:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2787us (2998us total) trans 0 rc 301/301 00010000:00010000:2.0:1746127002.630681:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 14 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127002.630688:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21529 00010000:00010000:2.0:1746127002.630703:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.630720:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991615232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.630726:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10053 00000100:00100000:3.0:1746127002.630904:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240512:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.630924:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240640:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.630934:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6ef9709 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e51 expref: 13 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.630944:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994240768:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.630964:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3944448->4194303] (req 3944448->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.630972:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc6200, rc 0) 00000100:00100000:3.0:1746127002.631004:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4234:x1830945991614848:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5491us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.631010:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21528 00000100:00100000:3.0:1746127002.632456:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994241024:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127002.632478:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc10000/0x34dc807b6ef98c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f54 expref: 19 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.632487:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10000/0x34dc807b6ef98c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f54 expref: 19 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.632495:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10000, rc 0) 00000100:00100000:3.0:1746127002.632533:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991614976:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4620us (4747us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127002.632539:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21530 00000100:00100000:0.0:1746127002.633496:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.633558:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991615360 00000100:00100000:2.0:1746127002.633565:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991615360 00010000:00010000:2.0:1746127002.633589:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 33 pid: 12333 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127002.633609:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10054 00000100:00100000:2.0:1746127002.633614:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991615360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.633625:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.633636:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 33 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.633645:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 33 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.633661:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f121e00/0x34dc807b6ef9836 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef2 expref: 33 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.633676:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.633697:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991615360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.633702:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10054 00000100:00100000:0.0:1746127002.641346:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.641445:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991615488 00000100:00100000:2.0:1746127002.641456:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991615488 00010000:00010000:2.0:1746127002.641497:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 18 pid: 9611 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746127002.641541:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10055 00000100:00100000:2.0:1746127002.641549:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991615488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.641565:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.641585:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 18 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.641598:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 18 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.641624:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9859 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f0e expref: 18 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.641638:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.641640:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.641647:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 17 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.641656:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 17 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.641690:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 17 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.641703:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994241152:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127002.641803:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.645779:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994241152:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127002.645803:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.645857:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991615488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4308us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.645869:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10055 00000100:00100000:0.0:1746127002.647245:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.647304:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991615744 00000100:00100000:2.0:1746127002.647311:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991615744 00002000:00100000:2.0:1746127002.647356:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (3944448->3948543) req@ffff880094827100 x1830945991615744/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.647372:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094827100 with x1830945991615744 ext(3944448->3948543) 00002000:00010000:2.0:1746127002.647376:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094827100 00000100:00100000:2.0:1746127002.647400:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8571 00000100:00100000:2.0:1746127002.647406:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991615744:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127002.647611:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991615744:12345-192.168.203.42@tcp:3:cat.0 Request processed in 204us (369us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127002.647617:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8571 00002000:00100000:2.0:1746127002.647622:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (3944448->3948543) req@ffff880094827100 x1830945991615744/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.647630:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094827100 with x1830945991615744 ext(3944448->3948543) 00002000:00010000:2.0:1746127002.647634:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094827100 00000100:00100000:0.0:1746127002.652396:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.652854:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991615872 00000100:00100000:3.0:1746127002.652863:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991615872 00000100:00100000:3.0:1746127002.652912:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21531 00000100:00100000:3.0:1746127002.652919:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4234:x1830945991615872:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127002.652938:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.653374:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f62 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.653558:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.653567:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 22 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.653573:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 39 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.653578:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.653579:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.653582:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 22 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.653610:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 39 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.653620:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 39 pid: 9611 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.653636:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994241280:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.653737:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 22 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.653745:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 22 pid: 9611 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.653752:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994241408:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.653774:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.653781:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 16 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.653787:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994241536:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.653798:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.659580:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.659612:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.659670:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991616128 00000100:00100000:1.0:1746127002.659678:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991616128 00000100:00100000:2.0:1746127002.659693:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991616000 00000100:00100000:2.0:1746127002.659697:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991616000 00010000:00010000:2.0:1746127002.659714:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 23 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.659714:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 17 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127002.659740:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10056 00000100:00100000:1.0:1746127002.659746:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991616128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.659757:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127002.659818:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994241280:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.659827:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994241408:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.659833:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994241536:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.659859:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 23 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.659877:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11000, rc 0) 00010000:00010000:1.0:1746127002.659905:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 17 pid: 9612 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.659915:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 17 pid: 9612 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.659917:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4234:x1830945991615872:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6999us (7530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.659924:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21531 00010000:00010000:1.0:1746127002.659935:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f44800/0x34dc807b6ef9710 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e58 expref: 17 pid: 9612 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.659950:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.659967:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991616128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 222us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.659972:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10056 00000100:00100000:1.0:1746127002.659984:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10057 00000100:00100000:1.0:1746127002.659988:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991616000:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.659994:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.659999:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 22 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.660005:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 22 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.660016:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450cc00/0x34dc807b6ef9860 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f15 expref: 22 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.660023:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.660036:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991616000:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 47us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.660040:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10057 00000100:00100000:0.0:1746127002.661179:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.661214:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991616256 00000100:00100000:1.0:1746127002.661219:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991616256 00010000:00010000:1.0:1746127002.661234:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 40 pid: 9611 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127002.661250:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10058 00000100:00100000:1.0:1746127002.661255:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991616256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.661262:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.661269:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 40 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.661277:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 40 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.661291:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136bc7400/0x34dc807b6ef9844 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ef9 expref: 40 pid: 9611 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746127002.661301:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.661304:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.661310:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.661317:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.661344:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.661356:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994241664:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127002.661725:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.665426:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994241664:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127002.665449:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.665497:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991616256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4239us (4319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.665508:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10058 00000100:00100000:0.0:1746127002.667787:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.667863:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991616512 00000100:00100000:2.0:1746127002.667872:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991616512 00002000:00100000:2.0:1746127002.667915:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (3432448->3436543) req@ffff88009cd65880 x1830945991616512/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.667924:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65880 with x1830945991616512 ext(3432448->3436543) 00002000:00010000:2.0:1746127002.667929:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd65880 00000100:00100000:2.0:1746127002.667950:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8572 00000100:00100000:2.0:1746127002.667956:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991616512:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127002.668743:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991616512:12345-192.168.203.42@tcp:3:cat.0 Request processed in 786us (961us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127002.668750:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8572 00002000:00100000:2.0:1746127002.668756:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (3432448->3436543) req@ffff88009cd65880 x1830945991616512/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.668763:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65880 with x1830945991616512 ext(3432448->3436543) 00002000:00010000:2.0:1746127002.668765:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd65880 00000100:00100000:0.0:1746127002.696112:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.696257:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991616768 00000100:00100000:1.0:1746127002.696266:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991616768 00000100:00100000:1.0:1746127002.696330:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17248 00000100:00100000:1.0:1746127002.696338:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4240:x1830945991616768:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127002.696361:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.696379:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef98d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f69 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.696452:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.696467:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.696477:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.696487:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.696492:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.696497:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697033:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697044:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697049:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127002.697072:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127002.697218:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697224:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697229:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697234:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697239:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a4600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127002.697241:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697246:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697255:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127002.697257:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127002.697261:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697264:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6ef98d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697626:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697631:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697636:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697639:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a5a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127002.697641:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697646:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697653:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58ae00) 00010000:00010000:1.0:1746127002.697654:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127002.697657:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697661:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef98de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.697702:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef98d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 32 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.697712:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 31 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.697718:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.697720:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127002.697722:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a4000, rc 0) 00000100:00100000:1.0:1746127002.697789:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4240:x1830945991616768:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1451us (1687us total) trans 8589938179 rc 0/0 00000100:00100000:1.0:1746127002.697796:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17248 00000100:00100000:0.0:1746127002.701650:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.701713:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991616896 00000100:00100000:3.0:1746127002.701721:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991616896 00000100:00100000:3.0:1746127002.701765:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21532 00000100:00100000:3.0:1746127002.701770:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4240:x1830945991616896:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127002.701785:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.701800:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f70 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.701822:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 16 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.701827:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.701828:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.701830:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2781184->2908159] (req 2781184->2908159) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.701852:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 16 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.701859:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 16 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.701872:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994241792:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.701957:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.703496:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.703584:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994241792:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.703607:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2781184->2908159] (req 2781184->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.703622:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10c00, rc 0) 00000100:00100000:3.0:1746127002.703664:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4240:x1830945991616896:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1892us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.703671:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21532 00000100:00100000:2.0:1746127002.703825:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991617024 00000100:00100000:2.0:1746127002.703830:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991617024 00002000:00100000:2.0:1746127002.703865:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (3944448->4194303) req@ffff88009cd65f80 x1830945991617024/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.703873:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65f80 with x1830945991617024 ext(3944448->4194303) 00010000:00010000:2.0:1746127002.703879:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 17 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.703890:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 17 pid: 16295 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746127002.703895:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd65f80 00000100:00100000:2.0:1746127002.703909:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1884 00000100:00100000:2.0:1746127002.703915:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991617024:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127002.710773:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991617024:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6848us (7271us total) trans 21474842846 rc 0/0 00000100:00100000:2.0:1746127002.710786:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1884 00002000:00100000:2.0:1746127002.710797:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (3944448->4194303) req@ffff88009cd65f80 x1830945991617024/t21474842846(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.710807:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65f80 with x1830945991617024 ext(3944448->4194303) 00010000:00010000:2.0:1746127002.710815:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.710830:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746127002.710836:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd65f80 00000100:00100000:0.0:1746127002.712611:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.712759:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991617152 00000100:00100000:1.0:1746127002.712768:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991617152 00010000:00010000:1.0:1746127002.712977:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.713020:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10059 00000100:00100000:1.0:1746127002.713027:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991617152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.713041:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746127002.713073:0:10641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127000 -> 1746127001 00002000:00010000:1.0:1746127002.713076:0:10641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127000 -> 1746127001 00010000:00010000:1.0:1746127002.713082:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.713095:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.713118:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef98b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f4d expref: 19 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.713172:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.713174:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.713182:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.713190:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.713227:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.713240:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994241920:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127002.713385:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.715269:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994241920:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127002.715289:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.715333:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991617152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2306us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.715343:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10059 00000100:00100000:0.0:1746127002.715698:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.715782:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991617408 00000100:00100000:3.0:1746127002.715789:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991617408 00002000:00100000:3.0:1746127002.715829:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2781184->2785279) req@ffff88009cd67100 x1830945991617408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.715837:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67100 with x1830945991617408 ext(2781184->2785279) 00002000:00010000:3.0:1746127002.715841:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd67100 00000100:00100000:3.0:1746127002.715868:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8573 00000100:00100000:3.0:1746127002.715877:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991617408:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127002.716103:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991617408:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 228us (405us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127002.716109:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8573 00002000:00100000:3.0:1746127002.716114:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2781184->2785279) req@ffff88009cd67100 x1830945991617408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.716126:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67100 with x1830945991617408 ext(2781184->2785279) 00002000:00010000:3.0:1746127002.716144:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd67100 00000100:00100000:0.0:1746127002.717920:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.717972:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991617664 00000100:00100000:3.0:1746127002.717978:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991617664 00002000:00100000:3.0:1746127002.718008:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2904064->2908159) req@ffff88009cd66300 x1830945991617664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.718016:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd66300 with x1830945991617664 ext(2904064->2908159) 00002000:00010000:3.0:1746127002.718020:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd66300 00000100:00100000:3.0:1746127002.718043:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8574 00000100:00100000:3.0:1746127002.718050:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991617664:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127002.718204:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991617664:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 154us (288us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127002.718210:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8574 00002000:00100000:3.0:1746127002.718216:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2904064->2908159) req@ffff88009cd66300 x1830945991617664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.718222:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd66300 with x1830945991617664 ext(2904064->2908159) 00002000:00010000:3.0:1746127002.718224:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd66300 00000100:00100000:0.0:1746127002.720399:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.720564:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991617920 00000100:00100000:3.0:1746127002.720571:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991617920 00000100:00100000:3.0:1746127002.720630:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6564 00000100:00100000:3.0:1746127002.720638:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4240:x1830945991617920:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127002.720881:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4240:x1830945991617920:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 243us (487us total) trans 8589938180 rc 0/0 00000100:00100000:3.0:1746127002.720890:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6564 00000100:00100000:0.0:1746127002.800082:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.800176:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991618176 00000100:00100000:1.0:1746127002.800186:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991618176 00000100:00100000:1.0:1746127002.800239:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17249 00000100:00100000:1.0:1746127002.800246:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4245:x1830945991618176:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.800269:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.800287:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5400/0x34dc807b6ef98fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f77 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.800358:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800370:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800379:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800390:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800394:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800399:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800487:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef990f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800495:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef990f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800500:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef990f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127002.800512:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127002.800580:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800586:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800591:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800596:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800601:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a5600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127002.800605:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800611:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800621:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127002.800623:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127002.800627:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800632:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6ef9901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800661:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800666:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800673:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800677:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a4400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127002.800679:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800684:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800690:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58ad00) 00010000:00010000:1.0:1746127002.800692:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127002.800693:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800697:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4400/0x34dc807b6ef9908 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127002.800734:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5400/0x34dc807b6ef98fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f77 expref: 35 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.800744:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef990f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f77 expref: 34 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.800751:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.800753:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127002.800755:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5a00, rc 0) 00000100:00100000:1.0:1746127002.800800:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4245:x1830945991618176:12345-192.168.203.42@tcp:101:cat.0 Request processed in 554us (727us total) trans 8589938181 rc 0/0 00000100:00100000:1.0:1746127002.800805:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17249 00000100:00100000:0.0:1746127002.802573:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.802621:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.802676:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991618432 00000100:00100000:1.0:1746127002.802684:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991618432 00000100:00100000:1.0:1746127002.802725:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1018 00000100:00100000:1.0:1746127002.802731:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991618432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.802742:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.802762:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6ef990f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f77 expref: 34 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.802775:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.802779:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.802807:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991618432:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.802813:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1018 00000100:00100000:3.0:1746127002.803028:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991618560 00000100:00100000:3.0:1746127002.803034:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991618560 00000100:00100000:3.0:1746127002.803233:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6565 00000100:00100000:3.0:1746127002.803241:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4245:x1830945991618560:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127002.803411:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4245:x1830945991618560:12345-192.168.203.42@tcp:35:cat.0 Request processed in 171us (842us total) trans 8589938182 rc 0/0 00000100:00100000:3.0:1746127002.803416:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6565 00000100:00100000:0.0:1746127002.804722:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.804804:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991618688 00000100:00100000:3.0:1746127002.804809:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991618688 00000100:00100000:3.0:1746127002.804837:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21533 00000100:00100000:3.0:1746127002.804842:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991618688:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.804853:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.804870:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef991d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f7e expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.804917:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994242048:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127002.805265:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d900 going to sleep for 11 seconds 00002000:00010000:3.0:1746127002.806339:0:9613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746127000 -> 1746127001 00002000:00010000:3.0:1746127002.806344:0:9613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127000 -> 1746127001 00002000:00010000:3.0:1746127002.806346:0:9613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746127000 -> 1746127001 00000100:00100000:3.0:1746127002.806366:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994242048:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127002.806390:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef991d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f7e expref: 40 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.806408:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6ef991d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f7e expref: 40 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.806417:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11a00, rc 0) 00000100:00100000:3.0:1746127002.806448:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991618688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1606us (1728us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127002.806455:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21533 00000100:00100000:0.0:1746127002.810309:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.810358:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.810424:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991619200 00000100:00100000:1.0:1746127002.810431:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991619072 00000100:00100000:3.0:1746127002.810434:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991619200 00000100:00100000:1.0:1746127002.810435:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991619072 00002000:00100000:3.0:1746127002.810478:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9f:0x0] (1212416->2097151) req@ffff88009cd67480 x1830945991619200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.810478:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (0->188415) req@ffff88009cd65500 x1830945991619072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.810487:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67480 with x1830945991619200 ext(1212416->2097151) 00002000:00100000:1.0:1746127002.810487:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65500 with x1830945991619072 ext(0->188415) 00002000:00010000:3.0:1746127002.810492:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd67480 00002000:00010000:1.0:1746127002.810492:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65500 00000100:00100000:3.0:1746127002.810554:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8575 00000100:00100000:3.0:1746127002.810561:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991619200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127002.810614:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8576 00000100:00100000:1.0:1746127002.810619:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991619072:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127002.813406:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.813426:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991619328 00000100:00100000:3.0:1746127002.813434:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991619328 00000100:00100000:0.0:1746127002.813444:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991619072:12345-192.168.203.42@tcp:3:cat.0 Request processed in 2823us (3084us total) trans 0 rc 188416/188416 00000100:00100000:0.0:1746127002.813454:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8576 00002000:00100000:0.0:1746127002.813465:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (0->188415) req@ffff88009cd65500 x1830945991619072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 188416/188416 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.813473:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65500 with x1830945991619072 ext(0->188415) 00002000:00010000:0.0:1746127002.813479:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd65500 00000100:00100000:3.0:1746127002.813483:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17250 00000100:00100000:3.0:1746127002.813490:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4246:x1830945991619328:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.813509:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.813525:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10800/0x34dc807b6ef9924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f85 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.813583:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813596:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813606:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813618:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813623:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813628:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813701:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813711:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.813717:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.813745:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.813757:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 13 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.813767:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994242176:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.813821:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.819375:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.819408:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994242176:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127002.819417:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991619584 00000100:00100000:0.0:1746127002.819424:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991619584 00010000:00010000:2.0:1746127002.819431:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:3.0:1746127002.819657:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991619200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9095us (9356us total) trans 0 rc 884736/884736 00000100:00100000:3.0:1746127002.819672:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8575 00000100:00100000:0.0:1746127002.819674:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6566 00002000:00100000:3.0:1746127002.819682:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9f:0x0] (1212416->2097151) req@ffff88009cd67480 x1830945991619200/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 884736/884736 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746127002.819682:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:14253:x1830945991619584:12345-192.168.203.42@tcp:35:ldlm_bl.0 00002000:00100000:3.0:1746127002.819690:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67480 with x1830945991619200 ext(1212416->2097151) 00002000:00010000:3.0:1746127002.819694:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd67480 00000100:00100000:0.0:1746127002.819857:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:14253:x1830945991619584:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 176us (492us total) trans 8589938183 rc 0/0 00000100:00100000:0.0:1746127002.819867:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6566 00000100:00100000:0.0:1746127002.821438:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.821502:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991619712 00000100:00100000:1.0:1746127002.821507:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991619712 00010000:00010000:1.0:1746127002.821533:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 15 pid: 13448 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.821561:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10060 00000100:00100000:1.0:1746127002.821565:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991619712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.821574:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.821579:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 15 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.821587:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 15 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.821605:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099191a00/0x34dc807b6ef97bf lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e82 expref: 15 pid: 13448 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.822012:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127002.822017:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127002.822027:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127002.822034:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127002.822066:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127002.822073:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822080:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:1.0:1746127002.822113:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991619712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 546us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.822119:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10060 00000004:00200000:2.0:1746127002.822125:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127002.822242:0:10958:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127002.822259:0:10958:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822269:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822280:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822286:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822291:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822297:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822302:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007dc10000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.822306:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822312:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822320:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127002.822323:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.822326:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822331:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10000/0x34dc807b6ef992b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822431:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822436:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822441:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822445:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bc6200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.822448:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822452:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822458:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095eece00) 00010000:00010000:2.0:1746127002.822460:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.822462:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822466:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.822496:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007dc10800/0x34dc807b6ef9924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.822508:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 7 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.822513:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.822515:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127002.822517:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc7400, rc 0) 00000100:00100000:2.0:1746127002.822557:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4246:x1830945991619328:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 9067us (9158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.822563:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17250 00000100:00100000:0.0:1746127002.825188:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.825221:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.825251:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.825278:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.825291:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991619840 00000100:00100000:1.0:1746127002.825300:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991619840 00000100:00100000:0.0:1746127002.825306:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991619968 00000100:00100000:0.0:1746127002.825308:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991619968 00000100:00100000:0.0:1746127002.825340:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991620096 00000100:00100000:0.0:1746127002.825342:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991620096 00000100:00100000:3.0:1746127002.825346:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991620224 00000100:00100000:3.0:1746127002.825350:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991620224 00000100:00100000:1.0:1746127002.825381:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21534 00000100:00100000:1.0:1746127002.825389:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991619968:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127002.825415:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.825435:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011ea87a00/0x34dc807b6ef9940 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f93 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.825491:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994242304:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127002.825565:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.825615:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21535 00000100:00100000:0.0:1746127002.825621:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991619840:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127002.825629:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.825639:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd00600/0x34dc807b6ef9947 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f8c expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.825666:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994242432:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127002.825682:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21536 00000100:00100000:0.0:1746127002.825689:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.825690:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991620096:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127002.825697:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.825704:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef994e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52f9a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.825728:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994242560:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127002.825755:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.825865:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21537 00000100:00100000:3.0:1746127002.825873:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991620224:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.825880:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.825887:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136bc7c00/0x34dc807b6ef9955 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fa1 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.825913:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994242688:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127002.825948:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d600 going to sleep for 11 seconds 00002000:00010000:3.0:1746127002.830940:0:3542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127000 -> 1746127001 00000100:00100000:0.0:1746127002.830959:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994242688:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127002.830961:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994242560:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127002.830990:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef994e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f9a expref: 16 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.830990:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136bc7c00/0x34dc807b6ef9955 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa1 expref: 19 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.831002:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef994e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f9a expref: 16 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.831002:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136bc7c00/0x34dc807b6ef9955 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa1 expref: 19 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.831016:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc7c00, rc 0) 00000100:00100000:0.0:1746127002.831078:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991620224:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5205us (5797us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127002.831086:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21537 00000100:00100000:1.0:1746127002.831100:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994242304:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127002.831121:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011ea87a00/0x34dc807b6ef9940 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f93 expref: 17 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.831147:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011ea87a00/0x34dc807b6ef9940 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f93 expref: 17 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.831161:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea87a00, rc 0) 00000100:00100000:1.0:1746127002.831181:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991619968:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5793us (5958us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127002.831187:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21534 00000100:00100000:2.0:1746127002.831586:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994242432:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.831605:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd00600/0x34dc807b6ef9947 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f8c expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.831614:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd00600/0x34dc807b6ef9947 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f8c expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.831643:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00600, rc 0) 00000100:00100000:2.0:1746127002.831666:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991619840:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6046us (6487us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.831672:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21535 00010000:00010000:3.0:1746127002.831711:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6800, rc 0) 00000100:00100000:3.0:1746127002.831733:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991620096:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6043us (6480us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127002.831739:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21536 00000100:00100000:0.0:1746127002.833684:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.833833:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991620480 00000100:00100000:3.0:1746127002.833841:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991620480 00002000:00100000:3.0:1746127002.833892:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880099197800 x1830945991620480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 504/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.833901:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197800 with x1830945991620480 ext(2097152->3145727) 00002000:00010000:3.0:1746127002.833907:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099197800 00000100:00100000:3.0:1746127002.833925:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8577 00000100:00100000:3.0:1746127002.833932:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991620480:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127002.836865:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.837290:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991620736 00000100:00100000:2.0:1746127002.837298:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991620736 00000100:00100000:2.0:1746127002.837341:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17251 00000100:00100000:2.0:1746127002.837347:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4246:x1830945991620736:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127002.837366:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.837384:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6ef995c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fa8 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.837476:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.837488:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.837496:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.837524:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.837534:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 8 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.837545:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994242816:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.838385:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.839623:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.841656:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991620992 00000100:00100000:2.0:1746127002.841669:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991620992 00000100:00100000:2.0:1746127002.841732:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17252 00000100:00100000:2.0:1746127002.841739:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4248:x1830945991620992:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127002.841763:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.841783:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef996a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52faf expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.841853:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.841866:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.841876:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.841891:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.841898:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.841903:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.841998:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef997f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842007:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef997f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842012:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef997f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127002.842021:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127002.842103:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842108:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842114:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842119:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842123:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbfce00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.842150:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842157:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842171:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127002.842174:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.842178:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842182:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6ef9971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842192:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842197:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127002.842526:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.842550:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991621120 00000100:00100000:0.0:1746127002.842553:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991621120 00010000:00010000:0.0:1746127002.842571:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.842588:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10061 00000100:00100000:0.0:1746127002.842598:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991621120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127002.842607:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127002.842614:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.842624:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.842636:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127002.842639:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127002.842646:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127002.842650:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127002.842665:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127002.842703:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991621120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.842709:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10061 00010000:00010000:2.0:1746127002.842812:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842819:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7dad000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127002.842822:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127002.842826:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.842829:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef9939 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f85 expref: 8 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.842833:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829500) 00010000:00010000:2.0:1746127002.842835:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127002.842837:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00000100:00100000:3.0:1746127002.842840:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994242816:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.842841:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad000/0x34dc807b6ef9978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127002.842857:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.842863:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.842867:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.842876:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef996a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52faf expref: 37 pid: 7258 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746127002.842878:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127002.842886:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef997f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52faf expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.842891:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.842893:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127002.842895:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad800, rc 0) 00000100:00100000:2.0:1746127002.842916:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4248:x1830945991620992:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1178us (3299us total) trans 8589938184 rc 0/0 00000100:00100000:2.0:1746127002.842922:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17252 00010000:00010000:3.0:1746127002.842924:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6ef995c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.842938:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.842943:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.842945:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127002.842946:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7a00, rc 0) 00000100:00100000:3.0:1746127002.842963:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4246:x1830945991620736:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5617us (6108us total) trans 8589938185 rc 0/0 00000100:00100000:3.0:1746127002.842968:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17251 00000100:00100000:3.0:1746127002.843686:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991620480:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9752us (10008us total) trans 0 rc 921600/921600 00000100:00100000:3.0:1746127002.843699:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8577 00002000:00100000:3.0:1746127002.843708:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880099197800 x1830945991620480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 504/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.843717:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197800 with x1830945991620480 ext(2097152->3145727) 00002000:00010000:3.0:1746127002.843721:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099197800 00000100:00100000:0.0:1746127002.847261:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.847448:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991621248 00000100:00100000:3.0:1746127002.847457:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991621248 00000100:00100000:3.0:1746127002.847517:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17253 00000100:00100000:3.0:1746127002.847525:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4246:x1830945991621248:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.847552:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.847571:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9994 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fb6 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.847664:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.847680:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.847686:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.847715:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.847725:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.847737:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994242944:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.847817:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.850227:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.851295:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994242944:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.851322:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:2.0:1746127002.851431:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991621376 00000100:00100000:2.0:1746127002.851438:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991621376 00000100:00100000:2.0:1746127002.851493:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1019 00000100:00100000:2.0:1746127002.851501:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991621376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.851513:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.851536:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dad800/0x34dc807b6ef997f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52faf expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.851562:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.851566:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.851574:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.851579:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.851583:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.851633:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991621376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 132us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.851639:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1019 00000100:00100000:0.0:1746127002.852909:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.853301:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.853662:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991621504 00000100:00100000:3.0:1746127002.853669:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991621504 00000100:00100000:1.0:1746127002.854228:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991621632 00000100:00100000:1.0:1746127002.854234:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991621632 00010000:00010000:1.0:1746127002.854257:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 10 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.854279:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10062 00000100:00100000:1.0:1746127002.854286:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991621632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127002.854288:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21538 00000100:00100000:3.0:1746127002.854296:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4245:x1830945991621504:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.854299:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.854304:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 10 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.854311:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.854315:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 10 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.854327:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fbd expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.854333:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9963 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fa8 expref: 10 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.854350:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.854358:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127002.854358:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.854360:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127002.854362:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.854363:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 40 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.854371:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127002.854377:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.854390:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 20 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.854392:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127002.854401:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 20 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.854412:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994243072:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127002.854426:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991621632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 140us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.854432:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10062 00010000:00010000:2.0:1746127002.854632:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.854639:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:3.0:1746127002.854685:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d600 going to sleep for 11 seconds 00000004:00200000:2.0:1746127002.854826:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127002.854831:0:10958:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127002.854849:0:10958:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.854880:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6ef9994 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.854892:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.854898:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.854901:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127002.854903:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6800, rc 0) 00000100:00100000:2.0:1746127002.854937:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4246:x1830945991621248:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7413us (7685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.854944:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17253 00000100:00100000:0.0:1746127002.862025:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.862108:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.862120:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.862160:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.862171:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991621760 00000100:00100000:1.0:1746127002.862180:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991621760 00000100:00100000:0.0:1746127002.862180:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991622016 00000100:00100000:0.0:1746127002.862183:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991622016 00000100:00100000:1.0:1746127002.862217:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991622144 00000100:00100000:1.0:1746127002.862219:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991622144 00000100:00100000:3.0:1746127002.862270:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994243072:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.862299:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 40 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.862317:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7000, rc 0) 00000100:00100000:3.0:1746127002.862359:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4245:x1830945991621504:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8064us (9453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.862367:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21538 00000100:00100000:3.0:1746127002.862386:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21539 00000100:00100000:3.0:1746127002.862392:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991621760:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.862406:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.862420:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac6200/0x34dc807b6ef99a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fc4 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.862471:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994243200:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127002.862529:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.862548:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991622528 00000100:00100000:3.0:1746127002.862552:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991622528 00000100:00100000:3.0:1746127002.862587:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17254 00000100:00100000:3.0:1746127002.862594:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4251:x1830945991622528:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.862610:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.862623:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6ef99b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fe0 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.862692:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862703:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862714:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862727:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862733:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862738:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862842:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862854:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862861:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:3.0:1746127002.862869:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127002.862945:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862950:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862959:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862964:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862970:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bc7400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127002.862974:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862980:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.862990:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127002.862992:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127002.862999:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.863004:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6ef99b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.863024:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00000100:00100000:0.0:1746127002.863026:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21540 00010000:00010000:3.0:1746127002.863028:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00000100:00100000:0.0:1746127002.863032:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991622016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.863033:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.863037:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bc6200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127002.863039:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127002.863040:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.863044:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.863050:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095eec700) 00010000:00010000:0.0:1746127002.863050:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01c00/0x34dc807b6ef99d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fcb expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.863062:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127002.863065:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.863069:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6ef99be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00000100:00100000:0.0:1746127002.863086:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994243328:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127002.863096:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21541 00000100:00100000:3.0:1746127002.863101:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991622144:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.863107:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127002.863109:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746127002.863114:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef99da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fd2 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.863148:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.863151:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994243456:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.863167:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991622272 00000100:00100000:0.0:1746127002.863169:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991622272 00000100:00100000:3.0:1746127002.863181:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.863187:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21542 00000100:00100000:0.0:1746127002.863191:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991622272:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127002.863197:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.863202:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef99e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fd9 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.863207:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6ef99b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 17 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.863216:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 16 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.863221:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000100:00100000:0.0:1746127002.863221:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994243584:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127002.863223:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127002.863225:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc6800, rc 0) 00000100:00100000:0.0:1746127002.863239:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.863929:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4251:x1830945991622528:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1333us (1914us total) trans 8589938186 rc 0/0 00000100:00100000:3.0:1746127002.863936:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17254 00000100:00100000:1.0:1746127002.864124:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.864193:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991621888 00000100:00100000:3.0:1746127002.864196:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991621888 00002000:00100000:3.0:1746127002.864222:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3436543) req@ffff88012cc9d180 x1830945991621888/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.864234:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d180 with x1830945991621888 ext(3145728->3436543) 00010000:00010000:3.0:1746127002.864240:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 21 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.864251:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 21 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746127002.864258:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cc9d180 00000100:00100000:3.0:1746127002.864272:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1885 00000100:00100000:3.0:1746127002.864280:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991621888:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127002.867367:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994243200:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.867383:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994243584:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127002.867402:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6200/0x34dc807b6ef99a9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fc4 expref: 16 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.867404:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef99e1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fd9 expref: 19 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.867414:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6200/0x34dc807b6ef99a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fc4 expref: 16 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.867414:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00200/0x34dc807b6ef99e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fd9 expref: 19 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.867425:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6200, rc 0) 00010000:00010000:0.0:1746127002.867429:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00200, rc 0) 00000100:00100000:2.0:1746127002.867511:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994243328:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.867527:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01c00/0x34dc807b6ef99d3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fcb expref: 18 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.867541:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01c00/0x34dc807b6ef99d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fcb expref: 18 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.867548:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01c00, rc 0) 00000100:00100000:0.0:1746127002.867721:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991622272:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4527us (4570us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127002.867729:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21542 00000100:00100000:2.0:1746127002.868051:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991622016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5018us (5927us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.868068:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21540 00000100:00100000:3.0:1746127002.868099:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991621760:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5604us (5887us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127002.868105:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21539 00000100:00100000:2.0:1746127002.868119:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994243456:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.868155:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef99da lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fd2 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.868164:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd600/0x34dc807b6ef99da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fd2 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.868172:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dd600, rc 0) 00000100:00100000:2.0:1746127002.868189:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991622144:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5088us (6028us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.868195:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21541 00000100:00100000:0.0:1746127002.873667:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.874323:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991622784 00000100:00100000:2.0:1746127002.874331:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991622784 00000100:00100000:2.0:1746127002.874387:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6567 00000100:00100000:2.0:1746127002.874396:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4251:x1830945991622784:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127002.875474:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4251:x1830945991622784:12345-192.168.203.42@tcp:35:cat.0 Request processed in 1074us (1810us total) trans 8589938187 rc 0/0 00000100:00100000:2.0:1746127002.875485:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6567 00000100:00100000:3.0:1746127002.876282:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991621888:12345-192.168.203.42@tcp:4:cat.0 Request processed in 12002us (12157us total) trans 17179875584 rc 0/0 00000100:00100000:3.0:1746127002.876292:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1885 00002000:00100000:3.0:1746127002.876301:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3436543) req@ffff88012cc9d180 x1830945991621888/t17179875584(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.876312:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d180 with x1830945991621888 ext(3145728->3436543) 00010000:00010000:3.0:1746127002.876321:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 23 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.876336:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 23 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746127002.876343:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cc9d180 00000100:00100000:1.0:1746127002.881381:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.881470:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991623680 00000100:00100000:3.0:1746127002.881480:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991623680 00000100:00100000:3.0:1746127002.881537:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17255 00000100:00100000:3.0:1746127002.881544:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4246:x1830945991623680:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127002.881564:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.881582:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef99e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53003 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.881679:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.881949:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.881964:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.881975:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.881981:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.881986:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.881992:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f45600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127002.881996:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.882002:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.882012:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127002.882016:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127002.882019:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.882024:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef99ef lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.882064:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef99e8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53003 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.882071:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef99e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53003 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.882079:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44800, rc 0) 00000100:00100000:3.0:1746127002.883212:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4246:x1830945991623680:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1663us (1836us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127002.883221:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17255 00000100:00100000:0.0:1746127002.883480:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.883593:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.883621:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.883635:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.883660:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.883680:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991622912 00000100:00100000:0.0:1746127002.883686:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991622912 00000100:00100000:0.0:1746127002.883713:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991623168 00000100:00100000:0.0:1746127002.883716:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991623168 00000100:00100000:0.0:1746127002.883726:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991623296 00000100:00100000:0.0:1746127002.883728:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991623296 00000100:00100000:0.0:1746127002.883737:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991623424 00000100:00100000:0.0:1746127002.883739:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991623424 00000100:00100000:0.0:1746127002.883750:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21543 00000100:00100000:0.0:1746127002.883755:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991622912:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.883770:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.883784:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd01200/0x34dc807b6ef99f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fe7 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.883831:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994243712:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.883889:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.883907:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21544 00000100:00100000:0.0:1746127002.883912:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991623168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.883919:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.883930:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6ef99fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52fee expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.883954:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994243840:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.883974:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.884034:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21545 00000100:00100000:0.0:1746127002.884039:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991623296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.884045:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.884067:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9a04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ff5 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.884095:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994243968:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.884116:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.884184:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21546 00000100:00100000:0.0:1746127002.884189:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991623424:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.884196:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.884205:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef9a0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e52ffc expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.884227:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994244096:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.884259:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.885173:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991623040 00000100:00100000:3.0:1746127002.885178:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991623040 00010000:00010000:3.0:1746127002.885202:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 27 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.885230:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10063 00000100:00100000:3.0:1746127002.885236:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991623040:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.885244:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.885266:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 27 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.885277:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 27 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.885299:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.885301:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.885308:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 39 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.885316:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 39 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.885338:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 39 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.885352:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994244224:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127002.885391:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00010000:00010000:2.0:1746127002.888122:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127002.891233:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.891425:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994243840:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127002.891457:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994243712:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127002.891461:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6ef99fd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fee expref: 27 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.891477:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6ef99fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fee expref: 27 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.891478:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd01200/0x34dc807b6ef99f6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe7 expref: 21 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.891492:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd01200/0x34dc807b6ef99f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe7 expref: 21 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.891505:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00e00, rc 0) 00010000:00010000:1.0:1746127002.891506:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01200, rc 0) 00000100:00100000:1.0:1746127002.891550:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991622912:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7794us (8071us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127002.891550:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991623168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7637us (7927us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127002.891558:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21543 00000100:00100000:2.0:1746127002.891590:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991623936 00000100:00100000:2.0:1746127002.891597:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991623936 00000100:00100000:2.0:1746127002.891633:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6568 00000100:00100000:1.0:1746127002.891638:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994243968:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127002.891640:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4246:x1830945991623936:12345-192.168.203.42@tcp:35:lfs.0 00010000:00010000:1.0:1746127002.891654:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9a04 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ff5 expref: 19 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.891663:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6200/0x34dc807b6ef9a04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ff5 expref: 19 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.891670:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc6200, rc 0) 00000100:00100000:1.0:1746127002.891687:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991623296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7648us (8050us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.891795:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4246:x1830945991623936:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 155us (572us total) trans 8589938188 rc 0/0 00000100:00100000:2.0:1746127002.891800:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6568 00000100:00100000:0.0:1746127002.891842:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21544 00000100:00100000:1.0:1746127002.891848:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21545 00010000:00010000:2.0:1746127002.891969:0:16295:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff88009ab0c700 x1830945994244096) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 25 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.891993:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11000/0x34dc807b6ef98c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f62 expref: 25 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.892002:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994244096:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.892018:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef9a0b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ffc expref: 24 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.892026:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9ba1e00/0x34dc807b6ef9a0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ffc expref: 24 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.892032:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9ba1e00, rc 0) 00000100:00100000:2.0:1746127002.892061:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991623424:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7863us (8391us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.892067:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21546 00000100:00100000:3.0:1746127002.892151:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994244224:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127002.892163:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.892197:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991623040:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6961us (8604us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.892205:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10063 00000100:00100000:0.0:1746127002.893973:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.894080:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991624064 00000100:00100000:2.0:1746127002.894097:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991624064 00000100:00100000:2.0:1746127002.894177:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21547 00000100:00100000:2.0:1746127002.894185:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4251:x1830945991624064:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.894203:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.894220:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5300a expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.894248:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.894256:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127002.894257:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127002.894260:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 19 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.894290:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.894303:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 32 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.894314:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244352:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.894401:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.900010:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.900099:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991624320 00000100:00100000:3.0:1746127002.900108:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991624320 00000100:00100000:3.0:1746127002.900270:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17256 00000100:00100000:3.0:1746127002.900280:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4253:x1830945991624320:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127002.900303:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.900322:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53011 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.900428:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.900442:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.900449:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 18 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.900456:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127002.900487:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 18 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.900497:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 18 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.900509:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994244480:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.900604:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.900612:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 8 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.900620:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994244608:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.902428:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.902747:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244352:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.902781:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 19 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.902799:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7a00, rc 0) 00000100:00100000:2.0:1746127002.903434:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4251:x1830945991624064:12345-192.168.203.42@tcp:101:cat.0 Request processed in 9248us (9466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.903443:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21547 00000100:00100000:0.0:1746127002.903647:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.903713:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.903740:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.903758:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991624832 00000100:00100000:1.0:1746127002.903763:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991624832 00002000:00100000:1.0:1746127002.903800:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009ab0d180 x1830945991624832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746127002.903804:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991624448 00000100:00100000:3.0:1746127002.903808:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991624448 00002000:00100000:1.0:1746127002.903816:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d180 with x1830945991624832 ext(3145728->4194303) 00002000:00010000:1.0:1746127002.903821:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0d180 00002000:00100000:3.0:1746127002.903827:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9c:0x0] (188416->1048575) req@ffff88012cc9c380 x1830945991624448/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127002.903832:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991624960 00000100:00100000:1.0:1746127002.903834:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991624960 00002000:00100000:3.0:1746127002.903840:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c380 with x1830945991624448 ext(188416->1048575) 00002000:00100000:1.0:1746127002.903844:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012cc9df80 x1830945991624960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746127002.903846:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 34 pid: 9613 timeout: 997 lvb_type: 0 00002000:00100000:1.0:1746127002.903851:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9df80 with x1830945991624960 ext(2097152->4194303) 00002000:00010000:1.0:1746127002.903853:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9df80 00010000:00010000:3.0:1746127002.903859:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 34 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.903863:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8578 00000100:00100000:1.0:1746127002.903868:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991624832:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:3.0:1746127002.903869:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cc9c380 00000100:00100000:3.0:1746127002.903890:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1886 00000100:00100000:3.0:1746127002.903900:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991624448:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127002.904043:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8579 00000100:00100000:3.0:1746127002.904049:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991624960:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127002.906975:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.907012:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994244480:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.907023:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994244608:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.907046:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:1.0:1746127002.907049:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.907085:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625088 00000100:00100000:2.0:1746127002.907094:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625088 00010000:00010000:2.0:1746127002.907123:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.907160:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625216 00000100:00100000:2.0:1746127002.907162:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625216 00010000:00010000:2.0:1746127002.907170:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 19 pid: 10958 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.907183:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10064 00000100:00100000:2.0:1746127002.907189:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991625088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.907200:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.907205:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.907220:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.907241:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac6800/0x34dc807b6ef999b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fb6 expref: 9 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.907376:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.907381:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.907390:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.907395:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.907439:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991625088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 249us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.907445:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10064 00000100:00100000:2.0:1746127002.907490:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10065 00000100:00100000:2.0:1746127002.907495:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991625216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127002.907501:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.907505:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 19 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.907513:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 19 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.907523:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6800/0x34dc807b6ef99c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fe0 expref: 19 pid: 10958 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.907531:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.907533:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.907539:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.907545:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.907560:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127002.907574:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991625216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 78us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.907579:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10065 00010000:00010000:2.0:1746127002.907611:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127002.907616:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127002.907632:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127002.907745:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 19 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.907758:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 18 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.907763:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127002.907765:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127002.907768:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45a00, rc 0) 00000100:00100000:2.0:1746127002.907792:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4253:x1830945991624320:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7515us (7795us total) trans 8589938189 rc 0/0 00000100:00100000:2.0:1746127002.907798:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17256 00000100:00100000:2.0:1746127002.916908:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991624832:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13027us (13249us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127002.916921:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8578 00002000:00100000:2.0:1746127002.916932:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009ab0d180 x1830945991624832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.916942:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d180 with x1830945991624832 ext(3145728->4194303) 00002000:00010000:2.0:1746127002.916948:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0d180 00000100:00100000:1.0:1746127002.920069:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.920322:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625344 00000100:00100000:3.0:1746127002.920332:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625344 00000100:00100000:3.0:1746127002.920378:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21548 00000100:00100000:3.0:1746127002.920385:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4253:x1830945991625344:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127002.920403:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.920420:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53018 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.920449:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.920460:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.920468:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 34 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.920474:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.920475:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.920478:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.920511:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 34 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.920522:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 34 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.920534:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244736:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.920622:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.920630:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 20 pid: 12333 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.920637:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244864:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.920664:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127002.920672:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 12 pid: 11152 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746127002.920680:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244992:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.920936:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.928209:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991624960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 24148us (24456us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127002.928221:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8579 00002000:00100000:3.0:1746127002.928234:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012cc9df80 x1830945991624960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.928244:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9df80 with x1830945991624960 ext(2097152->4194303) 00002000:00010000:3.0:1746127002.928251:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9df80 00000100:00100000:2.0:1746127002.929911:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244736:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.929921:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244864:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.934495:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991624448:12345-192.168.203.42@tcp:4:cat.0 Request processed in 30582us (30766us total) trans 21474842847 rc 0/0 00000100:00100000:3.0:1746127002.934510:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1886 00002000:00100000:3.0:1746127002.934523:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (188416->1048575) req@ffff88012cc9c380 x1830945991624448/t21474842847(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.934533:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c380 with x1830945991624448 ext(188416->1048575) 00010000:00010000:3.0:1746127002.934549:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.934568:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746127002.934574:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cc9c380 00000100:00100000:0.0:1746127002.935045:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.935172:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.935214:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.935243:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625600 00000100:00100000:0.0:1746127002.935250:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625600 00010000:00010000:0.0:1746127002.935277:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 35 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.935295:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625472 00000100:00100000:0.0:1746127002.935297:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625472 00010000:00010000:0.0:1746127002.935304:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 21 pid: 12333 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.935321:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625728 00000100:00100000:0.0:1746127002.935322:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625728 00010000:00010000:0.0:1746127002.935331:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 13 pid: 11152 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746127002.935343:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10066 00000100:00100000:0.0:1746127002.935352:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991625600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127002.935364:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127002.935385:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 35 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.935396:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10067 00010000:00010000:0.0:1746127002.935396:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 35 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.935406:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991625472:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.935413:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127002.935421:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10600/0x34dc807b6ef9813 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ec8 expref: 35 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.935423:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 21 pid: 12333 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.935432:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 21 pid: 12333 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.935679:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10068 00000100:00100000:3.0:1746127002.935686:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991625728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.935694:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127002.936060:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127002.936108:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991625600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 758us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.936114:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10066 00000100:00100000:0.0:1746127002.936173:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994244992:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127002.936200:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.936210:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36400, rc 0) 00000100:00100000:0.0:1746127002.936228:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4253:x1830945991625344:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 15844us (16192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.936234:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21548 00000100:00100000:0.0:1746127002.936272:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127002.936278:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6ef984b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f00 expref: 20 pid: 12333 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.936286:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625856 00000100:00100000:0.0:1746127002.936288:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625856 00010000:00010000:1.0:1746127002.936298:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127002.936312:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21549 00000100:00100000:0.0:1746127002.936316:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991625856:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.936330:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.936339:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef9a35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5301f expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.936375:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991625472:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 971us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.936377:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994245120:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127002.936382:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10067 00000100:00100000:0.0:1746127002.936431:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.936439:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127002.936480:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 13 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127002.936492:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 13 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127002.936504:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c37600/0x34dc807b6ef9702 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e4a expref: 13 pid: 11152 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746127002.936516:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.936518:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.936523:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 18 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.936531:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 18 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.936552:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 18 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.936560:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994245248:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127002.936580:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.936638:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991625984 00000100:00100000:0.0:1746127002.936641:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991625984 00000100:00100000:0.0:1746127002.936663:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21550 00000100:00100000:0.0:1746127002.936668:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991625984:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.936673:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.936680:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9a3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53026 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.936700:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994245376:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.936718:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.937492:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.937547:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991626112 00000100:00100000:3.0:1746127002.937550:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991626112 00010000:00010000:3.0:1746127002.937563:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 38 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.937579:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10069 00000100:00100000:3.0:1746127002.937583:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991626112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.937589:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.937598:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 38 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.937606:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 38 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.937617:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.937619:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127002.937627:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 18 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.937633:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 18 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.937648:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 18 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127002.937656:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994245504:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127002.937697:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.937946:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.938000:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991626240 00000100:00100000:1.0:1746127002.938003:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991626240 00000100:00100000:1.0:1746127002.938159:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21551 00000100:00100000:1.0:1746127002.938166:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4248:x1830945991626240:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127002.938175:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.938185:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5302d expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.938523:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:0.0:1746127002.938552:0:16295:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746127000 -> 1746127001 00002000:00010000:0.0:1746127002.938555:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127000 -> 1746127001 00002000:00010000:0.0:1746127002.938557:0:16295:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746127000 -> 1746127001 00000100:00100000:3.0:1746127002.938606:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994245248:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127002.938616:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.938641:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991625728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2955us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.938647:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10068 00000100:00100000:3.0:1746127002.938672:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991626496 00000100:00100000:3.0:1746127002.938674:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991626496 00002000:00100000:3.0:1746127002.938698:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (2084864->2088959) req@ffff8800a7c50e00 x1830945991626496/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.938706:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50e00 with x1830945991626496 ext(2084864->2088959) 00002000:00010000:3.0:1746127002.938709:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c50e00 00000100:00100000:3.0:1746127002.938720:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8580 00000100:00100000:3.0:1746127002.938725:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991626496:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127002.938816:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991626496:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 90us (293us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127002.938821:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8580 00002000:00100000:3.0:1746127002.938825:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (2084864->2088959) req@ffff8800a7c50e00 x1830945991626496/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.938831:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50e00 with x1830945991626496 ext(2084864->2088959) 00002000:00010000:3.0:1746127002.938833:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c50e00 00010000:00010000:1.0:1746127002.938886:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.938895:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.938902:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 41 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.938908:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.938910:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.938912:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1851391] (req 1048576->1851391) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.938936:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 41 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.938946:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 41 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.938955:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994245632:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127002.939116:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994245376:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127002.939149:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9a3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53026 expref: 38 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.939158:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9a3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53026 expref: 38 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.939167:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb7000, rc 0) 00000100:00100000:0.0:1746127002.939182:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991625984:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2514us (2744us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127002.939188:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21550 00010000:00010000:2.0:1746127002.939387:0:12333:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff8800a7c50380 x1830945994245120) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 36 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.939405:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bc7a00/0x34dc807b6ef9828 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 188416->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52edd expref: 36 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.939416:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994245120:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.939432:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef9a35 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5301f expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.939439:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011ea87e00/0x34dc807b6ef9a35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5301f expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.939447:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea87e00, rc 0) 00000100:00100000:2.0:1746127002.939464:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991625856:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3147us (3193us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127002.939470:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21549 00010000:00010000:1.0:1746127002.939595:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.939603:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 21 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.939610:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994245760:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.939686:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994245504:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127002.939694:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.939708:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991626112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2125us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.939713:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10069 00010000:00010000:1.0:1746127002.940123:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 15 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.940151:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 15 pid: 12333 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746127002.940162:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994245888:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127002.940620:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.940906:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.940956:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994245632:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.941041:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991626752 00000100:00100000:3.0:1746127002.941045:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991626752 00002000:00100000:3.0:1746127002.941080:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a7c53480 x1830945991626752/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.941088:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53480 with x1830945991626752 ext(0->1048575) 00002000:00010000:3.0:1746127002.941092:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53480 00000100:00100000:3.0:1746127002.941105:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8581 00000100:00100000:3.0:1746127002.941110:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991626752:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127002.943683:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.943720:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.944120:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994245760:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.944206:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991626880 00000100:00100000:3.0:1746127002.944212:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991626880 00010000:00010000:3.0:1746127002.944244:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 42 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746127002.944272:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10070 00000100:00100000:3.0:1746127002.944279:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991626880:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127002.944291:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127002.944310:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 42 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.944320:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 42 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.944344:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6ef97fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eb3 expref: 42 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.944359:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127002.944410:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991626880:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 131us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.944417:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10070 00000100:00100000:2.0:1746127002.945279:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994245888:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127002.945311:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1851391] (req 1048576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.945324:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642e00, rc 0) 00000100:00100000:0.0:1746127002.945355:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.945361:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4248:x1830945991626240:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7195us (7414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.945368:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21551 00000100:00100000:0.0:1746127002.945370:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991627264 00000100:00100000:0.0:1746127002.945374:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991627264 00000100:00100000:2.0:1746127002.945384:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991627008 00000100:00100000:2.0:1746127002.945387:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991627008 00010000:00010000:0.0:1746127002.945390:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746127002.945407:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10071 00000100:00100000:2.0:1746127002.945408:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21552 00000100:00100000:2.0:1746127002.945413:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4253:x1830945991627008:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:0.0:1746127002.945413:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991627264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127002.945421:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127002.945426:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.945431:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746127002.945439:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.945440:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53034 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.945453:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009665c800/0x34dc807b6ef96fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52e43 expref: 16 pid: 12333 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746127002.945460:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.945468:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127002.945471:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127002.945473:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127002.945476:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2129919] (req 2097152->2129919) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.945485:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991627264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.945491:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10071 00010000:00010000:2.0:1746127002.945499:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.945508:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 32 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746127002.945519:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994246016:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.945560:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.945561:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.945571:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991627136 00000100:00100000:0.0:1746127002.945574:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991627136 00010000:00010000:0.0:1746127002.945584:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 22 pid: 16295 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746127002.945596:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10072 00000100:00100000:0.0:1746127002.945601:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991627136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127002.945606:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127002.945612:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 22 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.945619:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 22 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.945631:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e88e600/0x34dc807b6ef981a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ecf expref: 22 pid: 16295 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.945639:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.945641:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.945646:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 39 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.945653:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 39 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.945671:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 39 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.945684:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994246144:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127002.945705:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.949555:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.949615:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991627520 00000100:00100000:2.0:1746127002.949626:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991627520 00002000:00100000:2.0:1746127002.949665:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a7c52300 x1830945991627520/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.949675:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52300 with x1830945991627520 ext(4194304->4829183) 00010000:00010000:2.0:1746127002.949684:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 33 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746127002.949699:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 33 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746127002.949707:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c52300 00000100:00100000:2.0:1746127002.949727:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1887 00000100:00100000:2.0:1746127002.949733:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991627520:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127002.950281:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994246016:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.950307:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2129919] (req 2097152->2129919) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.950322:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6800, rc 0) 00000100:00100000:0.0:1746127002.950391:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c52d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994246144:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127002.950404:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127002.950425:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991627136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4823us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.950434:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10072 00000100:00100000:3.0:1746127002.950837:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4253:x1830945991627008:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5422us (7115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.950845:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21552 00000100:00100000:1.0:1746127002.951246:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127002.951589:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991627648 00000100:00100000:3.0:1746127002.951595:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991627648 00002000:00100000:3.0:1746127002.951622:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2781184->2908159) req@ffff880094825c00 x1830945991627648/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.951630:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825c00 with x1830945991627648 ext(2781184->2908159) 00010000:00010000:3.0:1746127002.951636:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.951649:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746127002.951656:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094825c00 00000100:00100000:3.0:1746127002.951684:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1888 00000100:00100000:3.0:1746127002.951691:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991627648:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127002.954364:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991626752:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 13243us (13448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127002.954376:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8581 00002000:00100000:3.0:1746127002.954388:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a7c53480 x1830945991626752/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.954397:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53480 with x1830945991626752 ext(0->1048575) 00002000:00010000:3.0:1746127002.954402:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53480 00000100:00100000:3.0:1746127002.955505:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991627520:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5766us (5956us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127002.955514:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1887 00002000:00100000:3.0:1746127002.955520:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a7c52300 x1830945991627520/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.955528:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52300 with x1830945991627520 ext(4194304->4829183) 00010000:00010000:3.0:1746127002.955537:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746127002.955551:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746127002.955557:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c52300 00000100:00100000:0.0:1746127002.956779:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991627648:12345-192.168.203.42@tcp:4:cat.0 Request processed in 5082us (5528us total) trans 21474842848 rc 0/0 00000100:00100000:0.0:1746127002.956789:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1888 00002000:00100000:0.0:1746127002.956797:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2781184->2908159) req@ffff880094825c00 x1830945991627648/t21474842848(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.956805:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825c00 with x1830945991627648 ext(2781184->2908159) 00010000:00010000:0.0:1746127002.956812:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746127002.956824:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 35 pid: 9613 timeout: 997 lvb_type: 0 00002000:00010000:0.0:1746127002.956830:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094825c00 00000100:00100000:0.0:1746127002.960779:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.960839:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.960934:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991628032 00000100:00100000:1.0:1746127002.960943:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991628032 00002000:00100000:1.0:1746127002.960991:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1847296->1851391) req@ffff8800a7c50700 x1830945991628032/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.961000:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50700 with x1830945991628032 ext(1847296->1851391) 00002000:00010000:1.0:1746127002.961005:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c50700 00000100:00100000:1.0:1746127002.961039:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8582 00000100:00100000:1.0:1746127002.961047:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991628032:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127002.961226:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991628032:12345-192.168.203.42@tcp:3:cat.0 Request processed in 179us (385us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127002.961233:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8582 00002000:00100000:1.0:1746127002.961238:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1847296->1851391) req@ffff8800a7c50700 x1830945991628032/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127002.961244:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50700 with x1830945991628032 ext(1847296->1851391) 00002000:00010000:1.0:1746127002.961246:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c50700 00000100:00100000:3.0:1746127002.961641:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991627904 00000100:00100000:3.0:1746127002.961645:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991627904 00000100:00100000:3.0:1746127002.961671:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21553 00000100:00100000:3.0:1746127002.961676:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4251:x1830945991627904:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.961685:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.961700:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5303b expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.961725:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.961733:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.961735:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127002.961738:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 22 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.961767:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.961778:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 39 pid: 12340 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127002.961789:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994246272:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.961841:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.962325:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.962353:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.962377:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.962423:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991628288 00000100:00100000:0.0:1746127002.962427:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991628288 00000100:00100000:0.0:1746127002.962448:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991628160 00000100:00100000:0.0:1746127002.962449:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991628160 00000100:00100000:0.0:1746127002.962459:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991628416 00000100:00100000:0.0:1746127002.962461:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991628416 00000100:00100000:0.0:1746127002.962473:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21554 00000100:00100000:0.0:1746127002.962478:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991628288:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.962486:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.962496:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9a58 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53049 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.962528:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994246400:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.962560:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.962577:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21555 00000100:00100000:0.0:1746127002.962582:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991628160:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.962588:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.962595:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53042 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.962604:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.962606:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127002.962612:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 39 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.962627:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 39 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.962636:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6c00, rc 0) 00000100:00100000:0.0:1746127002.962653:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991628160:12345-192.168.203.42@tcp:101:cat.0 Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.962658:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21555 00000100:00100000:0.0:1746127002.962669:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21556 00000100:00100000:0.0:1746127002.962673:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991628416:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127002.962678:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127002.962683:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9a66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53050 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127002.962704:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994246528:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127002.962723:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.965201:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994246272:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127002.965230:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 22 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127002.965249:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfc800, rc 0) 00000100:00100000:1.0:1746127002.965502:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994246400:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127002.965527:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9a58 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53049 expref: 39 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127002.965536:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9a58 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53049 expref: 39 pid: 12333 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127002.965884:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4251:x1830945991627904:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4204us (5112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127002.965893:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21553 00000100:00100000:2.0:1746127002.966089:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.966111:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991628544 00000100:00100000:2.0:1746127002.966116:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991628544 00002000:00100000:2.0:1746127002.966171:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a8ee9f80 x1830945991628544/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 504/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.966180:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9f80 with x1830945991628544 ext(1048576->2097151) 00010000:00010000:2.0:1746127002.966186:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 40 pid: 12340 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127002.966195:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 40 pid: 12340 timeout: 998 lvb_type: 0 00002000:00010000:2.0:1746127002.966202:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8ee9f80 00000100:00100000:2.0:1746127002.966220:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1889 00000100:00100000:2.0:1746127002.966227:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991628544:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127002.966277:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994246528:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127002.966297:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9a66 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53050 expref: 38 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.966309:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9a66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53050 expref: 38 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127002.966321:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6400, rc 0) 00000100:00100000:0.0:1746127002.966341:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991628416:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3667us (3964us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127002.966347:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21556 00010000:00010000:1.0:1746127002.966701:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb7000, rc 0) 00000100:00100000:1.0:1746127002.966733:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991628288:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4254us (4408us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127002.966738:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21554 00000100:00100000:3.0:1746127002.969020:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.969451:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991628672 00000100:00100000:1.0:1746127002.969460:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991628672 00010000:00010000:1.0:1746127002.970100:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 36 pid: 9613 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746127002.970156:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10073 00000100:00100000:1.0:1746127002.970166:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991628672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.970180:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.970198:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 36 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.970211:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 36 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.970308:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6ef98f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2781184->2908159) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f70 expref: 36 pid: 9613 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746127002.970498:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.970501:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.970508:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.970518:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.970557:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.970569:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994246656:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127002.970938:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127002.971045:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991628544:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4817us (4955us total) trans 17179875585 rc 0/0 00000100:00100000:2.0:1746127002.971067:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1889 00002000:00100000:2.0:1746127002.971077:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a8ee9f80 x1830945991628544/t17179875585(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:8/0 lens 504/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746127002.971085:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:2.0:1746127002.971092:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9f80 with x1830945991628544 ext(1048576->2097151) 00010000:00010000:2.0:1746127002.971098:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 42 pid: 12340 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127002.971109:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 42 pid: 12340 timeout: 998 lvb_type: 0 00002000:00010000:2.0:1746127002.971115:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8ee9f80 00000100:00100000:1.0:1746127002.971303:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991628800 00000100:00100000:1.0:1746127002.971308:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991628800 00000100:00100000:1.0:1746127002.971345:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21557 00000100:00100000:1.0:1746127002.971351:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4245:x1830945991628800:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127002.971364:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127002.971375:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53057 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.971393:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.971399:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127002.971401:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127002.971404:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4825088->5242879] (req 4825088->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 37 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.971424:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.971433:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 19 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127002.971445:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.971446:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994246784:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127002.971796:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991629056 00000100:00100000:3.0:1746127002.971800:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991629056 00000100:00100000:1.0:1746127002.971921:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127002.971934:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6569 00000100:00100000:3.0:1746127002.971940:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4248:x1830945991629056:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127002.972662:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4248:x1830945991629056:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 721us (1215us total) trans 8589938190 rc 0/0 00000100:00100000:3.0:1746127002.972669:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6569 00000100:00100000:1.0:1746127002.973355:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994246656:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127002.973372:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.973425:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991628672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3261us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.973433:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10073 00000100:00100000:0.0:1746127002.973663:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994246784:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127002.973684:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4825088->5242879] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 36 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127002.973697:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47a00, rc 0) 00000100:00100000:0.0:1746127002.973967:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4245:x1830945991628800:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2614us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127002.973973:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21557 00000100:00100000:0.0:1746127002.974761:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.974802:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991629184 00000100:00100000:0.0:1746127002.974805:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.974809:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991629184 00010000:00010000:1.0:1746127002.974834:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 42 pid: 12340 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127002.974867:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10074 00000100:00100000:2.0:1746127002.974887:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991629440 00000100:00100000:2.0:1746127002.974891:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991629440 00002000:00100000:2.0:1746127002.974918:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2125824->2129919) req@ffff8800a7c51500 x1830945991629440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.974926:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51500 with x1830945991629440 ext(2125824->2129919) 00010000:00010000:2.0:1746127002.974933:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 20 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127002.974943:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 20 pid: 11152 timeout: 998 lvb_type: 0 00002000:00010000:2.0:1746127002.974949:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c51500 00000100:00100000:2.0:1746127002.974964:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1890 00000100:00100000:2.0:1746127002.974969:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991629440:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127002.975005:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991629184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.975014:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.975031:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 42 pid: 12340 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127002.975039:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 42 pid: 12340 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127002.975104:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991629440:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 134us (298us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127002.975109:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1890 00002000:00100000:2.0:1746127002.975116:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2125824->2129919) req@ffff8800a7c51500 x1830945991629440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/4536 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127002.975123:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51500 with x1830945991629440 ext(2125824->2129919) 00010000:00010000:2.0:1746127002.975126:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 20 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127002.975155:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 20 pid: 11152 timeout: 998 lvb_type: 0 00002000:00010000:2.0:1746127002.975161:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c51500 00010000:00010000:1.0:1746127002.975220:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfc800/0x34dc807b6ef9867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f1c expref: 42 pid: 12340 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127002.975292:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.975294:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.975300:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 21 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.975307:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 21 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.975333:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 21 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.975344:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994246912:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127002.975870:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.979486:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994246912:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127002.979508:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127002.979551:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991629184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4676us (4790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.979561:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10074 00000100:00100000:1.0:1746127002.980711:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127002.980794:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991629696 00000100:00100000:0.0:1746127002.980802:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991629696 00002000:00100000:0.0:1746127002.980839:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2129919) req@ffff880094825500 x1830945991629696/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746127002.980844:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:0.0:1746127002.980848:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825500 with x1830945991629696 ext(2097152->2129919) 00010000:00010000:0.0:1746127002.980885:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 20 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127002.980900:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 20 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127002.980921:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991629952 00000100:00100000:2.0:1746127002.980925:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991629952 00002000:00100000:2.0:1746127002.980949:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094824e00 x1830945991629952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/0 e 0 to 0 dl 1746127013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:0.0:1746127002.980953:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094825500 00002000:00100000:2.0:1746127002.980955:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824e00 with x1830945991629952 ext(1048576->2097151) 00002000:00010000:2.0:1746127002.980958:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094824e00 00000100:00100000:0.0:1746127002.981072:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1891 00000100:00100000:0.0:1746127002.981080:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991629696:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127002.981082:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8583 00000100:00100000:2.0:1746127002.981086:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991629952:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127002.983025:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991629696:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 1939us (2309us total) trans 21474842849 rc 0/0 00000100:00100000:0.0:1746127002.983038:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1891 00002000:00100000:0.0:1746127002.983047:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2129919) req@ffff880094825500 x1830945991629696/t21474842849(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/448 e 0 to 0 dl 1746127013 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127002.983065:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825500 with x1830945991629696 ext(2097152->2129919) 00010000:00010000:0.0:1746127002.983073:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127002.983087:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746127002.983094:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094825500 00000100:00100000:0.0:1746127002.990839:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.991547:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991630080 00000100:00100000:1.0:1746127002.991555:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991630080 00010000:00010000:1.0:1746127002.991586:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127002.992482:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10075 00000100:00100000:1.0:1746127002.992491:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991630080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127002.992504:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127002.992519:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127002.992530:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127002.992549:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6800/0x34dc807b6ef9a4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2129919) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53034 expref: 22 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127002.993011:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991629952:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 11922us (12164us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127002.993019:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8583 00002000:00100000:3.0:1746127002.993027:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094824e00 x1830945991629952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:8/0 lens 488/440 e 0 to 0 dl 1746127013 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127002.993035:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824e00 with x1830945991629952 ext(1048576->2097151) 00002000:00010000:3.0:1746127002.993039:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094824e00 00010000:00010000:1.0:1746127002.993273:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.993275:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127002.993282:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.993290:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127002.993316:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127002.993326:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994247040:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127002.993581:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127002.997834:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.997858:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994247040:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127002.997873:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127002.997912:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127002.998024:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991630080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5430us (7086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127002.998035:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10075 00000100:00100000:3.0:1746127002.998068:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991630336 00000100:00100000:3.0:1746127002.998074:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991630336 00000100:00100000:3.0:1746127002.998164:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991630208 00000100:00100000:3.0:1746127002.998167:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991630208 00000100:00100000:3.0:1746127002.998182:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21558 00000100:00100000:3.0:1746127002.998188:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991630336:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127002.998203:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127002.998215:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc000/0x34dc807b6ef9a74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53065 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127002.998235:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21559 00000100:00100000:2.0:1746127002.998243:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991630208:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.998250:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127002.998259:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994247168:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127002.998260:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5305e expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.998272:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.998274:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127002.998280:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 42 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.998292:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 42 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127002.998299:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643e00, rc 0) 00000100:00100000:2.0:1746127002.998628:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991630208:12345-192.168.203.42@tcp:101:cat.0 Request processed in 385us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127002.998634:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21559 00000100:00100000:3.0:1746127002.998636:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127002.998637:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127002.999161:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991630464 00000100:00100000:2.0:1746127002.999166:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991630464 00000100:00100000:2.0:1746127002.999411:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21560 00000100:00100000:2.0:1746127002.999418:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4251:x1830945991630464:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127002.999426:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127002.999435:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5306c expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.999451:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.999458:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127002.999459:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127002.999462:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 23 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.999477:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127002.999487:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 41 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127002.999495:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994247296:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127002.999542:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127003.003289:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994247296:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.003290:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127003.003314:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 23 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.003323:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991630592 00010000:00010000:2.0:1746127003.003328:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642c00, rc 0) 00000100:00100000:0.0:1746127003.003328:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991630592 00002000:00100000:0.0:1746127003.003358:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1851391) req@ffff8800a7c50380 x1830945991630592/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.003366:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50380 with x1830945991630592 ext(1048576->1851391) 00010000:00010000:0.0:1746127003.003372:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 42 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.003383:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 42 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.003555:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4251:x1830945991630464:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4137us (4917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.003562:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21560 00002000:00010000:0.0:1746127003.003583:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c50380 00000100:00100000:0.0:1746127003.003812:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1892 00000100:00100000:0.0:1746127003.003823:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991630592:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127003.004036:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994247168:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127003.004066:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc000/0x34dc807b6ef9a74 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53065 expref: 37 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.004075:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfc000/0x34dc807b6ef9a74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53065 expref: 37 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.004087:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfc000, rc 0) 00000100:00100000:3.0:1746127003.004105:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991630336:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5917us (6278us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127003.004111:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21558 00000100:00100000:0.0:1746127003.013124:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991630592:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9298us (9829us total) trans 17179875586 rc 0/0 00000100:00100000:0.0:1746127003.013147:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1892 00002000:00100000:0.0:1746127003.013157:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1851391) req@ffff8800a7c50380 x1830945991630592/t17179875586(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.013165:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50380 with x1830945991630592 ext(1048576->1851391) 00010000:00010000:0.0:1746127003.013173:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 44 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.013184:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 44 pid: 11152 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746127003.013190:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c50380 00000100:00100000:0.0:1746127003.013548:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.014448:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991630848 00000100:00100000:2.0:1746127003.014455:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991630848 00002000:00100000:2.0:1746127003.014481:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff88012cc9d880 x1830945991630848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.014489:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d880 with x1830945991630848 ext(4825088->4829183) 00002000:00010000:2.0:1746127003.014493:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9d880 00000100:00100000:2.0:1746127003.014517:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8584 00000100:00100000:2.0:1746127003.014524:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991630848:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127003.014615:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991630848:12345-192.168.203.42@tcp:3:cat.0 Request processed in 92us (1067us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127003.014624:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8584 00002000:00100000:2.0:1746127003.014629:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff88012cc9d880 x1830945991630848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.014635:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d880 with x1830945991630848 ext(4825088->4829183) 00002000:00010000:2.0:1746127003.014637:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9d880 00000100:00100000:0.0:1746127003.016909:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.016976:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991630976 00000100:00100000:1.0:1746127003.016981:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991630976 00010000:00010000:1.0:1746127003.016999:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 44 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.017022:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10076 00000100:00100000:1.0:1746127003.017026:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991630976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.017033:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746127003.017041:0:10641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127000 -> 1746127001 00002000:00010000:1.0:1746127003.017043:0:10641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127000 -> 1746127001 00010000:00010000:1.0:1746127003.017046:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 44 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.017074:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 44 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.017091:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096642e00/0x34dc807b6ef9a43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5302d expref: 44 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.017115:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.017117:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.017123:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 22 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.017220:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 22 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.017247:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 22 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.017258:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994247424:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127003.017327:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.018659:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994247424:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127003.018669:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.018696:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991630976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1669us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.018703:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10076 00000100:00100000:0.0:1746127003.022553:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.022598:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.022687:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991631360 00000100:00100000:2.0:1746127003.022699:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991631360 00000100:00100000:3.0:1746127003.022707:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991631488 00000100:00100000:3.0:1746127003.022711:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991631488 00002000:00100000:3.0:1746127003.022740:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2084863) req@ffff88009ab0f480 x1830945991631488/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.022740:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012cc9dc00 x1830945991631360/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.022749:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0f480 with x1830945991631488 ext(1048576->2084863) 00002000:00100000:2.0:1746127003.022749:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9dc00 with x1830945991631360 ext(1048576->2097151) 00002000:00010000:2.0:1746127003.022753:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9dc00 00002000:00010000:3.0:1746127003.022754:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0f480 00000100:00100000:3.0:1746127003.022787:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8585 00000100:00100000:3.0:1746127003.022795:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991631488:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127003.023111:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8586 00000100:00100000:2.0:1746127003.023118:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991631360:12345-192.168.203.42@tcp:3:multiop.0 00000100:00080000:0.0:1746127003.023274:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746127003.023277:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746127003.033759:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991631488:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 10954us (11149us total) trans 0 rc 1036288/1036288 00000100:00100000:3.0:1746127003.033772:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8585 00002000:00100000:3.0:1746127003.033783:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2084863) req@ffff88009ab0f480 x1830945991631488/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.033792:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0f480 with x1830945991631488 ext(1048576->2084863) 00002000:00010000:3.0:1746127003.033798:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0f480 00000100:00100000:2.0:1746127003.035794:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991631360:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 12668us (13239us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127003.035805:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8586 00002000:00100000:2.0:1746127003.035816:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012cc9dc00 x1830945991631360/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.035824:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9dc00 with x1830945991631360 ext(1048576->2097151) 00002000:00010000:2.0:1746127003.035829:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9dc00 00000100:00100000:0.0:1746127003.047769:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.047814:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.047971:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991631616 00000100:00100000:2.0:1746127003.047979:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991631616 00000100:00100000:2.0:1746127003.048759:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991631744 00000100:00100000:2.0:1746127003.048763:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991631744 00000100:00100000:2.0:1746127003.048785:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21561 00000100:00100000:2.0:1746127003.048791:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991631616:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127003.048807:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.048819:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53073 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.048833:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21562 00010000:00010000:2.0:1746127003.048837:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.048838:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.048845:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 22 pid: 9611 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127003.048850:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991631744:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127003.048857:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 22 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.048867:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643000, rc 0) 00010000:00010000:3.0:1746127003.048870:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.048887:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5307a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.048901:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991631616:12345-192.168.203.42@tcp:101:cat.0 Request processed in 111us (1139us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127003.048906:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.048907:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127003.048907:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21561 00010000:00010000:3.0:1746127003.048915:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 24 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.048928:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 24 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.048938:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfde00, rc 0) 00000100:00100000:3.0:1746127003.048974:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991631744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 132us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.048981:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21562 00000100:00100000:0.0:1746127003.060093:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.060279:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991632128 00000100:00100000:2.0:1746127003.060287:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991632128 00002000:00100000:2.0:1746127003.060323:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009ab0c000 x1830945991632128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.060332:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0c000 with x1830945991632128 ext(2097152->4194303) 00002000:00010000:2.0:1746127003.060337:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0c000 00000100:00100000:2.0:1746127003.060365:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8587 00000100:00100000:2.0:1746127003.060371:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991632128:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127003.061247:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.061520:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991632256 00000100:00100000:3.0:1746127003.061524:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991632256 00002000:00100000:3.0:1746127003.061546:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880094827480 x1830945991632256/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.061553:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094827480 with x1830945991632256 ext(2097152->4194303) 00002000:00010000:3.0:1746127003.061556:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094827480 00000100:00100000:3.0:1746127003.061581:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8588 00000100:00100000:3.0:1746127003.061586:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991632256:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127003.076250:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991632128:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15868us (16151us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127003.076262:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8587 00002000:00100000:2.0:1746127003.076271:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009ab0c000 x1830945991632128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.076278:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0c000 with x1830945991632128 ext(2097152->4194303) 00002000:00010000:2.0:1746127003.076283:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0c000 00000100:00100000:3.0:1746127003.080901:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991632256:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19306us (19647us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127003.080911:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8588 00002000:00100000:3.0:1746127003.080921:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880094827480 x1830945991632256/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.080929:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094827480 with x1830945991632256 ext(2097152->4194303) 00002000:00010000:3.0:1746127003.080935:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094827480 00000100:00100000:0.0:1746127003.089016:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.089112:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991632512 00000100:00100000:3.0:1746127003.089120:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991632512 00002000:00100000:3.0:1746127003.089183:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0d880 x1830945991632512/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.089192:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d880 with x1830945991632512 ext(4194304->4829183) 00002000:00010000:3.0:1746127003.089197:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0d880 00000100:00100000:3.0:1746127003.089301:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8589 00000100:00100000:3.0:1746127003.089309:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991632512:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.093543:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991632512:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4227us (4527us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127003.093554:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8589 00002000:00100000:3.0:1746127003.093564:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0d880 x1830945991632512/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.093572:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d880 with x1830945991632512 ext(4194304->4829183) 00002000:00010000:3.0:1746127003.093577:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0d880 00000100:00100000:0.0:1746127003.138278:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.139033:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991632768 00000100:00100000:2.0:1746127003.139043:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991632768 00000100:00080000:0.0:1746127003.139216:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746127003.139965:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17257 00000100:00100000:2.0:1746127003.139977:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4261:x1830945991632768:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127003.140003:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.140021:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642200/0x34dc807b6ef9a97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53081 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.140105:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140118:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140157:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140172:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140177:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140182:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140285:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9aac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140295:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9aac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140300:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9aac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127003.140309:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127003.140380:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140385:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140391:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140397:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140402:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096643400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127003.140406:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140412:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140422:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127003.140424:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127003.140429:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140437:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6ef9a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140460:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140465:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140469:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140473:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096642600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127003.140476:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140480:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140486:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7d00) 00010000:00010000:2.0:1746127003.140488:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127003.140490:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140494:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642600/0x34dc807b6ef9aa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.140532:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642200/0x34dc807b6ef9a97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53081 expref: 39 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.140544:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9aac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53081 expref: 38 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.140553:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.140555:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127003.140557:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642e00, rc 0) 00000100:00100000:2.0:1746127003.140695:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4261:x1830945991632768:12345-192.168.203.42@tcp:101:cat.0 Request processed in 721us (2425us total) trans 8589938191 rc 0/0 00000100:00100000:2.0:1746127003.140701:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17257 00000100:00100000:2.0:1746127003.144691:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.144755:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.144756:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991632896 00000100:00100000:1.0:1746127003.144765:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991632896 00000100:00100000:3.0:1746127003.144800:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991633152 00000100:00100000:3.0:1746127003.144805:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991633152 00000100:00100000:3.0:1746127003.144827:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6570 00000100:00100000:1.0:1746127003.144827:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1020 00000100:00100000:3.0:1746127003.144834:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4261:x1830945991633152:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127003.144834:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991632896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.144847:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.144871:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642e00/0x34dc807b6ef9aac lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53081 expref: 39 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.144900:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.144904:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.144948:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991632896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 114us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.144954:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1020 00000100:00100000:3.0:1746127003.145860:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4261:x1830945991633152:12345-192.168.203.42@tcp:35:cat.0 Request processed in 1025us (1103us total) trans 8589938192 rc 0/0 00000100:00100000:3.0:1746127003.145867:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6570 00000100:00100000:0.0:1746127003.153674:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.154297:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.154958:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991633408 00000100:00100000:1.0:1746127003.154969:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991633408 00000100:00100000:1.0:1746127003.155472:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991633280 00000100:00100000:1.0:1746127003.155477:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991633280 00000100:00100000:3.0:1746127003.155482:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21563 00000100:00100000:3.0:1746127003.155493:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991633408:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.155513:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127003.155520:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21564 00000100:00100000:1.0:1746127003.155525:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991633280:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.155532:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd000/0x34dc807b6ef9aba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5308f expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.155535:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127003.155587:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994247552:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127003.155680:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746127003.156764:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53088 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.156786:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.156788:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.156797:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 44 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.156811:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 44 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.156822:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfec00, rc 0) 00000100:00100000:1.0:1746127003.156852:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991633280:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1327us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.156858:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21564 00000100:00100000:3.0:1746127003.158449:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994247552:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127003.158482:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd000/0x34dc807b6ef9aba lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5308f expref: 37 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.158501:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd000/0x34dc807b6ef9aba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5308f expref: 37 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.158529:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfd000, rc 0) 00000100:00100000:3.0:1746127003.158571:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991633408:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3080us (4908us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127003.158578:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21563 00000100:00100000:0.0:1746127003.168335:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.168368:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.168401:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991633792 00000100:00100000:0.0:1746127003.168404:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.168411:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991633792 00000100:00100000:2.0:1746127003.168427:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991634048 00000100:00100000:2.0:1746127003.168431:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991634048 00002000:00100000:2.0:1746127003.168457:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009ab0dc00 x1830945991634048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.168458:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009ab0ed80 x1830945991633792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.168464:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0dc00 with x1830945991634048 ext(1048576->2097151) 00002000:00100000:3.0:1746127003.168465:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ed80 with x1830945991633792 ext(0->1048575) 00002000:00010000:2.0:1746127003.168469:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0dc00 00002000:00010000:3.0:1746127003.168470:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ed80 00000100:00100000:3.0:1746127003.168485:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991633920 00000100:00100000:3.0:1746127003.168488:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991633920 00000100:00100000:2.0:1746127003.168497:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8590 00002000:00100000:3.0:1746127003.168498:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009ab0fb80 x1830945991633920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127003.168502:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991633792:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:3.0:1746127003.168504:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0fb80 with x1830945991633920 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.168507:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0fb80 00000100:00100000:1.0:1746127003.168509:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8591 00000100:00100000:1.0:1746127003.168517:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991634048:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.168666:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8592 00000100:00100000:3.0:1746127003.168674:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991633920:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.183326:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991634048:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14798us (14945us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127003.183338:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8591 00002000:00100000:3.0:1746127003.183353:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009ab0dc00 x1830945991634048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.183363:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0dc00 with x1830945991634048 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.183369:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0dc00 00000100:00100000:2.0:1746127003.188913:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991633792:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20399us (20574us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127003.188926:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8590 00002000:00100000:2.0:1746127003.188937:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009ab0ed80 x1830945991633792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.188946:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ed80 with x1830945991633792 ext(0->1048575) 00002000:00010000:2.0:1746127003.188952:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ed80 00000100:00100000:3.0:1746127003.194896:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991633920:12345-192.168.203.42@tcp:3:cat.0 Request processed in 26211us (26479us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127003.194908:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8592 00002000:00100000:3.0:1746127003.194919:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009ab0fb80 x1830945991633920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.194927:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0fb80 with x1830945991633920 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.194933:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0fb80 00000100:00100000:0.0:1746127003.206796:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.206924:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991634304 00000100:00100000:3.0:1746127003.206933:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991634304 00000100:00100000:1.0:1746127003.207410:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21565 00000100:00100000:1.0:1746127003.207420:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4263:x1830945991634304:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127003.207435:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.207450:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53096 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.207473:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.207481:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.207487:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.207489:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.207491:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.207516:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.207526:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 23 pid: 9611 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.207536:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994247680:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.208976:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.208992:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 35 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.209001:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994247808:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.209140:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.212670:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994247680:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.214230:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.214507:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991634432 00000100:00100000:2.0:1746127003.214513:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991634432 00010000:00010000:2.0:1746127003.214542:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 24 pid: 9611 timeout: 998 lvb_type: 1 00000100:00100000:2.0:1746127003.214566:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10077 00000100:00100000:2.0:1746127003.214572:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991634432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.214583:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.214599:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 24 pid: 9611 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.214608:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 24 pid: 9611 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.214626:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096643000/0x34dc807b6ef9a89 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53073 expref: 24 pid: 9611 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.214641:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127003.214672:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991634432:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 100us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.214678:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10077 00000100:00100000:0.0:1746127003.217778:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.217846:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.217877:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991634688 00000100:00100000:1.0:1746127003.217887:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991634688 00000100:00100000:0.0:1746127003.217901:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994247808:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.217917:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 36 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.217929:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.217945:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe400, rc 0) 00000100:00100000:1.0:1746127003.217955:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10078 00000100:00100000:1.0:1746127003.217962:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991634688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.217973:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127003.217983:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4263:x1830945991634304:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10565us (11195us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127003.217986:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 36 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.217991:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21565 00010000:00010000:1.0:1746127003.217996:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 36 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.218011:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991634560 00010000:00010000:1.0:1746127003.218013:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a47a00/0x34dc807b6ef9a6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53057 expref: 36 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.218014:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991634560 00010000:00010000:1.0:1746127003.218028:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.218030:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.218036:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 21 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.218038:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21566 00010000:00010000:1.0:1746127003.218043:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 21 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.218044:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4261:x1830945991634560:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.218066:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.218077:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5309d expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.218083:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 21 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.218094:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994247936:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127003.218096:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.218102:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127003.218103:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127003.218106:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 37 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.218127:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.218159:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 21 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.218168:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994248064:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.218177:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.218199:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.225683:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.225980:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991634944 00000100:00100000:2.0:1746127003.225990:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991634944 00000100:00100000:2.0:1746127003.226062:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17258 00000100:00100000:2.0:1746127003.226071:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4265:x1830945991634944:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127003.226095:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.226114:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980a00/0x34dc807b6ef9ad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530a4 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.226224:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226236:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226247:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226259:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226264:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226269:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226361:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9aeb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226370:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9aeb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226376:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9aeb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127003.226384:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127003.226451:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226457:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226465:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226470:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226475:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e981400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127003.226479:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226484:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226494:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127003.226496:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127003.226501:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226505:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226526:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226530:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226534:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226538:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e980600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127003.226540:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226548:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226554:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7d00) 00010000:00010000:2.0:1746127003.226556:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127003.226558:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226563:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980600/0x34dc807b6ef9ae4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.226601:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980a00/0x34dc807b6ef9ad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530a4 expref: 41 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.226612:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9aeb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530a4 expref: 40 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.226618:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.226620:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127003.226622:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e980400, rc 0) 00000100:00100000:2.0:1746127003.226682:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4265:x1830945991634944:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 612us (1009us total) trans 8589938193 rc 0/0 00000100:00100000:2.0:1746127003.226688:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17258 00000100:00100000:0.0:1746127003.227844:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994248064:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127003.227869:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 37 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.227883:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911df800, rc 0) 00000100:00100000:0.0:1746127003.227903:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4261:x1830945991634560:12345-192.168.203.42@tcp:101:cat.0 Request processed in 9859us (10134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.227910:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21566 00000100:00100000:0.0:1746127003.227946:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.227993:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991635072 00000100:00100000:3.0:1746127003.227999:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991635072 00000100:00100000:0.0:1746127003.228019:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127003.228031:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (2056192->2097151) req@ffff8800a2fdaa00 x1830945991635072/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.228040:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdaa00 with x1830945991635072 ext(2056192->2097151) 00010000:00010000:3.0:1746127003.228046:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 22 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.228068:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 22 pid: 16295 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746127003.228074:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdaa00 00000100:00100000:1.0:1746127003.228188:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994247936:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127003.228199:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.228225:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991634688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10264us (10378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.228232:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10078 00000100:00100000:0.0:1746127003.228411:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991635328 00000100:00100000:0.0:1746127003.228415:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991635328 00000100:00100000:3.0:1746127003.228423:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1893 00002000:00100000:0.0:1746127003.228429:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2109440->2113535) req@ffff8800a2fd8000 x1830945991635328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746127003.228431:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991635072:12345-192.168.203.42@tcp:4:multiop.0 00002000:00100000:0.0:1746127003.228436:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd8000 with x1830945991635328 ext(2109440->2113535) 00002000:00010000:0.0:1746127003.228438:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd8000 00000100:00100000:0.0:1746127003.228456:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8593 00000100:00100000:0.0:1746127003.228461:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991635328:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127003.229093:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991635328:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 630us (1072us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127003.229099:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8593 00002000:00100000:3.0:1746127003.229104:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2109440->2113535) req@ffff8800a2fd8000 x1830945991635328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.229111:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd8000 with x1830945991635328 ext(2109440->2113535) 00002000:00010000:3.0:1746127003.229114:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd8000 00000100:00100000:1.0:1746127003.246753:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.246838:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991635456 00000100:00100000:2.0:1746127003.246846:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991635456 00000100:00100000:2.0:1746127003.246909:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1021 00000100:00100000:2.0:1746127003.246917:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991635456:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.246930:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.246956:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9aeb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530a4 expref: 40 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.246989:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.246993:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127003.247035:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991635456:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.250019:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991635072:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 21580us (22063us total) trans 21474842850 rc 0/0 00000100:00100000:3.0:1746127003.250032:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1893 00002000:00100000:3.0:1746127003.250043:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (2056192->2097151) req@ffff8800a2fdaa00 x1830945991635072/t21474842850(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.250060:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdaa00 with x1830945991635072 ext(2056192->2097151) 00010000:00010000:3.0:1746127003.250072:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 24 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.250086:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 24 pid: 16295 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746127003.250093:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdaa00 00000100:00100000:2.0:1746127003.250314:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1021 00000100:00100000:0.0:1746127003.273619:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.273793:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991635584 00000100:00100000:2.0:1746127003.273802:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991635584 00010000:00010000:2.0:1746127003.274025:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 24 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.274871:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10079 00000100:00100000:2.0:1746127003.275367:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991635584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.275619:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.275680:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 24 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.275693:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 24 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.275720:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6ef9a2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53018 expref: 24 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.275936:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.275939:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.275947:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.275955:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.276926:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 35 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.276942:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994248192:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127003.277081:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.280880:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.281003:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994248192:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127003.281031:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127003.281079:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991635840 00000100:00100000:3.0:1746127003.281087:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991635840 00000100:00100000:2.0:1746127003.281087:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991635584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6208us (7478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.281098:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10079 00002000:00100000:3.0:1746127003.281157:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fda300 x1830945991635840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.281171:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fda300 with x1830945991635840 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.281176:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fda300 00000100:00100000:3.0:1746127003.281203:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8594 00000100:00100000:3.0:1746127003.281211:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991635840:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.300336:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991635840:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19115us (19453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127003.300348:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8594 00002000:00100000:3.0:1746127003.300359:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fda300 x1830945991635840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.300368:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fda300 with x1830945991635840 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.300374:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fda300 00000100:00100000:0.0:1746127003.310658:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.310837:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991635968 00000100:00100000:2.0:1746127003.310847:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991635968 00000100:00100000:2.0:1746127003.310910:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21567 00000100:00100000:2.0:1746127003.310926:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991635968:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127003.310946:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.310963:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530ab expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.310989:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.310991:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.311004:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.311024:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.311041:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e980600, rc 0) 00000100:00100000:2.0:1746127003.311095:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991635968:12345-192.168.203.42@tcp:101:cat.0 Request processed in 174us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.311101:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21567 00000100:00100000:0.0:1746127003.319665:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.319767:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991636096 00000100:00100000:3.0:1746127003.319776:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991636096 00000100:00100000:3.0:1746127003.319833:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21568 00000100:00100000:3.0:1746127003.319841:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4261:x1830945991636096:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.319860:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.319881:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530b2 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.319910:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.319917:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127003.319919:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127003.319923:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 37 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.319955:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.319967:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 23 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.319980:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994248320:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.320079:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.321159:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.321249:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991636352 00000100:00100000:3.0:1746127003.321254:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991636352 00002000:00100000:3.0:1746127003.321287:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fd9880 x1830945991636352/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.321296:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9880 with x1830945991636352 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.321301:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9880 00000100:00100000:3.0:1746127003.321327:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8595 00000100:00100000:3.0:1746127003.321333:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991636352:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127003.327257:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.327299:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991636480 00000100:00100000:0.0:1746127003.327307:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991636480 00002000:00100000:0.0:1746127003.327344:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2113535) req@ffff8800a2fdb100 x1830945991636480/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 16872/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.327354:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb100 with x1830945991636480 ext(2097152->2113535) 00010000:00010000:0.0:1746127003.327362:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 26 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.327375:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 26 pid: 12333 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746127003.327386:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdb100 00000100:00100000:0.0:1746127003.327403:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1894 00000100:00100000:0.0:1746127003.327410:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991636480:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127003.327523:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994248320:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.327547:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 37 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.327560:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfd400, rc 0) 00000100:00100000:3.0:1746127003.327600:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4261:x1830945991636096:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7760us (7946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.327611:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21568 00000100:00100000:0.0:1746127003.335815:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991636480:12345-192.168.203.42@tcp:4:cat.0 Request processed in 8395us (8559us total) trans 21474842851 rc 0/0 00000100:00100000:0.0:1746127003.335825:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1894 00002000:00100000:0.0:1746127003.335836:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2113535) req@ffff8800a2fdb100 x1830945991636480/t21474842851(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 16872/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.335843:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb100 with x1830945991636480 ext(2097152->2113535) 00010000:00010000:0.0:1746127003.335853:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 28 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.335867:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 28 pid: 12333 timeout: 998 lvb_type: 0 00002000:00010000:0.0:1746127003.335874:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdb100 00000100:00100000:3.0:1746127003.340266:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991636352:12345-192.168.203.42@tcp:3:cat.0 Request processed in 18921us (19126us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127003.340278:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8595 00002000:00100000:3.0:1746127003.340289:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fd9880 x1830945991636352/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.340298:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9880 with x1830945991636352 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.340303:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9880 00000100:00100000:3.0:1746127003.346490:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.346522:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991636608 00000100:00100000:2.0:1746127003.346532:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991636608 00010000:00010000:2.0:1746127003.346570:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 26 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.346612:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10080 00000100:00100000:2.0:1746127003.346620:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991636608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.346636:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.346734:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 26 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.346747:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 26 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.346770:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9ac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53096 expref: 26 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.346791:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.346794:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.346801:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 36 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.346809:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 36 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.346843:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 36 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.346855:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994248448:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127003.346932:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127003.354856:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994248448:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127003.354885:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127003.354947:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991636608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8326us (8464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.354958:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10080 00000100:00100000:0.0:1746127003.356917:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.357017:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991636736 00000100:00100000:3.0:1746127003.357026:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991636736 00000100:00100000:3.0:1746127003.357095:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21569 00000100:00100000:3.0:1746127003.357103:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4269:x1830945991636736:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.357124:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.357165:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530b9 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.357190:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.357191:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.357199:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.357213:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.357224:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfca00, rc 0) 00000100:00100000:3.0:1746127003.357279:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4269:x1830945991636736:12345-192.168.203.42@tcp:101:cat.0 Request processed in 176us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.357284:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21569 00000100:00100000:0.0:1746127003.360515:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.360655:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991636992 00000100:00100000:3.0:1746127003.360665:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991636992 00002000:00100000:3.0:1746127003.360712:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a2fdb480 x1830945991636992/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.360722:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb480 with x1830945991636992 ext(2097152->4194303) 00002000:00010000:3.0:1746127003.360727:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fdb480 00000100:00100000:3.0:1746127003.360755:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8596 00000100:00100000:3.0:1746127003.360761:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991636992:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127003.372117:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.374634:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991637248 00000100:00100000:3.0:1746127003.374646:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991637248 00002000:00100000:3.0:1746127003.374693:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a2fd9f80 x1830945991637248/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.374704:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9f80 with x1830945991637248 ext(2097152->4194303) 00002000:00010000:3.0:1746127003.374709:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9f80 00000100:00100000:3.0:1746127003.374733:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8597 00000100:00100000:3.0:1746127003.374741:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991637248:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127003.376994:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991636992:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16223us (16482us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127003.377006:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8596 00002000:00100000:2.0:1746127003.377016:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a2fdb480 x1830945991636992/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.377024:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb480 with x1830945991636992 ext(2097152->4194303) 00002000:00010000:2.0:1746127003.377029:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fdb480 00000100:00100000:0.0:1746127003.388575:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.388723:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991637504 00000100:00100000:2.0:1746127003.388732:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991637504 00002000:00100000:2.0:1746127003.388779:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fd9500 x1830945991637504/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.388788:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9500 with x1830945991637504 ext(4194304->4829183) 00002000:00010000:2.0:1746127003.388793:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9500 00000100:00100000:2.0:1746127003.388823:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8598 00000100:00100000:2.0:1746127003.388831:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991637504:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.389339:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991637248:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14596us (17229us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127003.389346:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8597 00002000:00100000:3.0:1746127003.389352:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a2fd9f80 x1830945991637248/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.389366:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9f80 with x1830945991637248 ext(2097152->4194303) 00002000:00010000:3.0:1746127003.389369:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9f80 00000100:00100000:2.0:1746127003.397483:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991637504:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7660us (7927us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127003.397496:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8598 00002000:00100000:2.0:1746127003.397511:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fd9500 x1830945991637504/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.397520:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9500 with x1830945991637504 ext(4194304->4829183) 00002000:00010000:2.0:1746127003.397526:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9500 00000100:00100000:0.0:1746127003.400968:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.401041:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991637760 00000100:00100000:2.0:1746127003.401060:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991637760 00002000:00100000:2.0:1746127003.401111:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fd9c00 x1830945991637760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.401121:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9c00 with x1830945991637760 ext(4194304->4829183) 00002000:00010000:2.0:1746127003.401126:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9c00 00000100:00100000:2.0:1746127003.401192:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8599 00000100:00100000:2.0:1746127003.401200:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991637760:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.415185:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991637760:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13973us (14212us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127003.415198:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8599 00002000:00100000:3.0:1746127003.415209:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fd9c00 x1830945991637760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.415218:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd9c00 with x1830945991637760 ext(4194304->4829183) 00002000:00010000:3.0:1746127003.415224:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fd9c00 00000100:00100000:0.0:1746127003.422877:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.422973:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991637888 00000100:00100000:2.0:1746127003.422982:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991637888 00000100:00100000:2.0:1746127003.423046:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21570 00000100:00100000:2.0:1746127003.423068:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4265:x1830945991637888:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127003.423086:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.423104:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530c0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.423173:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 45 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.423182:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 23 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.423188:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.423190:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.423194:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3198976->4165631] (req 3198976->4165631) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.423223:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 23 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.423235:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 23 pid: 3542 timeout: 998 lvb_type: 1 00000100:00100000:2.0:1746127003.423247:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994248576:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.423350:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 45 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.423358:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 45 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.423367:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994248704:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.423386:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.427296:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.427353:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994248576:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.427366:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991638016 00000100:00100000:2.0:1746127003.427366:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994248704:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.427372:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991638016 00000100:00100000:1.0:1746127003.427383:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127003.427402:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3198976->4165631] (req 3198976->4165631) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.427406:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 46 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.427413:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991638144 00000100:00100000:1.0:1746127003.427415:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991638144 00010000:00010000:2.0:1746127003.427420:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e980800, rc 0) 00010000:00010000:1.0:1746127003.427428:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 24 pid: 3542 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746127003.427437:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10081 00000100:00100000:3.0:1746127003.427443:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991638016:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.427456:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127003.427467:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10082 00000100:00100000:2.0:1746127003.427474:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991638144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.427475:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 46 pid: 3542 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.427482:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.427484:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 46 pid: 3542 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.427493:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 24 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.427507:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7000/0x34dc807b6ef99a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52fbd expref: 46 pid: 3542 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.427509:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 24 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.427522:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfde00/0x34dc807b6ef9a90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5307a expref: 24 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.427525:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.427527:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.427534:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.427544:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.427552:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127003.427574:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.427586:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994248832:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127003.427587:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991638144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 113us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.427597:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10082 00000100:00100000:2.0:1746127003.427627:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4265:x1830945991637888:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4561us (4763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.427629:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127003.427633:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21570 00000100:00100000:3.0:1746127003.430839:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994248832:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127003.430860:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127003.430900:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991638016:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3455us (3613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.430908:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10081 00000100:00100000:0.0:1746127003.431626:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.431676:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991638400 00000100:00100000:3.0:1746127003.431683:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991638400 00002000:00100000:3.0:1746127003.431721:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3198976->3203071) req@ffff88012d22f800 x1830945991638400/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.431731:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22f800 with x1830945991638400 ext(3198976->3203071) 00002000:00010000:3.0:1746127003.431736:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22f800 00000100:00100000:3.0:1746127003.431761:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8600 00000100:00100000:3.0:1746127003.431768:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991638400:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127003.431889:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991638400:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 121us (264us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127003.431895:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8600 00002000:00100000:3.0:1746127003.431900:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3198976->3203071) req@ffff88012d22f800 x1830945991638400/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.431907:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22f800 with x1830945991638400 ext(3198976->3203071) 00002000:00010000:3.0:1746127003.431910:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22f800 00000100:00100000:0.0:1746127003.443640:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.443709:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991638656 00000100:00100000:3.0:1746127003.443719:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991638656 00002000:00100000:3.0:1746127003.443767:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (4161536->4165631) req@ffff88012d22ce00 x1830945991638656/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.443777:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22ce00 with x1830945991638656 ext(4161536->4165631) 00002000:00010000:3.0:1746127003.443783:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22ce00 00000100:00100000:3.0:1746127003.443815:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8601 00000100:00100000:3.0:1746127003.443823:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991638656:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127003.443967:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991638656:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 144us (338us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127003.443974:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8601 00002000:00100000:3.0:1746127003.443980:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (4161536->4165631) req@ffff88012d22ce00 x1830945991638656/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.443986:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22ce00 with x1830945991638656 ext(4161536->4165631) 00002000:00010000:3.0:1746127003.443988:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22ce00 00000100:00100000:0.0:1746127003.448884:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.449491:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991638912 00000100:00100000:3.0:1746127003.449500:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991638912 00000100:00100000:3.0:1746127003.449545:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6571 00000100:00100000:3.0:1746127003.449553:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4265:x1830945991638912:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127003.449889:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4265:x1830945991638912:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 335us (1013us total) trans 8589938194 rc 0/0 00000100:00100000:3.0:1746127003.449894:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6571 00000100:00100000:0.0:1746127003.517701:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.517830:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639040 00000100:00100000:2.0:1746127003.517840:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639040 00000100:00100000:2.0:1746127003.517917:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17259 00000100:00100000:2.0:1746127003.517924:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4275:x1830945991639040:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127003.517950:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.517968:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980a00/0x34dc807b6ef9b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530c7 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.518029:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518042:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518066:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518080:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518086:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518091:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518194:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518206:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 17 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.518213:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.518245:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 17 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.518256:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 17 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.518269:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994248960:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.518367:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746127003.518421:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746127003.521006:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.522615:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639168 00000100:00100000:3.0:1746127003.522626:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639168 00010000:00010000:3.0:1746127003.522691:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 18 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.522721:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10083 00000100:00100000:3.0:1746127003.522729:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991639168:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.522745:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.522751:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 18 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.522762:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 18 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.522785:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.522789:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.522799:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.522806:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.522824:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127003.522890:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991639168:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 160us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.522896:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10083 00010000:00010000:2.0:1746127003.523263:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9a20 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53011 expref: 17 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.523281:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994248960:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.523304:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523312:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523317:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127003.523367:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127003.523370:0:10958:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127003.523387:0:10958:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523397:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523408:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523414:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523420:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523425:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523430:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e980400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127003.523433:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523439:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523446:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127003.523449:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127003.523452:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523457:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980400/0x34dc807b6ef9b1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523466:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523475:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523480:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523484:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e981a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127003.523486:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523490:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523495:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7800) 00010000:00010000:2.0:1746127003.523497:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127003.523499:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523503:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981a00/0x34dc807b6ef9b23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.523533:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980a00/0x34dc807b6ef9b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.523543:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.523550:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.523552:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127003.523554:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e981400, rc 0) 00000100:00100000:2.0:1746127003.523581:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4275:x1830945991639040:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 5657us (5891us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.523588:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17259 00000100:00080000:0.0:1746127003.523656:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746127003.526254:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.526350:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639424 00000100:00100000:3.0:1746127003.526359:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639424 00000100:00100000:3.0:1746127003.526417:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21571 00000100:00100000:3.0:1746127003.526424:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991639424:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.526446:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.526465:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530d5 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.526480:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.526509:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.526522:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.526536:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.526583:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.526596:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639680 00000100:00100000:1.0:1746127003.526599:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639680 00000100:00100000:1.0:1746127003.526617:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639936 00000100:00100000:1.0:1746127003.526618:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639936 00000100:00100000:1.0:1746127003.526629:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639296 00000100:00100000:1.0:1746127003.526631:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639296 00000100:00100000:1.0:1746127003.526638:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639552 00000100:00100000:1.0:1746127003.526640:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639552 00000100:00100000:1.0:1746127003.526647:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991639808 00000100:00100000:1.0:1746127003.526648:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991639808 00000100:00100000:1.0:1746127003.526657:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21572 00000100:00100000:1.0:1746127003.526662:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991639680:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127003.526671:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.526681:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530e3 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.526701:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.526703:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.526712:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.526727:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.526737:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3200, rc 0) 00000100:00100000:1.0:1746127003.526782:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991639680:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 118us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.526787:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21572 00000100:00100000:1.0:1746127003.526801:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21573 00000100:00100000:1.0:1746127003.526805:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991639936:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127003.526811:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.526818:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9b3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530f1 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.526854:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249088:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127003.526904:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.526923:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21574 00000100:00100000:3.0:1746127003.526929:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991639296:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.526935:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.526942:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530ce expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.526952:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.526953:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.526958:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.526968:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.526980:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009da60a00, rc 0) 00000100:00100000:3.0:1746127003.527001:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991639296:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 72us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.527539:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21575 00000100:00100000:1.0:1746127003.527546:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2027:x1830945991639552:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127003.527552:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.527558:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530dc expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.527567:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.527569:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.527574:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 20 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.527583:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 20 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.527589:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2600, rc 0) 00000100:00100000:1.0:1746127003.527603:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+20:2027:x1830945991639552:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 59us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.527608:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21575 00000100:00100000:1.0:1746127003.527619:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21576 00000100:00100000:1.0:1746127003.527623:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991639808:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127003.527628:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.527633:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530ea expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.527642:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.527643:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.527646:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.527654:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.527661:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2e00, rc 0) 00000100:00100000:1.0:1746127003.527675:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991639808:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 51us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.527680:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21576 00010000:00010000:2.0:1746127003.528069:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.528072:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.528078:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 19 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.528090:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 19 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.528098:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7600, rc 0) 00000100:00100000:2.0:1746127003.528155:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2027:x1830945991639424:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 1702us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.528164:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21571 00000100:00080000:2.0:1746127003.528205:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746127003.528849:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21574 00002000:00010000:1.0:1746127003.531234:0:16295:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746127001 -> 1746127002 00002000:00010000:1.0:1746127003.531243:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127001 -> 1746127002 00002000:00010000:1.0:1746127003.531244:0:16295:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746127001 -> 1746127002 00000100:00100000:1.0:1746127003.531266:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249088:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127003.531301:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9b3f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530f1 expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.531314:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9b3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530f1 expref: 18 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.531351:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3e00, rc 0) 00000100:00100000:1.0:1746127003.531411:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991639936:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 4604us (4900us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127003.531419:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21573 00000100:00100000:0.0:1746127003.534424:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.534611:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991640192 00000100:00100000:2.0:1746127003.534620:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991640192 00000100:00100000:2.0:1746127003.534825:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17260 00000100:00100000:2.0:1746127003.534833:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4275:x1830945991640192:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127003.534855:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.534873:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980200/0x34dc807b6ef9b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530f8 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.534978:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.534993:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.535007:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.535037:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.535061:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 10 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.535074:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994249216:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.535276:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.537207:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.537300:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991640320 00000100:00100000:3.0:1746127003.537306:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991640320 00000100:00100000:2.0:1746127003.537312:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994249216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.537340:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 11 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.537340:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:3.0:1746127003.537364:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10084 00000100:00100000:3.0:1746127003.537371:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991640320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.537383:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.537388:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 11 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.537399:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 11 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.537421:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981400/0x34dc807b6ef9b2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c7 expref: 11 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.537620:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.537625:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.537635:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.537642:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.537659:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127003.537682:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.537689:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:3.0:1746127003.537695:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991640320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 323us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.537701:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10084 00000004:00200000:2.0:1746127003.537707:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127003.538057:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e980200/0x34dc807b6ef9b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530f8 expref: 11 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.538083:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530f8 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.538089:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.538093:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127003.538095:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e981200, rc 0) 00000100:00100000:2.0:1746127003.538116:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4275:x1830945991640192:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 3285us (3702us total) trans 8589938195 rc 0/0 00000100:00100000:2.0:1746127003.538122:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17260 00000100:00100000:0.0:1746127003.540477:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.540898:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991640576 00000100:00100000:3.0:1746127003.540908:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991640576 00000100:00100000:0.0:1746127003.540989:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17261 00000100:00100000:0.0:1746127003.540998:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4275:x1830945991640576:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127003.541024:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.541027:0:7258:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746127003.541067:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981200/0x34dc807b6ef9b62 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530f8 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.541096:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127003.541100:0:7258:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127003.541114:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9b70 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e530ff expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.541228:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541242:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541250:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541264:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541269:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541274:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541279:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebfc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127003.541283:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541289:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541295:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127003.541298:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746127003.541300:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541304:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6ef9b77 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127003.541326:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9b70 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ff expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.541333:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6ef9b70 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ff expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.541340:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe400, rc 0) 00000100:00100000:0.0:1746127003.541399:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4275:x1830945991640576:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 402us (929us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127003.541406:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17261 00000100:00100000:0.0:1746127003.544267:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.544364:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991640832 00000100:00100000:3.0:1746127003.544373:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991640832 00000100:00100000:3.0:1746127003.544517:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6572 00000100:00100000:3.0:1746127003.544525:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4275:x1830945991640832:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:3.0:1746127003.545080:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4275:x1830945991640832:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 555us (820us total) trans 8589938196 rc 0/0 00000100:00100000:3.0:1746127003.545087:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6572 00000100:00100000:0.0:1746127003.547253:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.547306:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.547421:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991641344 00000100:00100000:2.0:1746127003.547421:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991641088 00000100:00100000:3.0:1746127003.547428:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991641344 00000100:00100000:2.0:1746127003.547428:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991641088 00000100:00100000:2.0:1746127003.547611:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1157 00000100:00100000:2.0:1746127003.547620:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2026:x1830945991641344:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1746127003.547742:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2026:x1830945991641344:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 123us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.547748:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1157 00000100:00100000:2.0:1746127003.547763:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1158 00000100:00100000:2.0:1746127003.547772:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2026:x1830945991641088:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1746127003.547793:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2026:x1830945991641088:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 21us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.547797:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1158 00000100:00080000:0.0:1746127003.547880:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746127003.548311:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.548641:0:8223:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991640960 00000100:00100000:3.0:1746127003.548645:0:8223:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991640960 00000100:00100000:0.0:1746127003.548738:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.548808:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991641216 00000100:00100000:1.0:1746127003.548812:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991641216 00000100:00100000:1.0:1746127003.548835:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1159 00000100:00100000:1.0:1746127003.548840:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2026:x1830945991641216:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1746127003.548869:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2026:x1830945991641216:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 29us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.548874:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1159 00000100:00080000:0.0:1746127003.548939:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746127003.549004:0:8223:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 234 00000100:00100000:3.0:1746127003.549011:0:8223:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013084a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee06c75c-5a89-45a6-932b-08fb02e0019d+15:2026:x1830945991640960:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1746127003.549035:0:8223:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013084a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee06c75c-5a89-45a6-932b-08fb02e0019d+15:2026:x1830945991640960:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.549040:0:8223:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 234 00000100:00100000:0.0:1746127003.574392:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.574655:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991641472 00000100:00100000:1.0:1746127003.574666:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991641472 00000100:00100000:1.0:1746127003.575161:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21577 00000100:00100000:1.0:1746127003.575170:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4274:x1830945991641472:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127003.575189:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.575208:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53106 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.575237:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 24 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.575245:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 16 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.575256:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 43 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.575262:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.575264:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.575267:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1921024->2097151] (req 1921024->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 24 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.575297:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 43 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.575955:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 43 pid: 9611 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.575973:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249344:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.576191:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 16 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.576200:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 16 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.576208:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249472:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.576242:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 24 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.576253:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 24 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.576260:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249600:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.576273:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.579838:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249344:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.579853:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249472:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.579861:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249600:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.579891:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1921024->2097151] (req 1921024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 24 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.579910:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2200, rc 0) 00000100:00100000:1.0:1746127003.579966:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4274:x1830945991641472:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4796us (5585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.579975:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21577 00000100:00100000:0.0:1746127003.580636:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.580671:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.580694:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.580737:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991641728 00000100:00100000:0.0:1746127003.580743:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991641728 00010000:00010000:0.0:1746127003.580771:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 44 pid: 9611 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746127003.580796:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991641600 00000100:00100000:0.0:1746127003.580798:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991641600 00010000:00010000:0.0:1746127003.580807:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 17 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746127003.580824:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991641856 00000100:00100000:0.0:1746127003.580826:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991641856 00010000:00010000:0.0:1746127003.580834:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 24 pid: 11152 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.580846:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10085 00000100:00100000:0.0:1746127003.580852:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991641728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127003.580863:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.580882:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 44 pid: 9611 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.580892:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 44 pid: 9611 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.580914:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643e00/0x34dc807b6ef9a7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5305e expref: 44 pid: 9611 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.580929:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127003.580951:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991641728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.580957:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10085 00000100:00100000:0.0:1746127003.580967:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10086 00000100:00100000:0.0:1746127003.580972:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991641600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127003.580977:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.580983:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 17 pid: 12333 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.580991:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 17 pid: 12333 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.581001:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7600/0x34dc807b6ef9b31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530d5 expref: 17 pid: 12333 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.581013:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127003.581027:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991641600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.581032:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10086 00000100:00100000:0.0:1746127003.581042:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10087 00000100:00100000:0.0:1746127003.581046:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991641856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127003.581064:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.581070:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 24 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.581078:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 24 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.581089:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6ef9a51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5303b expref: 24 pid: 11152 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.581097:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.581098:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.581104:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.581111:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.581163:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.581175:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994249728:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127003.581239:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127003.582555:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994249728:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127003.582572:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127003.582602:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991641856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1555us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.582609:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10087 00000100:00100000:0.0:1746127003.583632:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.583751:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991642112 00000100:00100000:2.0:1746127003.583756:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991642112 00002000:00100000:2.0:1746127003.583803:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1921024->1925119) req@ffff88007edd6d80 x1830945991642112/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.583819:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd6d80 with x1830945991642112 ext(1921024->1925119) 00002000:00010000:2.0:1746127003.583823:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd6d80 00000100:00100000:2.0:1746127003.584096:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8602 00000100:00100000:2.0:1746127003.584104:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991642112:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127003.584267:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991642112:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 164us (642us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127003.584273:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8602 00002000:00100000:2.0:1746127003.584278:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1921024->1925119) req@ffff88007edd6d80 x1830945991642112/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.584285:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd6d80 with x1830945991642112 ext(1921024->1925119) 00002000:00010000:2.0:1746127003.584288:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd6d80 00000100:00100000:0.0:1746127003.587352:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.587516:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991642240 00000100:00100000:1.0:1746127003.587525:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991642240 00000100:00100000:1.0:1746127003.587573:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21578 00000100:00100000:1.0:1746127003.587581:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4274:x1830945991642240:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127003.587598:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.587617:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5310d expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.587649:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 24 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.587656:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 15 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.587664:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 42 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.587670:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.587671:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.587674:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1667071] (req 1048576->1667071) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 24 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.587702:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 42 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.587712:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 42 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.587723:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249856:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.587823:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 15 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.587831:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 15 pid: 9612 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.587848:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249984:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.588025:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 24 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.588033:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 24 pid: 9611 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.588041:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994250112:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.588256:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.589929:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249856:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.592262:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.592296:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.592324:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.592375:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991642496 00000100:00100000:0.0:1746127003.592382:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991642496 00010000:00010000:0.0:1746127003.592414:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 43 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746127003.592437:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991642368 00000100:00100000:0.0:1746127003.592440:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991642368 00010000:00010000:0.0:1746127003.592450:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 16 pid: 9612 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.592451:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994249984:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.592460:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994250112:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.592460:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991642624 00000100:00100000:0.0:1746127003.592461:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991642624 00010000:00010000:0.0:1746127003.592468:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 25 pid: 9611 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.592478:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10088 00000100:00100000:0.0:1746127003.592484:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991642496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.592486:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1667071] (req 1048576->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.592494:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.592498:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3a00, rc 0) 00010000:00010000:0.0:1746127003.592512:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 43 pid: 12333 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.592520:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 43 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.592539:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4274:x1830945991642240:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4959us (5194us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127003.592540:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bfec00/0x34dc807b6ef9ac1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53088 expref: 43 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.592545:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21578 00010000:00010000:0.0:1746127003.592553:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127003.592566:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991642496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 83us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.592571:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10088 00000100:00100000:0.0:1746127003.592581:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10089 00000100:00100000:0.0:1746127003.592585:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991642368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127003.592591:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.592597:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 16 pid: 9612 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.592605:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 16 pid: 9612 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.592616:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9b4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530dc expref: 16 pid: 9612 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.592623:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.592633:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10090 00000100:00100000:1.0:1746127003.592638:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2028:x1830945991642624:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127003.592639:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991642368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 53us (343us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127003.592645:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127003.592646:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10089 00010000:00010000:1.0:1746127003.592655:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 24 pid: 9611 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.592662:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 24 pid: 9611 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.592674:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6ef9a82 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5306c expref: 24 pid: 9611 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.592687:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.592689:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.592695:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.592702:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.592727:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 23 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.592738:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994250240:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127003.592784:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.594776:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994250240:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127003.594792:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.595449:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991642624:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2807us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.595458:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10090 00000100:00100000:2.0:1746127003.598888:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.598933:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991642880 00000100:00100000:0.0:1746127003.598940:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991642880 00002000:00100000:0.0:1746127003.598980:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1662976->1667071) req@ffff8800a8eeb100 x1830945991642880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.598987:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb100 with x1830945991642880 ext(1662976->1667071) 00002000:00010000:0.0:1746127003.598992:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8eeb100 00000100:00100000:0.0:1746127003.599016:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8603 00000100:00100000:0.0:1746127003.599022:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991642880:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127003.599189:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991642880:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 167us (309us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127003.599193:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8603 00002000:00100000:0.0:1746127003.599197:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1662976->1667071) req@ffff8800a8eeb100 x1830945991642880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.599201:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb100 with x1830945991642880 ext(1662976->1667071) 00002000:00010000:0.0:1746127003.599203:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8eeb100 00000100:00100000:0.0:1746127003.602114:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.602301:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991643136 00000100:00100000:3.0:1746127003.602308:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991643136 00000100:00100000:3.0:1746127003.602357:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6573 00000100:00100000:3.0:1746127003.602364:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4274:x1830945991643136:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127003.602563:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4274:x1830945991643136:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 198us (454us total) trans 8589938197 rc 0/0 00000100:00100000:3.0:1746127003.602569:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6573 00000100:00100000:0.0:1746127003.627638:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.629901:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991643392 00000100:00100000:1.0:1746127003.629913:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991643392 00000100:00100000:1.0:1746127003.629972:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17262 00000100:00100000:1.0:1746127003.629978:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4280:x1830945991643392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.630006:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.630024:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb2a00/0x34dc807b6ef9b8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53114 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.630105:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630117:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630141:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630154:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630160:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630165:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630821:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630831:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630838:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:1.0:1746127003.630851:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127003.630918:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630923:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630928:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630932:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630937:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdb3400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.630940:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630946:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630955:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127003.630957:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127003.630961:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.630965:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3400/0x34dc807b6ef9b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631390:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631396:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631405:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631408:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdb3800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.631410:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631414:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631419:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58ad00) 00010000:00010000:1.0:1746127003.631421:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127003.631423:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631426:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3800/0x34dc807b6ef9b9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.631461:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb2a00/0x34dc807b6ef9b8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 43 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.631471:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 42 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.631477:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.631478:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127003.631480:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3e00, rc 0) 00000100:00100000:1.0:1746127003.631542:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4280:x1830945991643392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1564us (3915us total) trans 8589938198 rc 0/0 00000100:00100000:1.0:1746127003.631547:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17262 00000100:00100000:0.0:1746127003.634012:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.634454:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991643648 00000100:00100000:3.0:1746127003.634464:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991643648 00000100:00100000:3.0:1746127003.634517:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6574 00000100:00100000:3.0:1746127003.634525:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4280:x1830945991643648:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127003.634803:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4280:x1830945991643648:12345-192.168.203.42@tcp:35:cat.0 Request processed in 278us (798us total) trans 8589938199 rc 0/0 00000100:00100000:3.0:1746127003.634810:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6574 00000100:00100000:2.0:1746127003.637677:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.637700:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.638602:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.638741:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991643776 00000100:00100000:0.0:1746127003.638741:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991643904 00000100:00100000:1.0:1746127003.638749:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991643776 00000100:00100000:0.0:1746127003.638749:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991643904 00000100:00100000:0.0:1746127003.638787:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991644032 00000100:00100000:0.0:1746127003.638789:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991644032 00000100:00100000:1.0:1746127003.638835:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21579 00000100:00100000:1.0:1746127003.638843:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991643904:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127003.638846:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21580 00000100:00100000:2.0:1746127003.638853:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991643776:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127003.638861:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.638861:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.638878:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e981400/0x34dc807b6ef9baf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5311b expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.638878:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2000/0x34dc807b6ef9bb6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53122 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.638926:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994250496:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127003.638926:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994250368:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127003.639034:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21581 00000100:00100000:3.0:1746127003.639042:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991644032:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.639061:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.639068:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53129 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.639095:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994250624:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127003.639303:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746127003.639451:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.639661:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746127003.641109:0:16295:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime: 1746127001 -> 1746127002 00002000:00010000:1.0:1746127003.641114:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746127000 -> 1746127002 00002000:00010000:1.0:1746127003.641116:0:16295:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime: 1746127001 -> 1746127002 00000100:00100000:1.0:1746127003.641156:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994250368:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127003.641184:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2000/0x34dc807b6ef9bb6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53122 expref: 45 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.641197:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2000/0x34dc807b6ef9bb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53122 expref: 45 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.641209:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2000, rc 0) 00000100:00100000:1.0:1746127003.641245:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991643904:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2403us (3542us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127003.641250:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21579 00002000:00010000:2.0:1746127003.641334:0:9613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127001 -> 1746127002 00002000:00010000:2.0:1746127003.641337:0:9613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127001 -> 1746127002 00002000:00010000:2.0:1746127003.641338:0:9613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127001 -> 1746127002 00000100:00100000:2.0:1746127003.641346:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994250496:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127003.641362:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e981400/0x34dc807b6ef9baf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5311b expref: 43 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.641370:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e981400/0x34dc807b6ef9baf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5311b expref: 43 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.641394:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e981400, rc 0) 00000100:00100000:2.0:1746127003.641412:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991643776:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2560us (3742us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127003.641417:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21580 00000100:00100000:3.0:1746127003.643863:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994250624:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127003.643902:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bbd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53129 expref: 24 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.643913:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53129 expref: 24 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.643946:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36600, rc 0) 00000100:00100000:3.0:1746127003.644007:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991644032:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4965us (5405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127003.644015:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21581 00000100:00100000:0.0:1746127003.646043:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.646122:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991644160 00000100:00100000:3.0:1746127003.646159:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991644160 00000100:00100000:3.0:1746127003.646211:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21582 00000100:00100000:3.0:1746127003.646218:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4280:x1830945991644160:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.646235:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.646252:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53130 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.646282:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 22 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.646289:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127003.646290:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127003.646294:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.646327:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 22 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.646339:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 22 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.646356:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994250752:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.646432:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.647917:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994250752:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.647941:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.647955:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d3b4600, rc 0) 00000100:00100000:3.0:1746127003.648003:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4280:x1830945991644160:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1785us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.648010:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21582 00000100:00100000:0.0:1746127003.648793:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.649237:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991644288 00000100:00100000:1.0:1746127003.649245:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991644288 00002000:00100000:1.0:1746127003.649650:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1921024->2097151) req@ffff88007edd7800 x1830945991644288/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.649659:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7800 with x1830945991644288 ext(1921024->2097151) 00010000:00010000:1.0:1746127003.649667:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 23 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.649680:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 23 pid: 16295 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746127003.649687:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007edd7800 00000100:00100000:1.0:1746127003.649719:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1895 00000100:00100000:1.0:1746127003.649727:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991644288:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127003.650587:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.650676:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991644416 00000100:00100000:3.0:1746127003.650681:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991644416 00000100:00100000:3.0:1746127003.650712:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21583 00000100:00100000:3.0:1746127003.650718:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4283:x1830945991644416:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.650728:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.650742:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53137 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.650763:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127003.650768:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.650817:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.650833:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22800, rc 0) 00000100:00100000:3.0:1746127003.650909:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4283:x1830945991644416:12345-192.168.203.42@tcp:101:cat.0 Request processed in 191us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.650916:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21583 00000100:00100000:1.0:1746127003.654491:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991644288:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 4755us (5689us total) trans 17179875587 rc 0/0 00000100:00100000:1.0:1746127003.654501:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1895 00002000:00100000:1.0:1746127003.654511:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1921024->2097151) req@ffff88007edd7800 x1830945991644288/t17179875587(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.654518:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7800 with x1830945991644288 ext(1921024->2097151) 00010000:00010000:1.0:1746127003.654526:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.654539:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746127003.654544:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007edd7800 00000100:00100000:0.0:1746127003.656096:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.656222:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991644544 00000100:00100000:1.0:1746127003.656232:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991644544 00010000:00010000:1.0:1746127003.656267:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.656307:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10091 00000100:00100000:1.0:1746127003.656315:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991644544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.656328:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.656345:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.656356:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.656380:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6ef9b7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53106 expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.656483:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.656486:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.656493:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.656503:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.656512:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.656513:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.656516:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.656523:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.656555:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.656568:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994250880:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127003.656660:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.656669:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994251008:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127003.656688:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.660864:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994250880:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127003.660876:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994251008:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127003.660897:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.661107:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991644544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4791us (5015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.661119:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10091 00000100:00100000:0.0:1746127003.663295:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.663445:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991644800 00000100:00100000:1.0:1746127003.663454:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991644800 00002000:00100000:1.0:1746127003.663509:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd5500 x1830945991644800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.663518:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5500 with x1830945991644800 ext(1048576->2097151) 00002000:00010000:1.0:1746127003.663524:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5500 00000100:00100000:1.0:1746127003.663561:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8604 00000100:00100000:1.0:1746127003.663569:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991644800:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127003.664794:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.664838:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.664839:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991645184 00000100:00100000:3.0:1746127003.664844:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991645184 00000100:00100000:0.0:1746127003.664863:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991645056 00000100:00100000:0.0:1746127003.664865:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991645056 00002000:00100000:3.0:1746127003.664874:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1667072->2097151) req@ffff88007edd5180 x1830945991645184/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.664877:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd4380 x1830945991645056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.664882:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5180 with x1830945991645184 ext(1667072->2097151) 00002000:00010000:3.0:1746127003.664887:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5180 00002000:00100000:0.0:1746127003.664889:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4380 with x1830945991645056 ext(1048576->2097151) 00002000:00010000:0.0:1746127003.664892:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd4380 00000100:00100000:0.0:1746127003.664914:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8605 00000100:00100000:0.0:1746127003.664919:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991645184:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127003.665208:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8606 00000100:00100000:1.0:1746127003.665216:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991645056:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127003.670322:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991644800:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6741us (7021us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127003.670335:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8604 00002000:00100000:1.0:1746127003.670347:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd5500 x1830945991644800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.670357:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5500 with x1830945991644800 ext(1048576->2097151) 00002000:00010000:1.0:1746127003.670363:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5500 00000100:00100000:0.0:1746127003.671493:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.671755:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991645568 00000100:00100000:1.0:1746127003.671764:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991645568 00000100:00100000:1.0:1746127003.672348:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17263 00000100:00100000:1.0:1746127003.672358:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4285:x1830945991645568:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127003.672383:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.672403:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb2000/0x34dc807b6ef9bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5313e expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.672513:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.672533:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 44 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.672546:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.672577:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 44 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.672592:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 44 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.672605:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994251136:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.672704:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.673608:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991645184:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8683us (8813us total) trans 0 rc 430080/430080 00000100:00100000:1.0:1746127003.673618:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8605 00002000:00100000:1.0:1746127003.673628:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa0:0x0] (1667072->2097151) req@ffff88007edd5180 x1830945991645184/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 430080/430080 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.673641:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5180 with x1830945991645184 ext(1667072->2097151) 00002000:00010000:1.0:1746127003.673645:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5180 00000100:00100000:2.0:1746127003.676497:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994251136:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.676525:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:1.0:1746127003.676746:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991645056:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11529us (11905us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127003.676756:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8606 00002000:00100000:1.0:1746127003.676765:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd4380 x1830945991645056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.676773:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4380 with x1830945991645056 ext(1048576->2097151) 00002000:00010000:1.0:1746127003.676778:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd4380 00000100:00100000:0.0:1746127003.677862:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.678083:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991645696 00000100:00100000:1.0:1746127003.678092:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991645696 00010000:00010000:1.0:1746127003.678126:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 45 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.678536:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10092 00000100:00100000:1.0:1746127003.678545:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991645696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.678560:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.678567:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 45 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.678578:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 45 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.678601:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3e00/0x34dc807b6ef9ba1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53114 expref: 45 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.678628:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.678633:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.678643:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.678651:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.678809:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.678844:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991645696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 300us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.678851:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10092 00010000:00010000:2.0:1746127003.678923:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.678930:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127003.678950:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127003.682706:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb2000/0x34dc807b6ef9bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 45 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.682766:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 44 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.682777:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.682780:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127003.682783:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3600, rc 0) 00000100:00100000:2.0:1746127003.682881:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4285:x1830945991645568:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10522us (11390us total) trans 8589938200 rc 0/0 00000100:00100000:2.0:1746127003.682889:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17263 00000100:00100000:0.0:1746127003.685697:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.685774:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.685907:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991645824 00000100:00100000:3.0:1746127003.685918:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991645824 00000100:00100000:3.0:1746127003.685988:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991645952 00000100:00100000:3.0:1746127003.685992:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991645952 00000100:00100000:3.0:1746127003.686017:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21584 00000100:00100000:3.0:1746127003.686027:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4280:x1830945991645824:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.686057:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.686078:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53145 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.686111:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.686119:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127003.686120:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127003.686124:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 44 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.686194:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.686207:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 25 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.686221:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994251264:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.686315:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.686542:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21585 00000100:00100000:1.0:1746127003.686552:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4283:x1830945991645952:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.686563:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.686573:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5314c expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.686592:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 44 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.686598:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127003.686599:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127003.686602:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.686623:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 44 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.686633:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 44 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.686642:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994251392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.686702:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.688212:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994251392:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.688243:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.688260:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2600, rc 0) 00000100:00100000:1.0:1746127003.688315:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4283:x1830945991645952:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1763us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.688323:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21585 00000100:00100000:3.0:1746127003.688400:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994251264:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.688415:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 44 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.688423:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22000, rc 0) 00000100:00100000:3.0:1746127003.688440:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4280:x1830945991645824:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2416us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.688446:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21584 00000100:00100000:0.0:1746127003.688871:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.688908:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.688967:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991646080 00000100:00100000:1.0:1746127003.688974:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991646080 00002000:00100000:1.0:1746127003.689017:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1667071) req@ffff88009c5e1180 x1830945991646080/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.689027:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1180 with x1830945991646080 ext(1048576->1667071) 00010000:00010000:1.0:1746127003.689034:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.689045:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746127003.689063:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1180 00000100:00100000:1.0:1746127003.689084:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991646208 00000100:00100000:1.0:1746127003.689088:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991646208 00002000:00100000:1.0:1746127003.689105:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (3198976->4165631) req@ffff88009c5e0380 x1830945991646208/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.689111:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0380 with x1830945991646208 ext(3198976->4165631) 00010000:00010000:1.0:1746127003.689117:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 44 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.689125:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 44 pid: 12333 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746127003.689163:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e0380 00000100:00100000:1.0:1746127003.689186:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1896 00000100:00100000:1.0:1746127003.689193:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991646080:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127003.689387:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1897 00000100:00100000:2.0:1746127003.689395:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991646208:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127003.703276:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991646080:12345-192.168.203.42@tcp:4:cat.0 Request processed in 14069us (14392us total) trans 17179875588 rc 0/0 00000100:00100000:1.0:1746127003.703290:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1896 00002000:00100000:1.0:1746127003.703302:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1667071) req@ffff88009c5e1180 x1830945991646080/t17179875588(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.703312:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1180 with x1830945991646080 ext(1048576->1667071) 00010000:00010000:1.0:1746127003.703322:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 28 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.703336:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 28 pid: 16295 timeout: 998 lvb_type: 0 00002000:00010000:1.0:1746127003.703343:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1180 00000100:00100000:0.0:1746127003.712028:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.712241:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991646336 00000100:00100000:3.0:1746127003.712250:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991646336 00000100:00100000:0.0:1746127003.713000:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.713032:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21586 00000100:00100000:3.0:1746127003.713041:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4285:x1830945991646336:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127003.713069:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.713086:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53153 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.713119:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.713144:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.713151:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 38 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.713157:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.713159:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.713162:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [905216->1048575] (req 905216->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 38 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.713743:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 38 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.713754:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 38 pid: 3542 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746127003.713766:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994251520:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.714011:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991646464 00000100:00100000:1.0:1746127003.714017:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991646464 00010000:00010000:1.0:1746127003.714039:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 28 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.714083:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10093 00000100:00100000:1.0:1746127003.714091:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991646464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.714103:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.714118:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 28 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.714141:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 28 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.714483:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3a00/0x34dc807b6ef9b85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1667071) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5310d expref: 28 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.714501:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.714503:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.714509:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 47 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.714517:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 47 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.714541:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 47 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.714549:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994251648:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127003.714890:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991646208:12345-192.168.203.42@tcp:4:cat.0 Request processed in 25495us (25980us total) trans 17179875589 rc 0/0 00000100:00100000:2.0:1746127003.714900:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1897 00002000:00100000:2.0:1746127003.714908:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (3198976->4165631) req@ffff88009c5e0380 x1830945991646208/t17179875589(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.714917:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0380 with x1830945991646208 ext(3198976->4165631) 00010000:00010000:2.0:1746127003.714923:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 46 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.714932:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 46 pid: 12333 timeout: 998 lvb_type: 0 00002000:00010000:2.0:1746127003.714938:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e0380 00010000:00010000:3.0:1746127003.715444:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.715454:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 14 pid: 1507 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746127003.715468:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994251776:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.715506:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.715514:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 25 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.715522:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994251904:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.715540:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.715614:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.716806:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994251520:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.718342:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.718707:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994251648:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127003.718730:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127003.718760:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991646592 00000100:00100000:1.0:1746127003.718765:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991646464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4676us (5767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.718768:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991646592 00000100:00100000:1.0:1746127003.718776:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10093 00010000:00010000:2.0:1746127003.718799:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 39 pid: 3542 timeout: 998 lvb_type: 1 00000100:00100000:2.0:1746127003.718822:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10094 00000100:00100000:2.0:1746127003.718828:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991646592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.718840:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.718861:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 39 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.718871:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 39 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.718894:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9a5f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53042 expref: 39 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.718924:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127003.718948:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991646592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 119us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.718953:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10094 00000100:00100000:0.0:1746127003.721198:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.721238:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.721301:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.721377:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991646976 00000100:00100000:1.0:1746127003.721384:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991646976 00010000:00010000:1.0:1746127003.721414:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 46 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.721437:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991647104 00000100:00100000:1.0:1746127003.721439:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991647104 00010000:00010000:1.0:1746127003.721453:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 15 pid: 1507 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.721468:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10095 00000100:00100000:1.0:1746127003.721474:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991646976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.721485:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.721502:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 46 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.721511:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 46 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.721530:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6ef9b0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->4165631) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530c0 expref: 46 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.721552:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.721554:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.721562:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.721574:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.721607:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.721618:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994252032:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127003.721686:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.721747:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10096 00000100:00100000:3.0:1746127003.721755:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991647104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.721763:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.721775:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 15 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.721782:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 15 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.721794:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127003.721813:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991647104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 59us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.721818:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10096 00010000:00010000:3.0:1746127003.721857:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6ef9b46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ce expref: 14 pid: 1507 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746127003.721868:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994251776:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.721881:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994251904:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.721906:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [905216->1048575] (req 905216->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.721915:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22e00, rc 0) 00000100:00100000:3.0:1746127003.721931:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4285:x1830945991646336:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8893us (9915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.721937:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21586 00000100:00100000:2.0:1746127003.722116:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991646848 00000100:00100000:2.0:1746127003.722120:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991646848 00002000:00100000:2.0:1746127003.722171:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009c5e1500 x1830945991646848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.722180:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1500 with x1830945991646848 ext(1048576->2097151) 00002000:00010000:2.0:1746127003.722183:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e1500 00000100:00100000:2.0:1746127003.722198:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8607 00000100:00100000:2.0:1746127003.722202:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991646848:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127003.724437:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.724458:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991647232 00000100:00100000:0.0:1746127003.724465:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991647232 00010000:00010000:0.0:1746127003.724492:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.724516:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10097 00000100:00100000:0.0:1746127003.724522:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991647232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127003.724534:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.724553:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.724564:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.724583:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7a00/0x34dc807b6ef9a12 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5300a expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.724599:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.724601:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.724608:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.724616:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.724650:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.724662:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994252160:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127003.724729:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.727904:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994252160:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127003.727928:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127003.727981:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991647232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3458us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.727992:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10097 00000100:00100000:1.0:1746127003.728181:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994252032:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127003.728201:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.728226:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991646976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6751us (6986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.728232:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10095 00000100:00100000:0.0:1746127003.728977:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.730239:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991646848:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 8032us (9044us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127003.730249:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8607 00002000:00100000:2.0:1746127003.730259:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009c5e1500 x1830945991646848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.730268:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1500 with x1830945991646848 ext(1048576->2097151) 00002000:00010000:2.0:1746127003.730274:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e1500 00000100:00100000:2.0:1746127003.730292:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991647488 00000100:00100000:2.0:1746127003.730298:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991647488 00002000:00100000:2.0:1746127003.730329:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9c:0x0] (905216->909311) req@ffff88009c5e3480 x1830945991647488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.730335:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3480 with x1830945991647488 ext(905216->909311) 00002000:00010000:2.0:1746127003.730337:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e3480 00000100:00100000:2.0:1746127003.731067:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8608 00000100:00100000:2.0:1746127003.731076:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991647488:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127003.731616:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991647488:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 540us (2639us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127003.731622:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8608 00002000:00100000:2.0:1746127003.731627:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9c:0x0] (905216->909311) req@ffff88009c5e3480 x1830945991647488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.731634:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3480 with x1830945991647488 ext(905216->909311) 00002000:00010000:2.0:1746127003.731637:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e3480 00000100:00100000:0.0:1746127003.733069:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.733277:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991647744 00000100:00100000:2.0:1746127003.733285:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991647744 00002000:00100000:2.0:1746127003.733318:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c5e0000 x1830945991647744/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.733327:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0000 with x1830945991647744 ext(2097152->4194303) 00002000:00010000:2.0:1746127003.733332:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e0000 00000100:00100000:2.0:1746127003.733357:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8609 00000100:00100000:2.0:1746127003.733364:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991647744:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127003.735297:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.735687:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991647872 00000100:00100000:3.0:1746127003.735693:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991647872 00000100:00100000:3.0:1746127003.735731:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21587 00000100:00100000:3.0:1746127003.735737:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4285:x1830945991647872:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127003.735752:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.735771:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5315a expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.735796:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 46 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.735804:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 28 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.735814:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.735816:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.735819:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->1331199] (req 1048576->1331199) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 46 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.735847:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 28 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.735859:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 28 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.735870:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994252288:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.735946:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 46 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.735954:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.735961:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994252416:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.735978:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.741331:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.741405:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991648000 00000100:00100000:1.0:1746127003.741415:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991648000 00000100:00100000:1.0:1746127003.741473:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21588 00000100:00100000:1.0:1746127003.741481:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4280:x1830945991648000:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.741500:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.741520:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53161 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.741546:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.741548:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.741555:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 48 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.741574:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 48 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.741584:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620e00, rc 0) 00000100:00100000:1.0:1746127003.741639:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4280:x1830945991648000:12345-192.168.203.42@tcp:101:cat.0 Request processed in 159us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.741645:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21588 00000100:00100000:0.0:1746127003.751575:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.751647:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991648128 00000100:00100000:1.0:1746127003.751656:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991648128 00000100:00100000:0.0:1746127003.751665:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.751684:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991648256 00000100:00100000:0.0:1746127003.751688:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991648256 00010000:00010000:1.0:1746127003.751694:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 29 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.751703:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 48 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.751738:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10098 00000100:00100000:1.0:1746127003.751746:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991648128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.751759:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.751779:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 29 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.751791:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 29 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.751817:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.751862:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991648128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.751868:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10098 00000100:00100000:1.0:1746127003.751889:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10099 00000100:00100000:1.0:1746127003.751893:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991648256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.751900:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.751906:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 48 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.751914:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 48 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.751926:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.751928:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.751935:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.751943:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.751974:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.751987:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994252544:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127003.752073:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00010000:00010000:3.0:1746127003.752751:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085b22800/0x34dc807b6ef9bcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53137 expref: 28 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.752769:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994252288:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.752791:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9bc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53130 expref: 48 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.752804:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994252416:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.752827:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 47 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.752836:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36600, rc 0) 00000100:00100000:3.0:1746127003.752863:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4285:x1830945991647872:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 17126us (17574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.752870:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21587 00000100:00100000:2.0:1746127003.754574:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991647744:12345-192.168.203.42@tcp:3:cat.0 Request processed in 21202us (21501us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127003.754585:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8609 00002000:00100000:2.0:1746127003.754595:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c5e0000 x1830945991647744/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.754604:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0000 with x1830945991647744 ext(2097152->4194303) 00002000:00010000:2.0:1746127003.754610:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e0000 00000100:00100000:0.0:1746127003.754660:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994252544:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127003.754679:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127003.754697:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991648256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2803us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.754705:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10099 00000100:00100000:0.0:1746127003.758512:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.759638:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991648512 00000100:00100000:2.0:1746127003.759649:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991648512 00002000:00100000:2.0:1746127003.759698:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c5e0e00 x1830945991648512/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.759707:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0e00 with x1830945991648512 ext(2097152->4194303) 00002000:00010000:2.0:1746127003.759714:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e0e00 00000100:00100000:2.0:1746127003.759749:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8610 00000100:00100000:2.0:1746127003.759756:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991648512:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127003.764764:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.764849:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.764943:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991648768 00000100:00100000:3.0:1746127003.764952:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991648768 00002000:00100000:3.0:1746127003.764998:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1327104->1331199) req@ffff88009c5e3100 x1830945991648768/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.765008:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3100 with x1830945991648768 ext(1327104->1331199) 00002000:00010000:3.0:1746127003.765014:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e3100 00000100:00100000:3.0:1746127003.765059:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8611 00000100:00100000:3.0:1746127003.765067:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991648768:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.765239:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991648768:12345-192.168.203.42@tcp:3:cat.0 Request processed in 172us (484us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127003.765246:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8611 00002000:00100000:3.0:1746127003.765252:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1327104->1331199) req@ffff88009c5e3100 x1830945991648768/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/4536 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.765258:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3100 with x1830945991648768 ext(1327104->1331199) 00002000:00010000:3.0:1746127003.765261:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e3100 00000100:00100000:2.0:1746127003.766358:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991648896 00000100:00100000:2.0:1746127003.766365:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991648896 00000100:00100000:2.0:1746127003.766410:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17264 00000100:00100000:2.0:1746127003.766417:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4286:x1830945991648896:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127003.766438:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.766457:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53168 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.766510:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766522:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766532:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766544:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766550:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766555:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766619:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766629:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 43 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.766636:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.766664:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 43 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.766675:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 43 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.766687:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994252672:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.767105:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.770797:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.770839:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.770870:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991649024 00000100:00100000:0.0:1746127003.770871:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.770879:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991649024 00000100:00100000:3.0:1746127003.770923:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991649152 00000100:00100000:3.0:1746127003.770925:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991649152 00000100:00100000:0.0:1746127003.770934:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991649280 00000100:00100000:0.0:1746127003.770936:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991649280 00000100:00100000:3.0:1746127003.770942:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21589 00000100:00100000:3.0:1746127003.770949:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991649024:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127003.770953:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21590 00000100:00100000:0.0:1746127003.770957:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991649152:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.770967:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.770967:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.770983:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085b23400/0x34dc807b6ef9c26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5316f expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.770983:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096643400/0x34dc807b6ef9c2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53176 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.771028:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994252800:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127003.771028:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994252928:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127003.771227:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.771349:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21591 00000100:00100000:3.0:1746127003.771360:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991649280:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.771374:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.771388:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5317d expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.771404:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.771405:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.771410:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 29 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.771420:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 29 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.771426:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c37600, rc 0) 00000100:00100000:3.0:1746127003.771538:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991649280:12345-192.168.203.42@tcp:101:cat.0 Request processed in 182us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.771543:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21591 00000100:00100000:0.0:1746127003.773221:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.773371:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994252672:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127003.773393:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:3.0:1746127003.773658:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.773883:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991649408 00000100:00100000:0.0:1746127003.773889:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991649408 00010000:00010000:0.0:1746127003.773914:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 44 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.773944:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10100 00000100:00100000:0.0:1746127003.773950:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991649408:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127003.773961:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.773966:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 44 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.774120:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991648512:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14363us (15618us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127003.774141:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8610 00002000:00100000:2.0:1746127003.774151:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c5e0e00 x1830945991648512/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.774160:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0e00 with x1830945991648512 ext(2097152->4194303) 00002000:00010000:2.0:1746127003.774164:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e0e00 00010000:00010000:0.0:1746127003.774594:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 44 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.774619:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdb3600/0x34dc807b6ef9bd9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5313e expref: 44 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.774804:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127003.774809:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774819:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774826:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774845:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127003.774856:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774861:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:0.0:1746127003.774908:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746127003.774913:0:10958:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746127003.774927:0:10958:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774936:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774945:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774951:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774957:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774963:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774968:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd03800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127003.774971:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774977:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774984:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127003.774986:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127003.774989:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.774993:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03800/0x34dc807b6ef9c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775002:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775006:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775011:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775015:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd03000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127003.775017:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775025:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775030:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090424800) 00010000:00010000:0.0:1746127003.775032:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127003.775034:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775038:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03000/0x34dc807b6ef9c18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.775078:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 12 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.775088:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 11 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.775095:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127003.775097:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746127003.775099:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02200, rc 0) 00002000:00010000:3.0:1746127003.775388:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746127001 -> 1746127002 00002000:00010000:3.0:1746127003.775391:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127001 -> 1746127002 00002000:00010000:3.0:1746127003.775393:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746127001 -> 1746127002 00000100:00100000:3.0:1746127003.775408:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994252800:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127003.775430:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085b23400/0x34dc807b6ef9c26 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5316f expref: 26 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.775440:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b23400/0x34dc807b6ef9c26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5316f expref: 26 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.775451:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b23400, rc 0) 00000100:00100000:3.0:1746127003.776264:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991649024:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5311us (5474us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127003.776273:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21589 00000100:00100000:1.0:1746127003.776781:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991649408:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2827us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.776913:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.776946:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991649664 00000100:00100000:2.0:1746127003.776952:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991649664 00000100:00100000:2.0:1746127003.776985:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6575 00000100:00100000:2.0:1746127003.776991:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4285:x1830945991649664:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127003.777187:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4285:x1830945991649664:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 195us (274us total) trans 8589938201 rc 0/0 00000100:00100000:2.0:1746127003.777193:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6575 00000100:00100000:2.0:1746127003.777254:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994252928:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127003.777279:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096643400/0x34dc807b6ef9c2d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53176 expref: 28 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.777292:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643400/0x34dc807b6ef9c2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53176 expref: 28 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.777299:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643400, rc 0) 00000100:00100000:2.0:1746127003.777322:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991649152:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6364us (6483us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127003.777328:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21590 00000100:00100000:1.0:1746127003.777458:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10100 00000100:00100000:0.0:1746127003.777547:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4286:x1830945991648896:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 11128us (12695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.777554:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17264 00000100:00100000:3.0:1746127003.778599:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.778625:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.778641:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991649792 00000100:00100000:3.0:1746127003.778646:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991649792 00000100:00100000:3.0:1746127003.778672:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991650048 00000100:00100000:3.0:1746127003.778674:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991650048 00000100:00100000:3.0:1746127003.778688:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21592 00000100:00100000:3.0:1746127003.778693:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991649792:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.778704:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.778718:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6000/0x34dc807b6ef9c3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53184 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.778762:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994253056:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127003.778828:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.778842:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21593 00000100:00100000:3.0:1746127003.778848:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991650048:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.778860:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.778870:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53192 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.778882:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.778884:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.778891:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 16 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.778905:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 16 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.778914:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d29a00, rc 0) 00000100:00100000:3.0:1746127003.778932:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991650048:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.778937:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21593 00000100:00100000:3.0:1746127003.778963:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.778973:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991649920 00000100:00100000:3.0:1746127003.778975:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991649920 00000100:00100000:3.0:1746127003.778998:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21594 00000100:00100000:3.0:1746127003.779003:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991649920:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.779010:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.779016:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7d28e00/0x34dc807b6ef9c49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5318b expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.779037:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994253184:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127003.779066:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.779116:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.779126:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991650176 00000100:00100000:3.0:1746127003.779146:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991650176 00000100:00100000:3.0:1746127003.779169:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21595 00000100:00100000:3.0:1746127003.779173:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991650176:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.779179:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.779186:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53199 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.779195:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.779435:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.779440:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 19 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.779450:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 19 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.779456:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac400, rc 0) 00000100:00100000:3.0:1746127003.779472:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2026:x1830945991650176:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 299us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.779477:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21595 00000100:00100000:0.0:1746127003.781532:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.781555:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.781590:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991650304 00000100:00100000:0.0:1746127003.781594:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991650304 00000100:00100000:0.0:1746127003.781621:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991650432 00000100:00100000:0.0:1746127003.781623:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991650432 00000100:00100000:0.0:1746127003.781636:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21596 00000100:00100000:0.0:1746127003.781646:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991650304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.781659:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.781674:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef9c57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531a0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.781711:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994253312:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127003.781726:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994253184:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127003.781750:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7d28e00/0x34dc807b6ef9c49 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5318b expref: 18 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.781761:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7d28e00/0x34dc807b6ef9c49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5318b expref: 18 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127003.781765:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746127003.781770:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d28e00, rc 0) 00000100:00100000:0.0:1746127003.781777:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21597 00000100:00100000:0.0:1746127003.781782:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991650432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.781788:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127003.781792:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991649920:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 2789us (2829us total) trans 0 rc 301/301 00010000:00010000:0.0:1746127003.781794:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef9c5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531a7 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.781798:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21594 00000100:00100000:0.0:1746127003.781813:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994253440:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127003.781830:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.781918:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994253056:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127003.781932:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6000/0x34dc807b6ef9c3b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53184 expref: 15 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.781941:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6000/0x34dc807b6ef9c3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53184 expref: 15 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.781963:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e8e6000, rc 0) 00000100:00100000:3.0:1746127003.781983:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991649792:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 3289us (3386us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127003.781990:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21592 00000100:00100000:1.0:1746127003.782880:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994253440:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127003.782898:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994253312:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127003.782900:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef9c5e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531a7 expref: 28 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.782910:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096642200/0x34dc807b6ef9c5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531a7 expref: 28 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.782912:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef9c57 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531a0 expref: 26 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.782922:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642c00/0x34dc807b6ef9c57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531a0 expref: 26 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.782932:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642200, rc 0) 00010000:00010000:2.0:1746127003.782934:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642c00, rc 0) 00000100:00100000:1.0:1746127003.782962:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991650432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1180us (1406us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127003.782968:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21597 00000100:00100000:2.0:1746127003.783068:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991650304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1425us (1540us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127003.783074:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21596 00000100:00100000:0.0:1746127003.783911:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.784193:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991650688 00000100:00100000:2.0:1746127003.784200:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991650688 00000100:00100000:2.0:1746127003.784234:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17265 00000100:00100000:2.0:1746127003.784240:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4286:x1830945991650688:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127003.784255:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.784269:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531ae expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.784363:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.784377:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 12 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.784384:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127003.784410:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 12 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.784672:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 12 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.784685:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994253568:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.784787:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.784947:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.785075:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991650816 00000100:00100000:2.0:1746127003.785079:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991650816 00000100:00100000:2.0:1746127003.785162:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21598 00000100:00100000:2.0:1746127003.785168:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991650816:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127003.785175:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.785184:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9c73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531b5 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.785211:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994253696:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127003.785244:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.785782:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.785810:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991650944 00000100:00100000:1.0:1746127003.785814:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991650944 00000100:00100000:1.0:1746127003.785843:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21599 00000100:00100000:1.0:1746127003.785848:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991650944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.785856:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.785870:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6d800/0x34dc807b6ef9c7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531bc expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.785896:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994253824:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127003.785922:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.785973:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994253568:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.785987:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:2.0:1746127003.786444:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.786485:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991651072 00000100:00100000:1.0:1746127003.786488:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991651072 00010000:00010000:1.0:1746127003.786503:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 13 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.786521:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10101 00000100:00100000:1.0:1746127003.786526:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991651072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.786536:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.786540:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 13 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.786550:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 13 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.786567:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9c1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53168 expref: 13 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.786579:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.786583:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.786591:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.786598:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.786619:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.786638:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991651072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 111us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.786644:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10101 00010000:00010000:3.0:1746127003.786690:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.786696:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:3.0:1746127003.786711:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127003.786811:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ae expref: 13 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.786822:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ae expref: 12 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.786839:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.786842:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127003.786844:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02e00, rc 0) 00000100:00100000:3.0:1746127003.786869:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4286:x1830945991650688:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 2629us (2960us total) trans 8589938202 rc 0/0 00000100:00100000:3.0:1746127003.786875:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17265 00000100:00100000:1.0:1746127003.787545:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994253824:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127003.787563:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6d800/0x34dc807b6ef9c7a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531bc expref: 28 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.787572:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6d800/0x34dc807b6ef9c7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531bc expref: 28 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.787581:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d800, rc 0) 00000100:00100000:1.0:1746127003.787617:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991650944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1768us (1834us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127003.787623:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21599 00000100:00100000:2.0:1746127003.787690:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994253696:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127003.787707:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9c73 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531b5 expref: 26 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.787717:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9c73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531b5 expref: 26 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.787726:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03600, rc 0) 00000100:00100000:2.0:1746127003.787742:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991650816:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2575us (2796us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127003.787747:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21598 00000100:00100000:0.0:1746127003.788578:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.788644:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991651328 00000100:00100000:3.0:1746127003.788649:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991651328 00000100:00100000:3.0:1746127003.788675:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17266 00000100:00100000:3.0:1746127003.788680:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4286:x1830945991651328:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.788699:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.788701:0:10958:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746127003.788717:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9c6c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ae expref: 12 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.788729:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.788733:0:10958:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127003.788741:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac000/0x34dc807b6ef9c88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531c3 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.788817:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.788829:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127003.788837:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:3.0:1746127003.788845:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127003.788907:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac000/0x34dc807b6ef9c88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 14 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.788918:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 13 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.788924:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.788926:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127003.788928:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac600, rc 0) 00000100:00100000:3.0:1746127003.789300:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4286:x1830945991651328:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 618us (722us total) trans 8589938203 rc 0/0 00000100:00100000:3.0:1746127003.789306:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17266 00000100:00100000:0.0:1746127003.790507:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.790691:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991651456 00000100:00100000:3.0:1746127003.790698:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991651456 00000100:00100000:3.0:1746127003.790749:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17267 00000100:00100000:3.0:1746127003.790756:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4286:x1830945991651456:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.790777:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.790792:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9c9d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531ca expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.790836:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9c9d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ca expref: 14 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.790847:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9c9d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ca expref: 14 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.790867:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.790870:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127003.790873:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdaca00, rc 0) 00000100:00100000:3.0:1746127003.790920:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4286:x1830945991651456:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 163us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.790925:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17267 00000100:00100000:0.0:1746127003.793851:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.794099:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.794120:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.794153:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.794568:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991651712 00000100:00100000:1.0:1746127003.794579:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991651712 00000100:00100000:2.0:1746127003.794603:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991651968 00000100:00100000:2.0:1746127003.794607:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991651968 00000100:00100000:1.0:1746127003.794625:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652224 00000100:00100000:1.0:1746127003.794628:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652224 00000100:00100000:2.0:1746127003.794637:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991651584 00000100:00100000:2.0:1746127003.794639:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991651584 00000100:00100000:1.0:1746127003.794645:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21600 00000100:00100000:1.0:1746127003.794653:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991651712:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:1.0:1746127003.794697:0:9611:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.794714:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 45 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.794722:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127003.794725:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127003.794727:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.794733:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21601 00000100:00100000:2.0:1746127003.794739:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991651968:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:1.0:1746127003.794759:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 45 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.794764:0:9613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.794771:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 45 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.794776:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 36 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.794784:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127003.794789:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994253952:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.794792:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.794797:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.794798:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.794800:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.794815:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21602 00000100:00100000:0.0:1746127003.794822:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991652224:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127003.794838:0:16295:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.794847:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.794853:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 18 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127003.794857:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda23c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746127003.794860:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 45 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.794864:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.794865:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.794867:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.794878:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21603 00010000:00010000:0.0:1746127003.794881:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 45 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.794884:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991651584:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127003.794889:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 45 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.794896:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994254080:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.794900:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.794911:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.794916:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127003.794917:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127003.794925:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.794925:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 18 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.794937:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 18 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746127003.794942:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 36 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.794944:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994254208:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.794951:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 36 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.794960:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994254336:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127003.794973:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.794980:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 26 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.794982:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.794986:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123475180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994254464:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.795000:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.795025:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.795095:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.795149:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991651840 00000100:00100000:1.0:1746127003.795153:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991651840 00000100:00100000:1.0:1746127003.795171:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652096 00000100:00100000:1.0:1746127003.795173:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652096 00000100:00100000:1.0:1746127003.795182:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21604 00000100:00100000:1.0:1746127003.795187:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2027:x1830945991651840:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:1.0:1746127003.795201:0:12340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.795210:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 45 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.795219:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 19 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127003.795223:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21605 00010000:00010000:1.0:1746127003.795224:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 26 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.795227:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.795228:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.795229:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.795232:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991652096:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:1.0:1746127003.795239:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 26 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.795245:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 26 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.795250:0:3542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.795252:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994254592:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.795259:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 36 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.795265:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.795272:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 24 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.795277:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.795278:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.795280:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.795288:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 19 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.795296:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 24 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.795296:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 19 pid: 1507 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.795304:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994254720:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.795305:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 24 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.795312:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994254848:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.795328:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 45 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.795336:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 45 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.795341:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994254976:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.795344:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.795351:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 16 pid: 9612 timeout: 998 lvb_type: 1 00000100:00100000:1.0:1746127003.795353:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.795358:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994255104:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.795390:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 36 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.795432:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.795439:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 24 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:2.0:1746127003.795446:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994255360:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.795469:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.795477:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 16 pid: 16295 timeout: 998 lvb_type: 1 00000100:00100000:2.0:1746127003.795483:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994255488:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.795499:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 36 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.795506:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 36 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.795513:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994255616:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.795524:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3cf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746127003.795577:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 36 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.795586:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994255232:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.795599:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127003.796774:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994253952:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.796794:0:9611:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.796814:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994254336:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.796822:0:1507:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.798065:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994254080:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.798077:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994254208:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.798422:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994254720:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.798475:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123475180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994254464:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.798502:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.798524:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994254592:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.798525:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.798539:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.798544:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994254976:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.798561:0:12340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.798580:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994255360:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.798584:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.798588:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994255488:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.798596:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994255616:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.798615:0:9613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.798633:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652608 00000100:00100000:2.0:1746127003.798638:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652608 00010000:00010000:2.0:1746127003.798666:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 20 pid: 1507 timeout: 998 lvb_type: 1 00000100:00100000:2.0:1746127003.798786:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652480 00000100:00100000:2.0:1746127003.798788:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652480 00000100:00100000:3.0:1746127003.798793:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994254848:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.798798:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 21 pid: 1507 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746127003.798801:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994255104:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.798807:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994255232:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.798829:0:3542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.798891:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10102 00000100:00100000:2.0:1746127003.798897:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2028:x1830945991652608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127003.798900:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10103 00000100:00100000:3.0:1746127003.798907:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2028:x1830945991652480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.798907:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.798914:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.798926:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 21 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.798926:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 21 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.798934:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 21 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.798936:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 21 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.798954:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdac400/0x34dc807b6ef9c50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53199 expref: 21 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:2.0:1746127003.798954:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7d29a00/0x34dc807b6ef9c42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53192 expref: 21 pid: 1507 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.798968:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127003.798968:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127003.799000:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2028:x1830945991652608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 103us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.799003:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2028:x1830945991652480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 97us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.799005:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10102 00000100:00100000:3.0:1746127003.799009:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10103 00000100:00100000:2.0:1746127003.799027:0:20410:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652736 00000100:00100000:2.0:1746127003.799029:0:20410:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652736 00002000:00100000:2.0:1746127003.799064:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9c:0x0] (905216->1048575) req@ffff880094826680 x1830945991652736/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.799072:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094826680 with x1830945991652736 ext(905216->1048575) 00010000:00010000:2.0:1746127003.799078:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.799086:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00002000:00010000:2.0:1746127003.799092:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094826680 00000100:00100000:2.0:1746127003.799104:0:20410:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1898 00000100:00100000:2.0:1746127003.799109:0:20410:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991652736:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127003.804387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.804421:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.804441:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.804455:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.804465:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.804475:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.804494:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652992 00000100:00100000:1.0:1746127003.804501:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652992 00010000:00010000:1.0:1746127003.804530:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 46 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.804553:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991653248 00000100:00100000:1.0:1746127003.804555:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991653248 00010000:00010000:1.0:1746127003.804561:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 27 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.804566:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991653632 00000100:00100000:1.0:1746127003.804567:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991653632 00000100:00100000:3.0:1746127003.804568:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991653120 00000100:00100000:3.0:1746127003.804572:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991653120 00010000:00010000:1.0:1746127003.804574:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 39 pid: 12333 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.804578:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991653376 00000100:00100000:1.0:1746127003.804581:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10104 00000100:00100000:0.0:1746127003.804582:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991653376 00000100:00100000:1.0:1746127003.804586:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991652992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.804589:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 18 pid: 9612 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746127003.804595:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.804597:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 18 pid: 16295 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746127003.804603:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10105 00000100:00100000:3.0:1746127003.804609:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991653248:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.804610:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 46 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.804613:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10106 00010000:00010000:3.0:1746127003.804618:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127003.804618:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991653632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.804623:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 46 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.804626:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.804636:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 27 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.804642:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 39 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.804646:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 27 pid: 16295 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.804656:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 39 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.804667:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6ef9bee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5314c expref: 27 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.804669:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10107 00010000:00010000:0.0:1746127003.804672:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800911df800/0x34dc807b6ef9acf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5309d expref: 39 pid: 12333 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.804674:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096620e00/0x34dc807b6ef9c03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53161 expref: 46 pid: 16295 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.804677:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991653120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.804681:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.804683:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.804685:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.804687:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127003.804688:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.804695:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 18 pid: 9612 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.804696:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.804703:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 18 pid: 9612 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746127003.804704:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127003.804714:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb2e00/0x34dc807b6ef9b54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ea expref: 18 pid: 9612 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.804717:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.804721:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991652992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 135us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.804721:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991653632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 102us (278us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127003.804723:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127003.804727:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10106 00000100:00100000:1.0:1746127003.804730:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10104 00000100:00100000:3.0:1746127003.804733:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991653248:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 124us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.804736:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991653120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 61us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.804740:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10108 00000100:00100000:3.0:1746127003.804743:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10105 00000100:00100000:0.0:1746127003.804744:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991653376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127003.804750:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10107 00010000:00010000:0.0:1746127003.804750:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.804756:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 17 pid: 16295 timeout: 998 lvb_type: 1 00000100:00100000:3.0:1746127003.804760:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652352 00000100:00100000:3.0:1746127003.804763:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652352 00010000:00010000:0.0:1746127003.804764:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 16 pid: 16295 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.804773:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3200/0x34dc807b6ef9b38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530e3 expref: 16 pid: 16295 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.804780:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.804781:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127003.804785:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1331199) req@ffff880094826a00 x1830945991652352/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127003.804793:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991653760 00002000:00100000:3.0:1746127003.804794:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094826a00 with x1830945991652352 ext(1048576->1331199) 00000100:00100000:0.0:1746127003.804794:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991653376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 50us (317us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127003.804800:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 45 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.804800:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991653760 00000100:00100000:0.0:1746127003.804802:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10108 00010000:00010000:3.0:1746127003.804809:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 45 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.804811:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 25 pid: 12333 timeout: 998 lvb_type: 1 00002000:00010000:3.0:1746127003.804816:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094826a00 00000100:00100000:1.0:1746127003.804826:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10109 00000100:00100000:3.0:1746127003.804829:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1899 00000100:00100000:1.0:1746127003.804830:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991653760:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127003.804834:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991652352:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:1.0:1746127003.804835:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127003.804835:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127003.804842:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 25 pid: 12333 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746127003.804844:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991653504 00000100:00100000:0.0:1746127003.804846:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991653504 00010000:00010000:1.0:1746127003.804849:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 25 pid: 12333 timeout: 998 lvb_type: 1 00010000:00010000:0.0:1746127003.804856:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.804863:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e980600/0x34dc807b6ef9af9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530ab expref: 25 pid: 12333 timeout: 998 lvb_type: 1 00010000:00010000:1.0:1746127003.804873:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.804875:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127003.804876:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10110 00010000:00010000:1.0:1746127003.804877:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.804881:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991653504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.804883:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.804886:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127003.804893:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.804900:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 47 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.804902:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127003.804907:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.804910:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085b22000/0x34dc807b6ef9be7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53145 expref: 47 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.804915:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.804916:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991653760:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 85us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127003.804917:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.804921:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10109 00010000:00010000:3.0:1746127003.804928:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.804929:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.804929:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991653504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 48us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.804934:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10110 00010000:00010000:3.0:1746127003.804936:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.804936:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.804946:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.804951:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.804958:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.804959:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127003.804965:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d3b4600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127003.804968:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.804980:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.804987:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127003.804988:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.804994:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4600/0x34dc807b6ef9cb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.804997:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991654016 00000100:00100000:0.0:1746127003.805000:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991654016 00010000:00010000:0.0:1746127003.805009:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 38 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.805028:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991652864 00000100:00100000:3.0:1746127003.805030:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991652224:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 10209us (10909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.805030:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991652864 00000100:00100000:3.0:1746127003.805037:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21602 00000100:00100000:1.0:1746127003.805039:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127003.805039:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 26 pid: 3542 timeout: 998 lvb_type: 1 00000100:00100000:0.0:1746127003.805060:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991653888 00000100:00100000:0.0:1746127003.805063:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991653888 00000100:00100000:1.0:1746127003.805068:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10111 00010000:00010000:0.0:1746127003.805072:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 24 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.805073:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991654016:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.805079:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127003.805083:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10112 00010000:00010000:1.0:1746127003.805086:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 38 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:0.0:1746127003.805087:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991652864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127003.805090:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10113 00010000:00010000:0.0:1746127003.805093:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.805094:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 38 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.805096:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991653888:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127003.805099:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 26 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.805102:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.805104:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfd400/0x34dc807b6ef9b00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b2 expref: 38 pid: 3542 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.805106:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 26 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.805109:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 24 pid: 3542 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.805113:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127003.805115:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c37600/0x34dc807b6ef9c34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5317d expref: 26 pid: 3542 timeout: 998 lvb_type: 1 00010000:00010000:3.0:1746127003.805118:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 24 pid: 3542 timeout: 998 lvb_type: 0 00010000:00010000:0.0:1746127003.805123:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.805125:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.805145:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805146:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dcfca00/0x34dc807b6ef9b07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e530b9 expref: 24 pid: 3542 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.805146:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991654016:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 53us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127003.805152:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.805153:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10111 00010000:00010000:3.0:1746127003.805154:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.805156:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.805159:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805164:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805166:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127003.805177:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127003.805180:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991652864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 92us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.805185:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10112 00000100:00100000:3.0:1746127003.805192:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991653888:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 96us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.805197:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10113 00010000:00010000:0.0:1746127003.805209:0:12340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805212:0:3542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805217:0:12340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805218:0:3542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805227:0:3542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805233:0:3542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805239:0:3542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805245:0:3542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdacc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127003.805247:0:3542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805258:0:3542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805266:0:3542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.805271:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdacc00/0x34dc807b6ef9cc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.805315:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991652096:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 10085us (10220us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127003.805320:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.805321:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21605 00010000:00010000:2.0:1746127003.805330:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7d29c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127003.805333:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.805339:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.805349:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.805355:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6ef9cab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.805390:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991651968:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 10650us (11290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.805396:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21601 00010000:00010000:0.0:1746127003.805451:0:12340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805459:0:12340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805465:0:12340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805470:0:12340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6dc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127003.805473:0:12340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805484:0:12340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805492:0:12340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.805497:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6dc00/0x34dc807b6ef9cc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127003.805535:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991651840:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 10347us (10509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.805541:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21604 00000100:00100000:2.0:1746127003.806017:0:20410:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991652736:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6873us (7398us total) trans 21474842852 rc 0/0 00000100:00100000:2.0:1746127003.806024:0:20410:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1898 00002000:00100000:2.0:1746127003.806031:0:20410:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9c:0x0] (905216->1048575) req@ffff880094826680 x1830945991652736/t21474842852(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.806038:0:20410:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094826680 with x1830945991652736 ext(905216->1048575) 00010000:00010000:2.0:1746127003.806044:0:20410:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.806072:0:20410:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00002000:00010000:2.0:1746127003.806078:0:20410:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094826680 00000100:00100000:0.0:1746127003.808656:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.808700:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991654144 00000100:00100000:2.0:1746127003.808707:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991654144 00010000:00010000:2.0:1746127003.808733:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.808762:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10114 00000100:00100000:2.0:1746127003.808768:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991654144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.808778:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.808792:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.808801:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.808818:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9bf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 905216->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53153 expref: 37 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.808830:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.808832:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.808836:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.808849:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.808877:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127003.808896:0:1507:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.808906:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.808908:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991654144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.808914:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10114 00010000:00010000:1.0:1746127003.808921:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.808928:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.808935:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.808945:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6c400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127003.808948:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.808956:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.808971:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.808977:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c400/0x34dc807b6ef9cb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.809013:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991651584:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 14129us (14859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.809020:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21603 00000100:00100000:3.0:1746127003.809250:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991652352:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4415us (4792us total) trans 17179875590 rc 0/0 00000100:00100000:3.0:1746127003.809259:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1899 00002000:00100000:3.0:1746127003.809266:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1331199) req@ffff880094826a00 x1830945991652352/t17179875590(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/448 e 0 to 0 dl 1746127014 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.809274:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094826a00 with x1830945991652352 ext(1048576->1331199) 00010000:00010000:3.0:1746127003.809281:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.809292:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00002000:00010000:3.0:1746127003.809298:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094826a00 00000100:00100000:0.0:1746127003.812487:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.812567:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991654272 00000100:00100000:2.0:1746127003.812574:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991654272 00010000:00010000:2.0:1746127003.812603:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.812624:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10115 00000100:00100000:2.0:1746127003.812628:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991654272:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127003.812637:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.812651:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.812660:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.812676:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6ef9bfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5315a expref: 46 pid: 1507 timeout: 998 lvb_type: 0 00010000:00010000:2.0:1746127003.812687:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.812689:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.812693:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.812698:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.812721:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127003.812755:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.812765:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.812780:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.812787:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.812794:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.812799:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6ce00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127003.812802:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.812807:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991654272:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 177us (327us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127003.812810:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.812812:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10115 00010000:00010000:1.0:1746127003.812820:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.812826:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6ef9ca4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127003.813036:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991651712:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 18383us (19191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.813056:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21600 00000100:00100000:0.0:1746127003.814307:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.814348:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991654528 00000100:00100000:2.0:1746127003.814354:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991654528 00000100:00100000:2.0:1746127003.814461:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17268 00000100:00100000:2.0:1746127003.814469:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4286:x1830945991654528:12345-192.168.203.42@tcp:36:mirror_io.0 00010000:00010000:2.0:1746127003.814510:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127003.814527:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9c9d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ca expref: 14 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814642:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.814646:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127003.814719:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.814732:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 17 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814739:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 43 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814751:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 17 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814757:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 17 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814763:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 43 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814768:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 8/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.814793:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 43 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814805:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 43 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.814819:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994255744:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.814915:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 17 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814922:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 17 pid: 13448 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.814930:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994255872:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.814954:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 17 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814962:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 17 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.814969:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd66680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994256000:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.814991:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 43 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.814998:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 43 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.815005:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd67800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994256128:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.815024:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 17 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.815030:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 17 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:2.0:1746127003.815037:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994256256:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.815078:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127003.816194:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994255872:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.816630:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.816691:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd66680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994256000:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.816699:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd67800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994256128:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127003.816704:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994256256:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127003.816846:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.816915:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994255744:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127003.816953:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127003.817171:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.817441:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991654656 00000100:00100000:1.0:1746127003.817448:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991654656 00010000:00010000:1.0:1746127003.817477:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 18 pid: 13448 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.817506:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991655168 00000100:00100000:1.0:1746127003.817508:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991655168 00010000:00010000:1.0:1746127003.817519:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 44 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.817532:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991654784 00000100:00100000:1.0:1746127003.817534:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991654784 00010000:00010000:1.0:1746127003.817541:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 19 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.817555:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10116 00000100:00100000:1.0:1746127003.817562:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991654656:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.817588:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.817593:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 19 pid: 13448 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817601:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 19 pid: 13448 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817618:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7200/0x34dc807b6ef97f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eac expref: 19 pid: 13448 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817630:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.817634:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.817642:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.817677:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991654656:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 115us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.817683:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10116 00000100:00100000:1.0:1746127003.817696:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10117 00000100:00100000:1.0:1746127003.817701:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991655168:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.817706:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.817710:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 44 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817717:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 44 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817730:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6ef9805 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52eba expref: 44 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817737:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.817740:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.817744:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.817758:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991655168:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 57us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.817763:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10117 00000100:00100000:1.0:1746127003.817772:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10118 00000100:00100000:1.0:1746127003.817777:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991654784:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.817784:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.817787:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 17 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817795:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 17 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817805:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6ef97f0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52ea5 expref: 17 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.817812:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.817814:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.817822:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.817834:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991654784:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 57us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.817839:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10118 00000100:00100000:0.0:1746127003.818157:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.818878:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991655040 00000100:00100000:3.0:1746127003.818884:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991655040 00010000:00010000:3.0:1746127003.818906:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 43 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.818927:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10119 00000100:00100000:3.0:1746127003.818932:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991655040:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127003.818939:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127003.818943:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 43 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.818951:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 43 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.818962:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6ef98e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f69 expref: 43 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:3.0:1746127003.818972:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.818976:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.818982:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127003.819014:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991655040:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 81us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.819020:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10119 00000100:00100000:0.0:1746127003.819550:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.819620:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991654912 00000100:00100000:1.0:1746127003.819631:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991654912 00010000:00010000:1.0:1746127003.819665:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 16 pid: 7258 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.819704:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10120 00000100:00100000:1.0:1746127003.819711:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991654912:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.819723:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.819728:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 16 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.819739:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 16 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.819758:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012341b000/0x34dc807b6ef988a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e52f2a expref: 16 pid: 7258 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.819774:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.819779:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.819787:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.819796:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.819822:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.819872:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991654912:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 161us (321us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127003.819876:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127003.819878:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10120 00010000:00010000:2.0:1746127003.819884:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000040:00080000:2.0:1746127003.820175:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1380, 88 off129040 00000004:00080000:2.0:1746127003.820182:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898862052288ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.820208:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1400, 88 off130888 00000004:00080000:2.0:1746127003.820212:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898862083065ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127003.820225:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1401, 88 off130976 00000004:00080000:2.0:1746127003.820227:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898862098048ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127003.820238:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1381, 88 off129128 00000004:00080000:2.0:1746127003.820241:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898862111588ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.820264:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1382, 88 off129216 00000004:00080000:2.0:1746127003.820267:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898862137909ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.820380:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1403, 88 off131160 00000004:00080000:2.0:1746127003.820385:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898862255239ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127003.820399:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1404, 88 off131248 00000004:00080000:2.0:1746127003.820401:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898862272079ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127003.820505:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1405, 88 off131336 00000004:00080000:2.0:1746127003.820510:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898862380358ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127003.820531:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1383, 88 off129304 00000004:00080000:2.0:1746127003.821205:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898863075547ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.821242:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1406, 88 off131424 00000004:00080000:2.0:1746127003.821248:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898863118578ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127003.821260:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1384, 88 off129392 00000004:00080000:2.0:1746127003.821262:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898863132758ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.821269:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1407, 88 off131512 00000004:00080000:2.0:1746127003.821271:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898863141551ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127003.821279:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1385, 88 off129480 00000004:00080000:2.0:1746127003.821281:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898863152091ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.821288:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1386, 88 off129568 00000004:00080000:2.0:1746127003.821291:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898863161587ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.821298:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1387, 88 off129656 00000004:00080000:2.0:1746127003.821301:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898863171411ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.821312:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1388, 88 off129744 00000004:00080000:2.0:1746127003.821315:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898863185262ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127003.821321:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1408, 88 off131600 00000004:00080000:2.0:1746127003.821324:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 898863194587ns, next at 895431202182ns, rc = 0 00000001:00080000:3.0:1746127003.823118:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938204 is committed 00000004:00080000:3.0:1746127003.823153:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1382 committed 00000004:00080000:3.0:1746127003.823160:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1363 committed 00000004:00080000:3.0:1746127003.823445:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1362 committed 00000004:00080000:3.0:1746127003.823448:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1361 committed 00000004:00080000:3.0:1746127003.823450:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1360 committed 00000004:00080000:3.0:1746127003.823452:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1381 committed 00000004:00080000:3.0:1746127003.823454:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1359 committed 00000004:00080000:3.0:1746127003.823456:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1380 committed 00000004:00080000:3.0:1746127003.823457:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1358 committed 00000004:00080000:3.0:1746127003.823459:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1379 committed 00000004:00080000:3.0:1746127003.823460:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1378 committed 00000004:00080000:3.0:1746127003.823461:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1377 committed 00000004:00080000:3.0:1746127003.823463:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1357 committed 00000004:00080000:3.0:1746127003.823464:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1356 committed 00000004:00080000:3.0:1746127003.823466:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1376 committed 00000004:00080000:3.0:1746127003.823467:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1375 committed 00000004:00080000:3.0:1746127003.823468:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1355 committed 00000001:00080000:3.0:1746127003.823477:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938201 is committed 00000001:00080000:3.0:1746127003.823489:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938197 is committed 00000004:00010000:2.0:1746127003.823602:0:13448:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880123475180 reply state ffff8800966a6800 transno 8589938204 ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.823622:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.823631:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.823634:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746127003.823637:0:13448:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746127003.823725:0:13448:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746127003.823727:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994256512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127003.823741:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4286:x1830945991654528:12345-192.168.203.42@tcp:36:mirror_io.0 Request processed in 9270us (9435us total) trans 8589938204 rc 0/0 00000100:00100000:2.0:1746127003.823750:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17268 00000100:00100000:0.0:1746127003.823776:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746127003.823791:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.823798:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127003.823801:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994257024:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746127003.823804:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.823809:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800994bce00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127003.823813:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.823819:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.823827:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.823830:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127003.823832:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127003.823837:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bce00/0x34dc807b6ef9cce lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127003.823950:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994256384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127003.824187:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994256640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127003.824237:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127003.824252:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994256896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127003.824264:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127003.824273:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994257408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127003.824285:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127003.824294:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994257920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127003.824305:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127003.824319:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746127003.824323:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994257536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127003.824336:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127003.824345:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994258048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127003.824356:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127003.824380:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994256512 00000100:00100000:1.0:1746127003.824386:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994256512 00000100:00100000:1.0:1746127003.824411:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994256384 00000100:00100000:1.0:1746127003.824413:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994256384 00000100:00100000:1.0:1746127003.824423:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994256896 00000100:00100000:1.0:1746127003.824425:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994256896 00000100:00100000:1.0:1746127003.824433:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257408 00000100:00100000:1.0:1746127003.824434:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257408 00000100:00100000:1.0:1746127003.824441:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257920 00000100:00100000:1.0:1746127003.824443:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257920 00000100:00100000:2.0:1746127003.824447:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257536 00000100:00100000:1.0:1746127003.824448:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994258048 00000100:00100000:2.0:1746127003.824450:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257536 00000100:00100000:1.0:1746127003.824450:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994258048 00000100:00100000:1.0:1746127003.824457:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21606 00000100:00100000:1.0:1746127003.824462:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3785:x1830945994256512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127003.824466:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21607 00000100:00100000:2.0:1746127003.824472:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3784:x1830945994256384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127003.824607:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3784:x1830945994256384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (370us total) trans 17179875591 rc 0/0 00000100:00100000:2.0:1746127003.824613:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21607 00000100:00100000:2.0:1746127003.824622:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21608 00000100:00100000:2.0:1746127003.824626:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3784:x1830945994256896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127003.824662:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127003.824665:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127003.824667:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:2.0:1746127003.824669:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127003.824671:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:2.0:1746127003.824686:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3784:x1830945994256896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (420us total) trans 17179875592 rc 0/0 00000100:00100000:2.0:1746127003.824690:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21608 00000100:00100000:2.0:1746127003.824698:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21609 00000100:00100000:2.0:1746127003.824701:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3784:x1830945994257408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127003.824746:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3784:x1830945994257408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (459us total) trans 17179875593 rc 0/0 00000100:00100000:2.0:1746127003.824750:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21609 00000100:00100000:2.0:1746127003.824758:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21610 00000100:00100000:2.0:1746127003.824762:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3784:x1830945994257920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127003.824794:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127003.824815:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257024 00000100:00100000:0.0:1746127003.824818:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257024 00000100:00100000:0.0:1746127003.824831:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21611 00000100:00100000:2.0:1746127003.824832:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3784:x1830945994257920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (525us total) trans 21474842853 rc 0/0 00000100:00100000:0.0:1746127003.824836:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3784:x1830945994258048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127003.824837:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21610 00000100:00100000:2.0:1746127003.824845:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21612 00000100:00100000:2.0:1746127003.824850:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3784:x1830945994257536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127003.824894:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3784:x1830945994258048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (537us total) trans 21474842854 rc 0/0 00000100:00100000:0.0:1746127003.824899:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21611 00000100:00100000:2.0:1746127003.824906:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3784:x1830945994257536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (568us total) trans 21474842855 rc 0/0 00000100:00100000:0.0:1746127003.824908:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21613 00000100:00100000:0.0:1746127003.824912:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3785:x1830945994257024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127003.824915:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21612 00000100:00100000:3.0:1746127003.824977:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825004:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127003.825018:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825026:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825037:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825043:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994258176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825065:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825075:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746127003.825079:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994256768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127003.825093:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825098:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127003.825110:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825115:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825124:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825143:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994258304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825163:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127003.825182:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994256640 00000100:00100000:3.0:1746127003.825184:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994256640 00000100:00100000:3.0:1746127003.825196:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257152 00000100:00100000:3.0:1746127003.825197:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257152 00000100:00100000:3.0:1746127003.825202:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257664 00000100:00100000:3.0:1746127003.825203:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257664 00000100:00100000:3.0:1746127003.825208:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994258176 00000100:00100000:3.0:1746127003.825209:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994258176 00000100:00100000:3.0:1746127003.825214:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994256768 00000100:00100000:3.0:1746127003.825216:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994256768 00000100:00100000:3.0:1746127003.825220:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257280 00000100:00100000:3.0:1746127003.825221:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257280 00000100:00100000:3.0:1746127003.825225:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994257792 00000100:00100000:3.0:1746127003.825227:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994257792 00000100:00100000:3.0:1746127003.825231:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994258304 00000100:00100000:3.0:1746127003.825232:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994258304 00000100:00100000:3.0:1746127003.825239:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21614 00000100:00100000:3.0:1746127003.825242:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3782:x1830945994256640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127003.825294:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994256640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (316us total) trans 17179875595 rc 0/0 00000100:00100000:3.0:1746127003.825298:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21614 00000100:00100000:3.0:1746127003.825307:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21615 00000100:00100000:3.0:1746127003.825311:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3782:x1830945994257152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127003.825342:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:3.0:1746127003.825345:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:3.0:1746127003.825347:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127003.825348:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:3.0:1746127003.825350:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1746127003.825363:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994257152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (344us total) trans 17179875596 rc 0/0 00000100:00100000:3.0:1746127003.825366:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21615 00000100:00100000:3.0:1746127003.825374:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21616 00000100:00100000:3.0:1746127003.825378:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3782:x1830945994257664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825416:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994257664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (378us total) trans 21474842856 rc 0/0 00000100:00100000:3.0:1746127003.825420:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21616 00000100:00100000:3.0:1746127003.825426:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21617 00000100:00100000:3.0:1746127003.825430:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3782:x1830945994258176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127003.825462:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127003.825464:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127003.825466:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127003.825468:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127003.825469:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:3.0:1746127003.825482:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994258176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (416us total) trans 21474842857 rc 0/0 00000100:00100000:3.0:1746127003.825486:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21617 00000100:00100000:3.0:1746127003.825493:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21618 00000100:00100000:3.0:1746127003.825496:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3782:x1830945994256768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127003.825538:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994256768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (444us total) trans 17179875597 rc 0/0 00000100:00100000:3.0:1746127003.825542:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21618 00000100:00100000:1.0:1746127003.825547:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3785:x1830945994256512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1084us (1770us total) trans 21474842858 rc 0/0 00000100:00100000:3.0:1746127003.825549:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21619 00000100:00100000:3.0:1746127003.825552:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3782:x1830945994257280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127003.825553:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21606 00000100:00100000:1.0:1746127003.825564:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21620 00000100:00100000:1.0:1746127003.825568:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3782:x1830945994257792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825590:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994257280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (479us total) trans 17179875598 rc 0/0 00000100:00100000:3.0:1746127003.825594:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21619 00000100:00100000:3.0:1746127003.825604:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21621 00002000:00010000:1.0:1746127003.825605:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746127003.825607:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00000100:00100000:3.0:1746127003.825609:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994258304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127003.825609:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127003.825611:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127003.825612:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:1.0:1746127003.825630:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994257792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (504us total) trans 21474842859 rc 0/0 00000100:00100000:1.0:1746127003.825635:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21620 00002000:00010000:3.0:1746127003.825657:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:3.0:1746127003.825659:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127003.825661:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127003.825662:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127003.825664:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000004:00080000:1.0:1746127003.825676:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094827800/2, rc 0, transno 21474842855 00000100:00100000:3.0:1746127003.825685:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994258304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (520us total) trans 21474842860 rc 0/0 00000100:00100000:1.0:1746127003.825686:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994257536:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127003.825696:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094825f80/2, rc 0, transno 21474842854 00000100:00100000:3.0:1746127003.825699:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21621 00000100:00100000:1.0:1746127003.825699:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994258048:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127003.825707:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880123474a80/2, rc 0, transno 17179875591 00000100:00100000:1.0:1746127003.825710:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994256384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127003.825716:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba57100/2, rc 0, transno 17179875592 00000100:00100000:1.0:1746127003.825719:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994256896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127003.825725:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba55c00/2, rc 0, transno 17179875593 00000100:00100000:1.0:1746127003.825727:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994257408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127003.825728:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880123477800/2, rc 0, transno 17179875597 00000004:00080000:1.0:1746127003.825732:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094825180/2, rc 0, transno 21474842853 00000100:00100000:3.0:1746127003.825733:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994256768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127003.825735:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994257920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127003.825737:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3785:x1830945994257024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 823us (941us total) trans 17179875594 rc 0/0 00000004:00080000:3.0:1746127003.825742:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba56d80/2, rc 0, transno 17179875598 00000100:00100000:0.0:1746127003.825744:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21613 00000100:00100000:3.0:1746127003.825745:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127003.825755:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094827b80/2, rc 0, transno 21474842859 00000100:00100000:3.0:1746127003.825758:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127003.825766:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094824700/2, rc 0, transno 21474842858 00000004:00080000:3.0:1746127003.825767:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd4700/2, rc 0, transno 21474842860 00000100:00100000:0.0:1746127003.825769:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994256512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127003.825770:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994258432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825771:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994258304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127003.825777:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba56680/2, rc 0, transno 17179875594 00000100:00100000:0.0:1746127003.825780:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994257024:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127003.825781:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880123476680/2, rc 0, transno 17179875595 00000100:00100000:3.0:1746127003.825785:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994256640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127003.825789:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746127003.825792:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba55180/2, rc 0, transno 17179875596 00000100:00100000:3.0:1746127003.825795:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127003.825803:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094826300/2, rc 0, transno 21474842856 00000100:00100000:3.0:1746127003.825805:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994257664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127003.825805:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994258432 00000100:00100000:1.0:1746127003.825808:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994258432 00000004:00080000:3.0:1746127003.825811:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094824000/2, rc 0, transno 21474842857 00000100:00100000:3.0:1746127003.825814:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994258176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127003.825821:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21622 00000100:00100000:1.0:1746127003.825824:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3784:x1830945994258432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127003.825873:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3784:x1830945994258432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (84us total) trans 21474842861 rc 0/0 00000100:00100000:1.0:1746127003.825878:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21622 00000100:00100000:0.0:1746127003.825887:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000004:00080000:1.0:1746127003.825892:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22f480/2, rc 0, transno 21474842861 00000100:00100000:1.0:1746127003.825895:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994258432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127003.825973:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991655424 00000100:00100000:3.0:1746127003.825976:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991655424 00000100:00100000:3.0:1746127003.826009:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17269 00000100:00100000:3.0:1746127003.826016:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4291:x1830945991655424:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127003.826034:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.826064:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad600/0x34dc807b6ef9cd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531d1 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.826164:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826176:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826187:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826199:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826208:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826213:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826303:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826314:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 6 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.826321:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.826367:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 6 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.826386:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 6 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:3.0:1746127003.826397:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994258560:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127003.827111:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127003.827231:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.827279:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991655552 00000100:00100000:2.0:1746127003.827285:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991655552 00000100:00100000:2.0:1746127003.827449:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17270 00000100:00100000:2.0:1746127003.827456:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4286:x1830945991655552:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127003.827482:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.827493:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531d8 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.827527:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.827537:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.827551:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.827554:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127003.827557:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665d000, rc 0) 00000100:00100000:2.0:1746127003.827600:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4286:x1830945991655552:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 144us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.827606:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17270 00000100:00100000:3.0:1746127003.829108:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994258560:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127003.829149:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127003.829264:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.829299:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.829352:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991655808 00000100:00100000:2.0:1746127003.829357:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991655808 00000100:00100000:2.0:1746127003.829388:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17271 00000100:00100000:2.0:1746127003.829393:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4286:x1830945991655808:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127003.829405:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.829416:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc800/0x34dc807b6ef9cf8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531df expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.829484:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127003.829498:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127003.829506:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127003.829536:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127003.829540:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127003.829556:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127003.829577:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc800/0x34dc807b6ef9cf8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.829588:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 9 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.829595:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127003.829598:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127003.829600:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc000, rc 0) 00000100:00100000:2.0:1746127003.829627:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4286:x1830945991655808:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 233us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.829632:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17271 00000100:00100000:1.0:1746127003.829688:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991655680 00000100:00100000:1.0:1746127003.829692:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991655680 00010000:00010000:1.0:1746127003.829709:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 9 pid: 10958 timeout: 998 lvb_type: 0 00000100:00100000:1.0:1746127003.829726:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10121 00000100:00100000:1.0:1746127003.829730:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991655680:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127003.829739:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127003.829744:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 9 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.829754:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 9 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.829767:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6ef9c8f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531c3 expref: 9 pid: 10958 timeout: 998 lvb_type: 0 00010000:00010000:1.0:1746127003.829782:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.829785:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.829792:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.829797:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127003.829820:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127003.829838:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2028:x1830945991655680:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 107us (539us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127003.829844:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127003.829844:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10121 00010000:00010000:3.0:1746127003.829850:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127003.829863:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127003.829944:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.829951:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.829956:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.829962:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd03c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127003.829965:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.829972:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.829980:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.829982:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127003.829985:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.829989:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9cea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830006:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830011:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830014:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830022:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd02200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127003.830024:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830029:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830036:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127003.830038:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127003.830041:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830057:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6ef9cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830067:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830071:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830075:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830079:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd02e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127003.830081:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830086:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830091:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099507500) 00010000:00010000:3.0:1746127003.830094:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127003.830096:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830100:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9ce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.830157:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad600/0x34dc807b6ef9cd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d1 expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.830163:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad600/0x34dc807b6ef9cd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d1 expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.830171:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdad600, rc 0) 00000100:00100000:3.0:1746127003.830193:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4291:x1830945991655424:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4178us (4306us total) trans 8589938205 rc 301/301 00000100:00100000:3.0:1746127003.830199:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17269 00000100:00100000:0.0:1746127003.832805:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.832837:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.832859:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.832871:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.832892:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.832951:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.833018:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991655936 00000100:00100000:2.0:1746127003.833026:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991655936 00000100:00100000:2.0:1746127003.833081:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991656192 00000100:00100000:2.0:1746127003.833083:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991656192 00000100:00100000:2.0:1746127003.833095:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991656448 00000100:00100000:2.0:1746127003.833096:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991656448 00000100:00100000:2.0:1746127003.833105:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991656064 00000100:00100000:2.0:1746127003.833107:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991656064 00000100:00100000:2.0:1746127003.833116:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991656320 00000100:00100000:2.0:1746127003.833117:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991656320 00000100:00100000:3.0:1746127003.833119:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991656576 00000100:00100000:3.0:1746127003.833123:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991656576 00000100:00100000:2.0:1746127003.833160:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21623 00000100:00100000:3.0:1746127003.833167:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21624 00000100:00100000:2.0:1746127003.833168:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991655936:12345-192.168.203.42@tcp:101:mirror_io.0 00000100:00100000:3.0:1746127003.833174:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991656192:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127003.833184:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.833184:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.833204:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531f4 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.833204:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531e6 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127003.833226:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c89a, atime: 0x6813c89a, ctime: 0x6813c89a, blocks: 0x808 00002000:00010000:2.0:1746127003.833226:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c89a, atime: 0x6813c899, ctime: 0x6813c89a, blocks: 0x7f8 00010000:00010000:3.0:1746127003.833241:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.833241:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.833243:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.833243:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.833251:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 18 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.833254:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.833267:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.833277:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e9600, rc 0) 00000100:00100000:1.0:1746127003.833291:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21625 00000100:00100000:1.0:1746127003.833299:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991656448:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127003.833306:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.833315:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53202 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.833317:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991655936:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 150us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.833322:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21623 00010000:00010000:3.0:1746127003.833325:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 18 pid: 9613 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746127003.833326:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c899, atime: 0x6813c899, ctime: 0x6813c899, blocks: 0x14e0 00010000:00010000:3.0:1746127003.833333:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03200, rc 0) 00000100:00100000:2.0:1746127003.833335:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21626 00010000:00010000:1.0:1746127003.833335:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.833337:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127003.833339:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991656064:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127003.833342:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 15 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.833345:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.833352:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531ed expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127003.833353:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991656192:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 180us (515us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127003.833353:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 15 pid: 9612 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127003.833358:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21624 00010000:00010000:1.0:1746127003.833360:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6ce00, rc 0) 00002000:00010000:2.0:1746127003.833366:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c89a, atime: 0x6813c89a, ctime: 0x6813c89a, blocks: 0x800 00000100:00100000:3.0:1746127003.833370:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21627 00010000:00010000:2.0:1746127003.833372:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.833374:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127003.833375:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991656320:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127003.833377:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 18 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127003.833378:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991656448:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 81us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.833383:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21625 00010000:00010000:3.0:1746127003.833384:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.833385:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 18 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.833392:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e531fb expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.833392:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8400, rc 0) 00000100:00100000:1.0:1746127003.833394:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21628 00000100:00100000:1.0:1746127003.833399:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991656576:12345-192.168.203.42@tcp:101:mirror_io.0 00002000:00010000:3.0:1746127003.833404:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c899, atime: 0x6813c899, ctime: 0x6813c899, blocks: 0x800 00010000:00010000:1.0:1746127003.833404:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127003.833405:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991656064:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 66us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.833409:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21626 00010000:00010000:3.0:1746127003.833411:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.833413:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.833413:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53209 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.833417:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746127003.833422:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c89a, atime: 0x6813c899, ctime: 0x6813c89a, blocks: 0x1008 00010000:00010000:3.0:1746127003.833425:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.833428:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.833430:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.833432:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02c00, rc 0) 00010000:00010000:1.0:1746127003.833433:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 18 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.833442:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 18 pid: 9612 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127003.833448:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991656320:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 73us (555us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127003.833455:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d400, rc 0) 00000100:00100000:3.0:1746127003.833456:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21627 00000100:00100000:1.0:1746127003.833468:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991656576:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 69us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.833473:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21628 00010000:00010000:2.0:1746127003.891018:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127003.909794:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.909914:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991656832 00000100:00100000:3.0:1746127003.909924:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991656832 00000100:00100000:0.0:1746127003.910471:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17272 00000100:00100000:0.0:1746127003.910481:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4293:x1830945991656832:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127003.910507:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.910527:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef9d37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53210 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.910606:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.910619:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.910630:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.910642:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.910647:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.910652:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.910780:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.910789:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.910795:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:1.0:1746127003.910803:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127003.911667:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911675:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911681:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911686:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6c000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.911690:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911696:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911706:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.911709:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746127003.911713:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911718:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c000/0x34dc807b6ef9d4c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911751:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911757:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911761:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911766:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911770:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c37600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.911772:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911776:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911782:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127003.911784:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127003.911787:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911791:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37600/0x34dc807b6ef9d3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911799:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911804:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911809:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911813:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c36600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.911815:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911820:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911825:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f700) 00010000:00010000:1.0:1746127003.911827:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127003.911829:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911833:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36600/0x34dc807b6ef9d45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.911868:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef9d37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53210 expref: 29 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.911873:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4e00/0x34dc807b6ef9d37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53210 expref: 29 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.911880:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4e00, rc 0) 00000100:00100000:1.0:1746127003.911939:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4293:x1830945991656832:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1461us (2157us total) trans 8589938206 rc 301/301 00000100:00100000:1.0:1746127003.911946:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17272 00000100:00100000:0.0:1746127003.918093:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.918239:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991657088 00000100:00100000:1.0:1746127003.918249:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991657088 00000100:00100000:1.0:1746127003.918352:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17273 00000100:00100000:1.0:1746127003.918361:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4296:x1830945991657088:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.918390:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.918409:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6ef9d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53217 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.918566:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918578:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918586:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918598:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918603:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918607:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918708:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918716:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918720:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:1.0:1746127003.918732:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127003.918799:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918806:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918811:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918816:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6dc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.918820:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918826:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918836:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.918838:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746127003.918842:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918846:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9d6f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918885:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918890:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918894:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918903:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918907:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6ca00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.918909:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918914:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918921:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127003.918923:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127003.918926:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918931:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6ef9d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918939:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.918944:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.919189:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.919195:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6c200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127003.919197:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.919202:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.919214:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a600) 00010000:00010000:1.0:1746127003.919216:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127003.919218:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.919223:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6ef9d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.919261:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6ef9d5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53217 expref: 30 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.919269:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6ef9d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53217 expref: 30 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.919276:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d000, rc 0) 00000100:00100000:1.0:1746127003.919326:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4296:x1830945991657088:12345-192.168.203.42@tcp:101:cat.0 Request processed in 966us (1244us total) trans 8589938207 rc 301/301 00000100:00100000:1.0:1746127003.919332:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17273 00000100:00100000:2.0:1746127003.919894:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.920083:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991657344 00000100:00100000:0.0:1746127003.920089:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991657344 00000100:00100000:0.0:1746127003.920144:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17274 00000100:00100000:0.0:1746127003.920152:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4299:x1830945991657344:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.920168:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.920179:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6ef9d7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5321e expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.920223:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920230:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920237:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920247:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920252:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920258:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920314:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920321:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920326:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:0.0:1746127003.920333:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127003.920371:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920377:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920386:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920390:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b22600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127003.920393:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920397:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920405:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127003.920407:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746127003.920410:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920414:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22600/0x34dc807b6ef9d92 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920428:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920432:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920436:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920441:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920445:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b23c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127003.920446:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920454:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920459:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127003.920461:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127003.920463:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920467:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23c00/0x34dc807b6ef9d84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920473:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920478:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920482:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920485:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b22c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127003.920487:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920491:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920495:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f800) 00010000:00010000:0.0:1746127003.920497:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127003.920499:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920503:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9d8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127003.920529:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6ef9d7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5321e expref: 11 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.920536:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6ef9d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5321e expref: 11 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.920543:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22000, rc 0) 00000100:00100000:0.0:1746127003.920581:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4299:x1830945991657344:12345-192.168.203.42@tcp:101:cat.0 Request processed in 417us (676us total) trans 8589938208 rc 301/301 00000100:00100000:0.0:1746127003.920586:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17274 00000100:00100000:2.0:1746127003.921876:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.921931:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991657600 00000100:00100000:0.0:1746127003.921937:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991657600 00000100:00100000:0.0:1746127003.921972:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6576 00000100:00100000:0.0:1746127003.921977:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4296:x1830945991657600:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746127003.922117:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4296:x1830945991657600:12345-192.168.203.42@tcp:35:cat.0 Request processed in 139us (246us total) trans 8589938209 rc 0/0 00000100:00100000:0.0:1746127003.922123:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6576 00000100:00100000:0.0:1746127003.926517:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.926621:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991657856 00000100:00100000:2.0:1746127003.926630:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991657856 00000100:00100000:2.0:1746127003.926683:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6577 00000100:00100000:2.0:1746127003.926691:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4299:x1830945991657856:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746127003.927267:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127003.927334:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4299:x1830945991657856:12345-192.168.203.42@tcp:35:cat.0 Request processed in 643us (826us total) trans 8589938210 rc 0/0 00000100:00100000:2.0:1746127003.927341:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6577 00000100:00100000:3.0:1746127003.927405:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991657984 00000100:00100000:3.0:1746127003.927408:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991657984 00000100:00100000:3.0:1746127003.927432:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17275 00000100:00100000:3.0:1746127003.927437:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4296:x1830945991657984:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.927449:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.927467:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9da0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53225 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.927530:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.927546:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.927557:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127003.927582:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127003.927586:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127003.927596:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.927616:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03c00/0x34dc807b6ef9da0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.927642:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.927688:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.927691:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127003.927693:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03600, rc 0) 00000100:00100000:3.0:1746127003.927726:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4296:x1830945991657984:12345-192.168.203.42@tcp:101:cat.0 Request processed in 288us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.927732:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17275 00000100:00100000:1.0:1746127003.930360:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.930426:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.930479:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.930508:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991658240 00000100:00100000:1.0:1746127003.930515:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991658240 00000100:00100000:1.0:1746127003.930561:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991658368 00000100:00100000:1.0:1746127003.930564:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991658368 00000100:00100000:1.0:1746127003.930586:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21629 00000100:00100000:1.0:1746127003.930596:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991658240:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.930615:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.930635:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53233 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.930659:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.930662:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.930673:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 37 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.930690:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 37 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.930702:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d600, rc 0) 00000100:00100000:1.0:1746127003.930755:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991658240:12345-192.168.203.42@tcp:101:cat.0 Request processed in 159us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.930761:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21629 00000100:00100000:1.0:1746127003.930780:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21630 00000100:00100000:1.0:1746127003.930786:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991658368:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.930796:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.930808:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5323a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.930821:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.930822:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.930828:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 46 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.930838:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 46 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.930851:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6ca00, rc 0) 00000100:00100000:1.0:1746127003.930874:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991658368:12345-192.168.203.42@tcp:101:cat.0 Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.930879:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21630 00000100:00100000:3.0:1746127003.931619:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991658112 00000100:00100000:3.0:1746127003.931626:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991658112 00000100:00100000:3.0:1746127003.931667:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17276 00000100:00100000:3.0:1746127003.931675:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4299:x1830945991658112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.931694:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.931709:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9dbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5322c expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.931803:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6ef9dc3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.931818:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6ef9dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.931828:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6ef9dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127003.931858:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127003.931863:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127003.931882:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6ef9dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127003.931908:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6ef9dbc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5322c expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.931925:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6ef9dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5322c expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127003.931932:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127003.931934:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127003.931937:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665da00, rc 0) 00000100:00100000:3.0:1746127003.931976:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4299:x1830945991658112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 300us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.931981:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17276 00000100:00100000:0.0:1746127003.933023:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.933080:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.933107:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.933179:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.933226:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991658496 00000100:00100000:0.0:1746127003.933233:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991658496 00000100:00100000:0.0:1746127003.933265:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991658624 00000100:00100000:0.0:1746127003.933269:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991658624 00000100:00100000:0.0:1746127003.933288:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991658752 00000100:00100000:0.0:1746127003.933292:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991658752 00000100:00100000:0.0:1746127003.933307:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991658880 00000100:00100000:0.0:1746127003.933310:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991658880 00000100:00100000:0.0:1746127003.933328:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21631 00000100:00100000:0.0:1746127003.933335:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991658496:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.933349:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.933364:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53241 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.933385:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933387:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933396:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933411:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933421:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b23400, rc 0) 00000100:00100000:0.0:1746127003.933457:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991658496:12345-192.168.203.42@tcp:101:cat.0 Request processed in 122us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.933463:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21631 00000100:00100000:0.0:1746127003.933481:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21632 00000100:00100000:0.0:1746127003.933488:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991658624:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.933496:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.933505:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53248 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.933522:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933524:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933529:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 39 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933539:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 39 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933547:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22e00, rc 0) 00000100:00100000:0.0:1746127003.933571:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991658624:12345-192.168.203.42@tcp:101:cat.0 Request processed in 83us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.933576:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21632 00000100:00100000:0.0:1746127003.933590:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21633 00000100:00100000:0.0:1746127003.933596:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991658752:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.933603:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.933612:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5324f expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.933624:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933626:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933631:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 39 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933641:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 39 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933652:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22c00, rc 0) 00000100:00100000:0.0:1746127003.933675:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991658752:12345-192.168.203.42@tcp:101:cat.0 Request processed in 79us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.933679:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21633 00000100:00100000:0.0:1746127003.933693:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21634 00000100:00100000:0.0:1746127003.933698:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991658880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127003.933705:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127003.933713:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53256 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127003.933724:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933725:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127003.933731:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933740:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127003.933747:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b23c00, rc 0) 00000100:00100000:0.0:1746127003.933769:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991658880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 70us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127003.933773:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21634 00000100:00100000:0.0:1746127003.934896:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.934923:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.935859:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.936265:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.936279:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991659008 00000100:00100000:3.0:1746127003.936286:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991659008 00000100:00100000:3.0:1746127003.936328:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991659136 00000100:00100000:3.0:1746127003.936330:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991659136 00000100:00100000:3.0:1746127003.936339:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991659264 00000100:00100000:3.0:1746127003.936341:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991659264 00000100:00100000:3.0:1746127003.936351:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21635 00000100:00100000:3.0:1746127003.936357:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991659008:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127003.936369:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127003.936382:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5325d expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.936411:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21636 00000100:00100000:1.0:1746127003.936416:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21637 00000100:00100000:2.0:1746127003.936418:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991659136:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127003.936422:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991659264:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127003.936424:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.936427:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.936433:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53264 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.936433:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5326b expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127003.936447:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.936447:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.936449:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.936449:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.936456:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.936456:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.936468:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.936468:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.936477:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8600, rc 0) 00010000:00010000:1.0:1746127003.936477:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d000, rc 0) 00000100:00100000:1.0:1746127003.936512:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991659264:12345-192.168.203.42@tcp:101:cat.0 Request processed in 90us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.936518:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21637 00000100:00100000:1.0:1746127003.936530:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991659392 00000100:00100000:1.0:1746127003.936532:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991659392 00000100:00100000:1.0:1746127003.936545:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21638 00000100:00100000:2.0:1746127003.936548:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991659136:12345-192.168.203.42@tcp:101:cat.0 Request processed in 131us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.936550:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991659392:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127003.936553:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21636 00010000:00010000:1.0:1746127003.936554:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.936561:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53272 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.936569:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.936570:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.936574:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 26 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.936582:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 26 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.936588:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6dc00, rc 0) 00000100:00100000:1.0:1746127003.936602:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991659392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 51us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127003.936605:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21638 00000100:00100000:0.0:1746127003.936704:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.936744:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991659520 00000100:00100000:1.0:1746127003.936747:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991659520 00000100:00100000:0.0:1746127003.936749:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127003.936991:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.936994:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127003.937001:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 26 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.937014:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 26 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127003.937023:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdaca00, rc 0) 00000100:00100000:3.0:1746127003.937070:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991659008:12345-192.168.203.42@tcp:101:cat.0 Request processed in 712us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127003.937076:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21635 00000100:00100000:3.0:1746127003.937639:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991659648 00000100:00100000:3.0:1746127003.937642:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991659648 00000100:00100000:1.0:1746127003.937678:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21639 00000100:00100000:1.0:1746127003.937683:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991659520:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.937690:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.937698:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53279 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127003.937704:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21640 00010000:00010000:1.0:1746127003.937708:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127003.937709:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991659648:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127003.937709:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127003.937713:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 26 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.937715:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127003.937722:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53280 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.937722:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 26 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127003.937728:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4be800, rc 0) 00010000:00010000:2.0:1746127003.937730:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.937731:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127003.937735:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 28 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127003.937743:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 28 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127003.937747:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991659520:12345-192.168.203.42@tcp:101:cat.0 Request processed in 64us (1044us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127003.937751:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e9a00, rc 0) 00000100:00100000:1.0:1746127003.937751:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21639 00000100:00100000:2.0:1746127003.937763:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991659648:12345-192.168.203.42@tcp:101:cat.0 Request processed in 55us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127003.937768:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21640 00000100:00100000:0.0:1746127003.954508:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.954554:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.954585:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.954599:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.954626:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127003.954637:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.954663:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991660160 00000100:00100000:0.0:1746127003.954663:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991659904 00000100:00100000:1.0:1746127003.954671:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991660160 00000100:00100000:0.0:1746127003.954671:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991659904 00002000:00100000:1.0:1746127003.954719:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007ece5180 x1830945991660160/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.954728:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece5180 with x1830945991660160 ext(1048576->2097151) 00002000:00010000:1.0:1746127003.954733:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece5180 00000100:00100000:3.0:1746127003.954736:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991660416 00000100:00100000:3.0:1746127003.954739:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991660416 00000100:00100000:1.0:1746127003.954748:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991660672 00000100:00100000:1.0:1746127003.954750:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991660672 00000100:00100000:2.0:1746127003.954794:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991661184 00000100:00100000:2.0:1746127003.954799:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991661184 00002000:00100000:0.0:1746127003.955163:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88007ece7480 x1830945991659904/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.955170:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece7480 with x1830945991659904 ext(0->1048575) 00002000:00010000:0.0:1746127003.955174:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece7480 00000100:00100000:0.0:1746127003.955186:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991661056 00000100:00100000:0.0:1746127003.955188:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991661056 00002000:00100000:0.0:1746127003.955209:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007ece6d80 x1830945991661056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127003.955215:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6d80 with x1830945991661056 ext(1048576->2097151) 00002000:00010000:0.0:1746127003.955218:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece6d80 00000100:00100000:0.0:1746127003.955234:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8612 00000100:00100000:0.0:1746127003.955242:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2028:x1830945991660160:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127003.956342:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8613 00000100:00100000:0.0:1746127003.956353:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991659904:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:3.0:1746127003.957255:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ece6a00 x1830945991660416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.957255:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007ece5c00 x1830945991660672/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.957263:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6a00 with x1830945991660416 ext(1048576->2097151) 00002000:00100000:1.0:1746127003.957263:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece5c00 with x1830945991660672 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.957268:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece6a00 00002000:00010000:1.0:1746127003.957268:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece5c00 00000100:00100000:1.0:1746127003.957285:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8614 00000100:00100000:1.0:1746127003.957293:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991661056:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:2.0:1746127003.957319:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ece4000 x1830945991661184/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.957326:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4000 with x1830945991661184 ext(1048576->2097151) 00002000:00010000:2.0:1746127003.957329:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece4000 00000100:00100000:3.0:1746127003.957444:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8615 00000100:00100000:3.0:1746127003.957451:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991660672:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127003.957837:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8616 00000100:00100000:1.0:1746127003.957843:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2029:x1830945991660416:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.958117:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8617 00000100:00100000:3.0:1746127003.958122:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991661184:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127003.958531:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.958550:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991661440 00000100:00100000:1.0:1746127003.958555:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991661440 00002000:00100000:1.0:1746127003.958577:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009cc3dc00 x1830945991661440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.958582:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3dc00 with x1830945991661440 ext(0->1048575) 00002000:00010000:1.0:1746127003.958585:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3dc00 00000100:00100000:1.0:1746127003.958595:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8618 00000100:00100000:1.0:1746127003.958599:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991661440:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127003.959680:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127003.959707:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991661568 00000100:00100000:3.0:1746127003.959711:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991661568 00002000:00100000:3.0:1746127003.959732:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012238d500 x1830945991661568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/0 e 0 to 0 dl 1746127014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.959738:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238d500 with x1830945991661568 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.959742:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012238d500 00000100:00100000:3.0:1746127003.959756:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8619 00000100:00100000:3.0:1746127003.959761:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991661568:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127003.971035:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991660160:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15783us (16470us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127003.971057:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8612 00002000:00100000:2.0:1746127003.971070:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007ece5180 x1830945991660160/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127003.971079:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece5180 with x1830945991660160 ext(1048576->2097151) 00002000:00010000:2.0:1746127003.971084:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece5180 00000100:00100000:1.0:1746127003.974026:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991661056:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16724us (19375us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127003.974036:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8614 00002000:00100000:1.0:1746127003.974055:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007ece6d80 x1830945991661056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.974064:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6d80 with x1830945991661056 ext(1048576->2097151) 00002000:00010000:1.0:1746127003.974069:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece6d80 00000100:00100000:3.0:1746127003.979589:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991660672:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22127us (24976us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127003.979601:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8615 00002000:00100000:3.0:1746127003.979612:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007ece5c00 x1830945991660672/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.979621:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece5c00 with x1830945991660672 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.979626:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece5c00 00000100:00100000:3.0:1746127003.986268:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991661184:12345-192.168.203.42@tcp:3:cat.0 Request processed in 28131us (31626us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127003.986282:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8617 00002000:00100000:3.0:1746127003.986297:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ece4000 x1830945991661184/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.986308:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4000 with x1830945991661184 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.986314:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece4000 00000100:00100000:1.0:1746127003.992902:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991660416:12345-192.168.203.42@tcp:3:cat.0 Request processed in 35047us (38306us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127003.992914:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8616 00002000:00100000:1.0:1746127003.992927:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ece6a00 x1830945991660416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127003.992936:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6a00 with x1830945991660416 ext(1048576->2097151) 00002000:00010000:1.0:1746127003.992942:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece6a00 00000100:00100000:0.0:1746127003.994710:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127003.994793:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991661952 00000100:00100000:1.0:1746127003.994802:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991661952 00000100:00100000:1.0:1746127003.994859:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17277 00000100:00100000:1.0:1746127003.994867:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4291:x1830945991661952:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127003.994887:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127003.994891:0:10958:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746127003.994918:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6ef9dc3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5322c expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.994946:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127003.994950:0:10958:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127003.994961:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158e00/0x34dc807b6ef9e10 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53287 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.995092:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.995105:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 7 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.995113:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.995119:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 7 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.995125:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127003.995319:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 7 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.995330:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 7 pid: 10958 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127003.995346:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994258688:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.995443:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.995452:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 30 pid: 13448 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127003.995458:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994258816:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127003.995489:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 7 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127003.995495:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 7 pid: 7258 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127003.995502:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994258944:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127003.995517:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77540 going to sleep for 11 seconds 00000100:00100000:3.0:1746127003.997459:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991661568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 37688us (37775us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127003.997471:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8619 00002000:00100000:3.0:1746127003.997482:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012238d500 x1830945991661568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127003.997491:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238d500 with x1830945991661568 ext(1048576->2097151) 00002000:00010000:3.0:1746127003.997496:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012238d500 00000100:00100000:0.0:1746127004.002930:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.002965:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994258688:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.002978:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994258816:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.002982:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.003013:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662080 00000100:00100000:0.0:1746127004.003020:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662080 00010000:00010000:0.0:1746127004.003062:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 8 pid: 10958 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746127004.003088:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662208 00000100:00100000:0.0:1746127004.003091:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662208 00010000:00010000:0.0:1746127004.003105:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 31 pid: 13448 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.003110:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991661440:12345-192.168.203.42@tcp:3:cat.0 Request processed in 44509us (44579us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.003120:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8618 00000100:00100000:0.0:1746127004.003120:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10122 00000100:00100000:0.0:1746127004.003126:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991662080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746127004.003153:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009cc3dc00 x1830945991661440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.003161:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3dc00 with x1830945991661440 ext(0->1048575) 00010000:00010000:0.0:1746127004.003161:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746127004.003165:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3dc00 00010000:00010000:0.0:1746127004.003167:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 8 pid: 10958 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746127004.003181:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 8 pid: 10958 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.003190:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10123 00000100:00100000:2.0:1746127004.003197:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991662208:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.003203:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127004.003203:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d000/0x34dc807b6ef9cf1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531d8 expref: 8 pid: 10958 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.003207:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 31 pid: 13448 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.003215:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 31 pid: 13448 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746127004.003221:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127004.003225:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127004.003233:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127004.003240:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127004.003259:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2026:x1830945991662080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 133us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.003264:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10122 00010000:00010000:2.0:1746127004.003339:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03600/0x34dc807b6ef9da7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53225 expref: 31 pid: 13448 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.003354:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.003357:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127004.003362:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127004.003366:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.003396:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991662208:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 200us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.003401:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10123 00000100:00100000:0.0:1746127004.006072:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.006153:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662336 00000100:00100000:3.0:1746127004.006160:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662336 00000100:00100000:2.0:1746127004.006167:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994258944:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.006191:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 7 pid: 7258 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.006198:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:3.0:1746127004.006223:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10124 00000100:00100000:3.0:1746127004.006230:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2026:x1830945991662336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.006243:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127004.006248:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 7 pid: 7258 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.006257:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 7 pid: 7258 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.006277:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800994bc000/0x34dc807b6ef9cff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531df expref: 7 pid: 7258 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.006292:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127004.006296:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127004.006305:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127004.006311:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127004.006331:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127004.006368:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:2026:x1830945991662336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 138us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.006378:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10124 00010000:00010000:3.0:1746127004.006401:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127004.006406:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000040:00080000:3.0:1746127004.006663:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1389, 88 off129832 00000004:00080000:3.0:1746127004.006670:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048540150ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006742:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1409, 88 off131688 00000004:00080000:3.0:1746127004.006748:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048618673ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127004.006761:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1410, 88 off131776 00000004:00080000:3.0:1746127004.006765:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048635193ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127004.006773:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1390, 88 off129920 00000004:00080000:3.0:1746127004.006775:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048646015ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006782:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1391, 88 off130008 00000004:00080000:3.0:1746127004.006784:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048655085ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006791:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1411, 88 off131864 00000004:00080000:3.0:1746127004.006793:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048664192ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127004.006800:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1412, 88 off131952 00000004:00080000:3.0:1746127004.006802:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048673083ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127004.006809:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1413, 88 off132040 00000004:00080000:3.0:1746127004.006813:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048684060ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127004.006821:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1392, 88 off130096 00000004:00080000:3.0:1746127004.006823:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048693713ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006830:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1414, 88 off132128 00000004:00080000:3.0:1746127004.006832:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048702843ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127004.006839:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1393, 88 off130184 00000004:00080000:3.0:1746127004.006842:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048712457ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006848:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1415, 88 off132216 00000004:00080000:3.0:1746127004.006850:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048720990ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127004.006857:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1394, 88 off130272 00000004:00080000:3.0:1746127004.006859:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048729735ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006866:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1395, 88 off130360 00000004:00080000:3.0:1746127004.006868:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048738992ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006875:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1396, 88 off130448 00000004:00080000:3.0:1746127004.006878:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048748502ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006884:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1397, 88 off130536 00000004:00080000:3.0:1746127004.006886:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899048757233ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127004.006893:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1416, 88 off132304 00000004:00080000:3.0:1746127004.006895:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899048766087ns, next at 895431202182ns, rc = 0 00000100:00100000:1.0:1746127004.008261:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991659904:12345-192.168.203.42@tcp:3:cat.0 Request processed in 51906us (53757us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127004.008270:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8613 00002000:00100000:1.0:1746127004.008280:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88007ece7480 x1830945991659904/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:9/0 lens 488/440 e 0 to 0 dl 1746127014 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.008288:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece7480 with x1830945991659904 ext(0->1048575) 00002000:00010000:1.0:1746127004.008294:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece7480 00000001:00080000:3.0:1746127004.008780:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938211 is committed 00000004:00080000:3.0:1746127004.008786:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1390 committed 00000004:00080000:3.0:1746127004.008796:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1372 committed 00000004:00080000:3.0:1746127004.008807:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1371 committed 00000004:00080000:3.0:1746127004.008809:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1370 committed 00000004:00080000:3.0:1746127004.008811:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1369 committed 00000004:00080000:3.0:1746127004.008812:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1389 committed 00000004:00080000:3.0:1746127004.008813:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1368 committed 00000004:00080000:3.0:1746127004.008815:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1388 committed 00000004:00080000:3.0:1746127004.008816:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1367 committed 00000004:00080000:3.0:1746127004.008818:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1387 committed 00000004:00080000:3.0:1746127004.008819:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1386 committed 00000004:00080000:3.0:1746127004.008821:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1385 committed 00000004:00080000:3.0:1746127004.008823:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1366 committed 00000004:00080000:3.0:1746127004.008824:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1365 committed 00000004:00080000:3.0:1746127004.008826:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1384 committed 00000004:00080000:3.0:1746127004.008827:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1383 committed 00000004:00080000:3.0:1746127004.008829:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1364 committed 00000001:00080000:3.0:1746127004.008841:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938209 is committed 00000100:00100000:3.0:1746127004.008877:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127004.008916:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746127004.008927:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.008938:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.008940:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746127004.008952:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158e00/0x34dc807b6ef9e10 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 10 pid: 10958 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746127004.008963:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259200 00010000:00010000:2.0:1746127004.008966:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.008968:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259200 00010000:00010000:2.0:1746127004.008992:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.008994:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746127004.008997:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159400, rc 0) 00000100:00100000:3.0:1746127004.009000:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21641 00000100:00100000:3.0:1746127004.009006:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3782:x1830945994259200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127004.009020:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4291:x1830945991661952:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 14154us (14318us total) trans 8589938211 rc 0/0 00000100:00100000:2.0:1746127004.009026:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17277 00000100:00080000:2.0:1746127004.009109:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746127004.009126:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994259072:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127004.009142:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127004.009145:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127002 -> 1746127002 00002000:00010000:3.0:1746127004.009147:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127002 -> 1746127002 00002000:00010000:3.0:1746127004.009148:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127002 -> 1746127002 00002000:00010000:3.0:1746127004.009150:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746127004.009161:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127004.009168:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994259200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (253us total) trans 17179875599 rc 0/0 00000100:00100000:3.0:1746127004.009174:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21641 00000100:00100000:2.0:1746127004.009179:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259072 00000100:00100000:2.0:1746127004.009182:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259072 00000100:00100000:2.0:1746127004.009196:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21642 00000004:00080000:3.0:1746127004.009200:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd6680/2, rc 0, transno 17179875599 00000100:00100000:2.0:1746127004.009200:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3785:x1830945994259072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127004.009204:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259200:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127004.009249:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127004.009252:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127002 -> 1746127002 00002000:00010000:2.0:1746127004.009254:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127002 -> 1746127002 00002000:00010000:2.0:1746127004.009255:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127002 -> 1746127002 00002000:00010000:2.0:1746127004.009257:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746127004.009277:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3785:x1830945994259072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (116us total) trans 17179875600 rc 0/0 00000100:00100000:2.0:1746127004.009283:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21642 00000100:00100000:2.0:1746127004.009299:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994259584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127004.009313:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.009316:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746127004.009332:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd4a80/2, rc 0, transno 17179875600 00000100:00100000:1.0:1746127004.009332:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.009335:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994259072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127004.009341:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994260096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127004.009341:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994260224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127004.009353:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.009357:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259584 00000100:00100000:2.0:1746127004.009359:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259584 00000100:00100000:1.0:1746127004.009364:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746127004.009368:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.009374:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259712 00000100:00100000:2.0:1746127004.009376:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259712 00000100:00100000:1.0:1746127004.009382:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.009387:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260224 00000100:00100000:2.0:1746127004.009389:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260224 00000100:00100000:1.0:1746127004.009392:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.009397:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259328 00000100:00100000:2.0:1746127004.009399:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259328 00000100:00100000:1.0:1746127004.009405:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.009410:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259840 00000100:00100000:2.0:1746127004.009411:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259840 00000100:00100000:2.0:1746127004.009421:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21643 00000100:00100000:1.0:1746127004.009424:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21644 00000100:00100000:2.0:1746127004.009425:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3785:x1830945994259584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127004.009428:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3782:x1830945994259712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.009471:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21645 00000100:00100000:2.0:1746127004.009475:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994260224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127004.009478:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746127004.009480:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127004.009482:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127004.009483:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127004.009485:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:1.0:1746127004.009504:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994259712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (171us total) trans 21474842862 rc 0/0 00000100:00100000:1.0:1746127004.009509:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21644 00002000:00010000:2.0:1746127004.009516:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00000100:00100000:1.0:1746127004.009518:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21646 00002000:00010000:2.0:1746127004.009519:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127004.009521:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127004.009522:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00000100:00100000:1.0:1746127004.009522:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994259328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127004.009524:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:2.0:1746127004.009540:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994260224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (186us total) trans 21474842864 rc 0/0 00000100:00100000:2.0:1746127004.009545:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21645 00000100:00100000:2.0:1746127004.009553:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21647 00002000:00010000:1.0:1746127004.009553:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746127004.009555:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127002 -> 1746127002 00000100:00100000:2.0:1746127004.009557:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994259840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127004.009557:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127001 -> 1746127001 00002000:00010000:1.0:1746127004.009560:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127002 -> 1746127002 00002000:00010000:1.0:1746127004.009562:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:1.0:1746127004.009576:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994259328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (193us total) trans 21474842865 rc 0/0 00000100:00100000:1.0:1746127004.009581:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21646 00000004:00080000:1.0:1746127004.009603:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3f480/2, rc 0, transno 21474842865 00000100:00100000:1.0:1746127004.009609:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127004.009705:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994259456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.009838:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3782:x1830945994259840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (431us total) trans 21474842866 rc 0/0 00000004:00080000:1.0:1746127004.009840:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3ce00/2, rc 0, transno 21474842866 00000100:00100000:2.0:1746127004.009843:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21647 00000100:00100000:1.0:1746127004.009843:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259840:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127004.009849:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3d180/2, rc 0, transno 21474842862 00000100:00100000:1.0:1746127004.009852:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994259712:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127004.009857:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3ca80/2, rc 0, transno 21474842864 00000100:00100000:1.0:1746127004.009860:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994260224:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746127004.009864:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746127004.009870:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.009886:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260096 00000100:00100000:2.0:1746127004.009889:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260096 00002000:00010000:1.0:1746127004.009895:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:1.0:1746127004.009897:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127001 -> 1746127001 00002000:00010000:1.0:1746127004.009899:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127001 -> 1746127001 00000100:00100000:2.0:1746127004.009900:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21648 00002000:00010000:1.0:1746127004.009901:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127001 -> 1746127001 00002000:00010000:1.0:1746127004.009903:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:2.0:1746127004.009904:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3785:x1830945994260096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127004.009923:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3785:x1830945994259584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 498us (606us total) trans 21474842863 rc 0/0 00000100:00100000:1.0:1746127004.009928:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21643 00002000:00010000:2.0:1746127004.009940:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746127004.009942:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127004.009944:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127004.009945:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127004.009947:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:2.0:1746127004.009963:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3785:x1830945994260096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (91us total) trans 21474842867 rc 0/0 00000100:00100000:2.0:1746127004.009968:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21648 00000100:00100000:3.0:1746127004.009980:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746127004.009985:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3c380/2, rc 0, transno 21474842867 00000100:00100000:2.0:1746127004.009989:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994260096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127004.009991:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994259968:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127004.009995:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3c000/2, rc 0, transno 21474842863 00000100:00100000:2.0:1746127004.009997:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994259584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.010006:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259456 00000100:00100000:2.0:1746127004.010009:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259456 00000100:00100000:2.0:1746127004.010023:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21649 00000100:00100000:2.0:1746127004.010027:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3784:x1830945994259456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127004.010074:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127004.010076:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127001 -> 1746127001 00002000:00010000:2.0:1746127004.010078:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127001 -> 1746127001 00002000:00010000:2.0:1746127004.010079:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127001 -> 1746127001 00002000:00010000:2.0:1746127004.010081:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746127004.010097:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3784:x1830945994259456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (117us total) trans 21474842868 rc 0/0 00000100:00100000:2.0:1746127004.010102:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21649 00000100:00100000:3.0:1746127004.010342:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127004.010345:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746127004.010353:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994260352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127004.010356:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994260480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127004.010371:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127004.010386:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994259968 00000100:00100000:0.0:1746127004.010389:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994259968 00000004:00080000:3.0:1746127004.010655:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3e300/2, rc 0, transno 21474842868 00000100:00100000:3.0:1746127004.010659:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994259456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127004.010664:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746127004.010668:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994260608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127004.010684:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.010692:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994261120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127004.011572:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260480 00000100:00100000:3.0:1746127004.011576:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994260992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127004.011576:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260480 00000100:00100000:0.0:1746127004.011591:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260608 00000100:00100000:0.0:1746127004.011593:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260608 00000100:00100000:3.0:1746127004.011595:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127004.011603:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260992 00000100:00100000:0.0:1746127004.011604:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260992 00000100:00100000:0.0:1746127004.011614:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21650 00000100:00100000:3.0:1746127004.011618:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21651 00000100:00100000:0.0:1746127004.011619:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3784:x1830945994259968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127004.011623:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3784:x1830945994260480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127004.011676:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127004.011678:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127002 -> 1746127002 00002000:00010000:3.0:1746127004.011680:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127001 -> 1746127001 00002000:00010000:3.0:1746127004.011682:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127002 -> 1746127002 00002000:00010000:3.0:1746127004.011683:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746127004.011692:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3784:x1830945994259968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1350us total) trans 21474842869 rc 0/0 00000100:00100000:3.0:1746127004.011698:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3784:x1830945994260480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1326us total) trans 17179875601 rc 0/0 00000100:00100000:0.0:1746127004.011698:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21650 00000100:00100000:3.0:1746127004.011702:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21651 00000100:00100000:0.0:1746127004.011707:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21652 00000100:00100000:3.0:1746127004.011709:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21653 00000100:00100000:0.0:1746127004.011711:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3784:x1830945994260608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127004.011713:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3784:x1830945994260992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127004.011746:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994260864:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127004.011751:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127004.011753:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127004.011755:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:0.0:1746127004.011756:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127004.011759:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127004.011764:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127004.011773:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3784:x1830945994260608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1088us total) trans 17179875603 rc 0/0 00000100:00100000:0.0:1746127004.011777:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21652 00000100:00100000:3.0:1746127004.011778:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746127004.011781:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994260736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127004.011784:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260864 00000100:00100000:0.0:1746127004.011786:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260864 00000100:00100000:3.0:1746127004.011794:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.011813:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260736 00000100:00100000:2.0:1746127004.011816:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260736 00000100:00100000:2.0:1746127004.011830:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21654 00000100:00100000:2.0:1746127004.011833:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3783:x1830945994260864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127004.011874:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:2.0:1746127004.011876:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127004.011878:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127004.011880:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127004.011881:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:2.0:1746127004.011901:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3783:x1830945994260864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (136us total) trans 17179875604 rc 0/0 00000100:00100000:2.0:1746127004.011906:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21654 00000100:00100000:2.0:1746127004.011914:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21655 00000100:00100000:2.0:1746127004.011917:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3783:x1830945994260736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127004.011963:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3783:x1830945994260736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (167us total) trans 17179875605 rc 0/0 00000100:00100000:2.0:1746127004.011967:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21655 00000100:00100000:2.0:1746127004.011984:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.012001:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994261120 00000100:00100000:2.0:1746127004.012003:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994261120 00000100:00100000:2.0:1746127004.012013:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21656 00000100:00100000:2.0:1746127004.012017:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3785:x1830945994261120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127004.012080:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3785:x1830945994261120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (95us total) trans 17179875606 rc 0/0 00000100:00100000:2.0:1746127004.012085:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21656 00000004:00080000:2.0:1746127004.012104:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e3800/2, rc 0, transno 17179875606 00000100:00100000:2.0:1746127004.012108:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994261120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127004.012151:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd64a80/2, rc 0, transno 17179875603 00000100:00100000:2.0:1746127004.012154:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994260608:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127004.012160:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd4e00/2, rc 0, transno 17179875601 00000100:00100000:2.0:1746127004.012161:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994260480:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127004.012168:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3df80/2, rc 0, transno 21474842869 00000100:00100000:2.0:1746127004.012171:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994259968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.012190:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.012210:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994260352 00000100:00100000:2.0:1746127004.012213:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994260352 00000100:00100000:2.0:1746127004.012226:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21657 00000100:00100000:2.0:1746127004.012230:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3782:x1830945994260352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127004.012285:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3782:x1830945994260352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (93us total) trans 21474842870 rc 0/0 00000100:00100000:2.0:1746127004.012289:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21657 00000004:00080000:2.0:1746127004.012305:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c748380/2, rc 0, transno 21474842870 00000100:00100000:2.0:1746127004.012308:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994260352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127004.012837:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3784:x1830945994260992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1123us (1241us total) trans 17179875602 rc 0/0 00000100:00100000:3.0:1746127004.012843:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21653 00000004:00080000:3.0:1746127004.012862:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd65c00/2, rc 0, transno 17179875605 00000100:00100000:3.0:1746127004.012865:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994260736:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127004.012871:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e1880/2, rc 0, transno 17179875604 00000100:00100000:3.0:1746127004.012873:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994260864:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127004.012927:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e2300/2, rc 0, transno 17179875602 00000100:00100000:2.0:1746127004.012930:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994260992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127004.019811:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.019916:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662464 00000100:00100000:3.0:1746127004.019926:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662464 00000100:00100000:3.0:1746127004.019986:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21658 00000100:00100000:3.0:1746127004.019993:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4291:x1830945991662464:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127004.020095:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.020115:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5328e expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.020260:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.020269:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 27 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.020275:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 38 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.020281:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.020282:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.020285:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3485696->4194303] (req 3485696->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.020326:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 38 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.020337:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 38 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.020350:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994261248:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.020459:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 27 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.020597:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 27 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.020607:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994261376:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.020642:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.020650:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 14 pid: 9612 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.020657:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994261504:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127004.020677:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.021059:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.021463:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662592 00000100:00100000:3.0:1746127004.021469:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662592 00000100:00100000:3.0:1746127004.021499:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17278 00000100:00100000:3.0:1746127004.021505:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4296:x1830945991662592:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127004.021517:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.021529:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53295 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.021576:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 28 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.021587:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 28 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.021603:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127004.021606:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127004.021609:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098672600, rc 0) 00000100:00100000:3.0:1746127004.021647:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4296:x1830945991662592:12345-192.168.203.42@tcp:101:cat.0 Request processed in 140us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.021653:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17278 00000100:00100000:3.0:1746127004.022817:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994261248:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.023010:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.023095:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662720 00000100:00100000:3.0:1746127004.023099:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662720 00010000:00010000:3.0:1746127004.023157:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 39 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.023175:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10125 00000100:00100000:3.0:1746127004.023181:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991662720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.023189:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127004.023204:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 39 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.023214:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 39 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.023233:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b22c00/0x34dc807b6ef9dd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5324f expref: 39 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.023248:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127004.023280:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991662720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.023286:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10125 00000100:00080000:2.0:1746127004.023362:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746127004.024830:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994261376:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127004.024839:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994261504:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.024869:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3485696->4194303] (req 3485696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.024880:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc34a00, rc 0) 00000100:00100000:3.0:1746127004.025601:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4291:x1830945991662464:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5607us (5797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.025608:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21658 00000100:00100000:0.0:1746127004.025759:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.025806:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662976 00000100:00100000:2.0:1746127004.025812:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662976 00010000:00010000:2.0:1746127004.025856:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 15 pid: 9612 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.025877:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10126 00000100:00100000:2.0:1746127004.025883:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991662976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.025893:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.025912:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 15 pid: 9612 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.025921:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 15 pid: 9612 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.025940:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6ef9d1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53202 expref: 15 pid: 9612 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.025959:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.025981:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991662976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.025986:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10126 00000100:00080000:3.0:1746127004.026158:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746127004.026269:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.026407:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991662848 00000100:00100000:2.0:1746127004.026410:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991662848 00010000:00010000:2.0:1746127004.026422:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 27 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.026438:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10127 00000100:00100000:2.0:1746127004.026443:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991662848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.026449:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.026456:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 27 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.026464:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 27 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.026476:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4be800/0x34dc807b6ef9e02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53279 expref: 27 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.026489:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.026490:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.026496:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.026509:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.026538:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.026550:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994261632:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.026610:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.027056:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.027182:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.027374:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.027529:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991663232 00000100:00100000:1.0:1746127004.027533:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991663232 00002000:00100000:1.0:1746127004.027564:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c5e0700 x1830945991663232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.027578:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0700 with x1830945991663232 ext(1048576->2097151) 00002000:00010000:1.0:1746127004.027583:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e0700 00000100:00100000:3.0:1746127004.027823:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991663488 00000100:00100000:3.0:1746127004.027826:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991663488 00002000:00100000:3.0:1746127004.027843:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009c5e2a00 x1830945991663488/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.027855:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2a00 with x1830945991663488 ext(1048576->2097151) 00002000:00010000:3.0:1746127004.027859:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e2a00 00000100:00100000:1.0:1746127004.027919:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991663744 00000100:00100000:1.0:1746127004.027922:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991663744 00002000:00100000:1.0:1746127004.027936:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012cc9c000 x1830945991663744/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.027942:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c000 with x1830945991663744 ext(1048576->2097151) 00002000:00010000:1.0:1746127004.027944:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9c000 00000100:00100000:3.0:1746127004.028433:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8620 00000100:00100000:3.0:1746127004.028441:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991663232:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.029177:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8621 00000100:00100000:2.0:1746127004.029185:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991663488:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.030401:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8622 00000100:00100000:1.0:1746127004.030410:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991663744:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.031094:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.031117:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991663872 00000100:00100000:1.0:1746127004.031122:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991663872 00000100:00100000:1.0:1746127004.031181:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21659 00000100:00100000:1.0:1746127004.031186:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4293:x1830945991663872:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127004.031196:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.031213:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5329c expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.031239:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 17 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.031246:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 31 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.031259:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.031266:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.031268:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.031272:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1208320->1933311] (req 1208320->1933311) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 49 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.031302:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.031313:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.031325:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994261760:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127004.031386:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 31 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.031393:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 31 pid: 12340 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.031399:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994261888:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127004.031422:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 17 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.031434:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 17 pid: 11152 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.031441:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262016:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.031457:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127004.032386:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994261632:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127004.032406:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127004.032430:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991662848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5985us (6160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.032439:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10127 00000100:00100000:1.0:1746127004.032512:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.032527:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991664128 00000100:00100000:1.0:1746127004.032530:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991664128 00002000:00100000:1.0:1746127004.032553:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (3485696->3489791) req@ffff88009c74b480 x1830945991664128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.032561:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74b480 with x1830945991664128 ext(3485696->3489791) 00002000:00010000:1.0:1746127004.032564:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c74b480 00000100:00080000:3.0:1746127004.034381:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746127004.037543:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8623 00000100:00100000:3.0:1746127004.037559:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991664128:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127004.037724:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991664128:12345-192.168.203.42@tcp:3:cat.0 Request processed in 171us (5212us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127004.037730:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8623 00002000:00100000:3.0:1746127004.037738:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3485696->3489791) req@ffff88009c74b480 x1830945991664128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.037747:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74b480 with x1830945991664128 ext(3485696->3489791) 00002000:00010000:3.0:1746127004.037753:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c74b480 00000100:00100000:0.0:1746127004.039978:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.040012:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.040034:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.040067:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991664384 00000100:00100000:0.0:1746127004.040075:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991664384 00002000:00100000:0.0:1746127004.040108:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd6300 x1830945991664384/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.040117:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd6300 with x1830945991664384 ext(1048576->2097151) 00010000:00010000:0.0:1746127004.040126:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 50 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:0.0:1746127004.040165:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 50 pid: 3542 timeout: 999 lvb_type: 1 00002000:00010000:0.0:1746127004.040172:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007edd6300 00000100:00100000:0.0:1746127004.040189:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991664640 00000100:00100000:0.0:1746127004.040191:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991664640 00002000:00100000:0.0:1746127004.040202:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007edd5c00 x1830945991664640/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.040210:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5c00 with x1830945991664640 ext(1048576->2097151) 00002000:00010000:0.0:1746127004.040213:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5c00 00000100:00100000:0.0:1746127004.040228:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991664896 00000100:00100000:0.0:1746127004.040230:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991664896 00002000:00100000:0.0:1746127004.040242:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012ced5880 x1830945991664896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.040248:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5880 with x1830945991664896 ext(1048576->2097151) 00002000:00010000:0.0:1746127004.040251:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced5880 00000100:00100000:0.0:1746127004.040262:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1900 00000100:00100000:0.0:1746127004.040269:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2029:x1830945991664384:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127004.040610:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8624 00000100:00100000:2.0:1746127004.040617:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2029:x1830945991664640:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127004.041330:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8625 00000100:00100000:1.0:1746127004.041338:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991664896:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127004.043327:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991663744:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12911us (15944us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127004.043337:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8622 00002000:00100000:1.0:1746127004.043346:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012cc9c000 x1830945991663744/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.043355:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c000 with x1830945991663744 ext(1048576->2097151) 00002000:00010000:1.0:1746127004.043360:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9c000 00000100:00100000:1.0:1746127004.045123:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994261760:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.048210:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994261888:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.048224:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262016:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.048259:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1208320->1933311] (req 1208320->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 53 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.048277:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e88f200, rc 0) 00000100:00100000:0.0:1746127004.048720:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.048856:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991665024 00000100:00100000:1.0:1746127004.048863:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991665024 00000100:00100000:2.0:1746127004.048879:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:4293:x1830945991663872:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 17691us (17784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.048888:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21659 00010000:00010000:1.0:1746127004.048893:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 18 pid: 11152 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.048913:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10128 00000100:00100000:1.0:1746127004.048918:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2028:x1830945991665024:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127004.048930:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127004.048946:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 18 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.048955:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 18 pid: 11152 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.048977:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991663488:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19794us (21795us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746127004.048978:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6ef9d22 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531ed expref: 18 pid: 11152 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.048985:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8621 00002000:00100000:2.0:1746127004.048993:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009c5e2a00 x1830945991663488/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746127004.048994:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746127004.049002:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2a00 with x1830945991663488 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.049005:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e2a00 00000100:00100000:1.0:1746127004.049023:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2028:x1830945991665024:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 104us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.049028:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10128 00000100:00100000:3.0:1746127004.052664:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991663232:12345-192.168.203.42@tcp:3:cat.0 Request processed in 24213us (25606us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.052676:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8620 00002000:00100000:3.0:1746127004.052687:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c5e0700 x1830945991663232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.052696:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e0700 with x1830945991663232 ext(1048576->2097151) 00010000:00010000:3.0:1746127004.052705:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.052722:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 999 lvb_type: 1 00002000:00010000:3.0:1746127004.052730:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e0700 00000100:00100000:2.0:1746127004.058285:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2029:x1830945991664640:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 17657us (18259us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.058298:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8624 00002000:00100000:2.0:1746127004.058310:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007edd5c00 x1830945991664640/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.058320:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5c00 with x1830945991664640 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.058326:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5c00 00000100:00100000:0.0:1746127004.063410:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.063994:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991664896:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 22654us (23955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127004.064007:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8625 00002000:00100000:1.0:1746127004.064018:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012ced5880 x1830945991664896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.064028:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5880 with x1830945991664896 ext(1048576->2097151) 00002000:00010000:1.0:1746127004.064034:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced5880 00000100:00100000:2.0:1746127004.064148:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991665152 00000100:00100000:2.0:1746127004.064156:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991665152 00010000:00010000:2.0:1746127004.064187:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.064210:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10129 00000100:00100000:2.0:1746127004.064217:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991665152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.064228:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.064246:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.064256:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.064279:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8600/0x34dc807b6ef9ded lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53264 expref: 28 pid: 12340 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.064299:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.064318:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991665152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 101us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.064323:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10129 00000100:00100000:0.0:1746127004.067562:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.067721:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991665536 00000100:00100000:1.0:1746127004.067732:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991665536 00002000:00100000:1.0:1746127004.067774:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3485695) req@ffff88012ced6d80 x1830945991665536/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.067783:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6d80 with x1830945991665536 ext(2097152->3485695) 00002000:00010000:1.0:1746127004.067788:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced6d80 00000100:00100000:0.0:1746127004.067791:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.067873:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2029:x1830945991664384:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 27603us (27900us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.067882:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1900 00002000:00100000:2.0:1746127004.067888:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd6300 x1830945991664384/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.067895:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd6300 with x1830945991664384 ext(1048576->2097151) 00010000:00010000:2.0:1746127004.067902:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.067916:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 999 lvb_type: 1 00002000:00010000:2.0:1746127004.067922:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007edd6300 00000100:00100000:2.0:1746127004.067938:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991665664 00000100:00100000:2.0:1746127004.067942:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991665664 00002000:00100000:2.0:1746127004.067956:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012ced6300 x1830945991665664/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.067962:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6300 with x1830945991665664 ext(2097152->3145727) 00002000:00010000:2.0:1746127004.067964:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced6300 00000100:00100000:1.0:1746127004.068020:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8626 00000100:00100000:1.0:1746127004.068027:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991665536:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.068114:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8627 00000100:00100000:2.0:1746127004.068120:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991665664:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.068552:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.068596:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991665792 00000100:00100000:3.0:1746127004.068600:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991665792 00000100:00100000:3.0:1746127004.068627:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21660 00000100:00100000:3.0:1746127004.068632:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4291:x1830945991665792:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127004.068640:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.068655:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532a3 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.068677:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.068684:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 29 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.068690:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.068696:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.068698:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.068701:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 30 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.068734:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.068744:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 48 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.068754:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262144:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.069524:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 30 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.069533:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 30 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.069541:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262272:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.069567:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 16 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.069574:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 16 pid: 9612 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.069581:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262400:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127004.069594:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.076659:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.076752:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991665920 00000100:00100000:1.0:1746127004.076770:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991665920 00010000:00010000:1.0:1746127004.076811:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.076863:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10130 00000100:00100000:1.0:1746127004.076870:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991665920:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127004.076884:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127004.076904:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.076921:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.076945:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6ef9db5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5323a expref: 49 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.076965:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.076967:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.076974:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.076983:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.077015:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 48 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.077027:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994262528:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127004.077172:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.077255:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991665664:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9133us (9462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.077264:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8627 00002000:00100000:2.0:1746127004.077272:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012ced6300 x1830945991665664/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.077280:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6300 with x1830945991665664 ext(2097152->3145727) 00010000:00010000:2.0:1746127004.077287:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 29 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.077296:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 29 pid: 3542 timeout: 999 lvb_type: 1 00002000:00010000:2.0:1746127004.077302:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ced6300 00000100:00100000:0.0:1746127004.081770:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.081799:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262144:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.081809:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.081837:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.081851:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.081877:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991666176 00000100:00100000:0.0:1746127004.081883:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991666176 00000100:00100000:0.0:1746127004.081922:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991666304 00000100:00100000:0.0:1746127004.081925:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991666304 00000100:00100000:0.0:1746127004.081936:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991666432 00000100:00100000:0.0:1746127004.081938:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991666432 00000100:00100000:0.0:1746127004.081965:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21661 00000100:00100000:0.0:1746127004.081972:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991666176:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:3.0:1746127004.081983:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21662 00010000:00010000:0.0:1746127004.081990:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127004.081991:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991666304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127004.082001:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.082008:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012158ca00/0x34dc807b6ef9e3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532aa expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.082013:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21663 00010000:00010000:3.0:1746127004.082014:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc35e00/0x34dc807b6ef9e41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532b1 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.082029:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2027:x1830945991666432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.082057:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127004.082069:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ece6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994262784:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127004.082069:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994262656:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127004.082074:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012341b600/0x34dc807b6ef9e48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532b8 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.082100:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.082109:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012341b600/0x34dc807b6ef9e48 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532b8 expref: 52 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.082118:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012341b600/0x34dc807b6ef9e48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532b8 expref: 52 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127004.082124:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991666048 00000100:00100000:2.0:1746127004.082149:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991666048 00000100:00100000:3.0:1746127004.082155:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.082157:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1746127004.082165:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341b600, rc 0) 00010000:00010000:2.0:1746127004.082168:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 52 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.082188:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10131 00000100:00100000:2.0:1746127004.082195:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2027:x1830945991666048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.082203:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127004.082208:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2027:x1830945991666432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 184us (354us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127004.082214:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21663 00000100:00100000:3.0:1746127004.082219:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262400:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.082222:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 52 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.082232:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 51 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746127004.082248:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127004.082249:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085b23c00/0x34dc807b6ef9ddf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53256 expref: 51 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.082260:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991666560 00000100:00100000:3.0:1746127004.082263:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991666560 00010000:00010000:3.0:1746127004.082277:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 17 pid: 9612 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.082305:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10132 00000100:00100000:3.0:1746127004.082311:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991666560:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.082319:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127004.082327:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 17 pid: 9612 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.082335:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 17 pid: 9612 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.082348:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6d400/0x34dc807b6ef9d30 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53209 expref: 17 pid: 9612 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746127004.082366:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127004.082367:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127004.082381:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127004.082384:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994262528:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127004.082390:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991666560:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.082397:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10132 00010000:00010000:1.0:1746127004.082398:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.082401:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991666048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 206us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.082408:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10131 00000100:00100000:1.0:1746127004.082418:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991665920:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5549us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.082425:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10130 00000100:00100000:2.0:1746127004.082430:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991666816 00000100:00100000:2.0:1746127004.082433:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991666816 00002000:00100000:2.0:1746127004.082455:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1208320->1212415) req@ffff88012ced4380 x1830945991666816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.082463:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4380 with x1830945991666816 ext(1208320->1212415) 00002000:00010000:2.0:1746127004.082467:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4380 00000100:00100000:2.0:1746127004.082481:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8628 00000100:00100000:2.0:1746127004.082485:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2027:x1830945991666816:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127004.082553:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991665536:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14526us (14998us total) trans 0 rc 1388544/1388544 00000100:00100000:1.0:1746127004.082561:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8626 00002000:00100000:1.0:1746127004.082568:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3485695) req@ffff88012ced6d80 x1830945991665536/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1388544/1388544 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.082576:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6d80 with x1830945991665536 ext(2097152->3485695) 00002000:00010000:1.0:1746127004.082580:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced6d80 00000100:00100000:2.0:1746127004.082621:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2027:x1830945991666816:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 134us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127004.082630:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8628 00002000:00100000:2.0:1746127004.082635:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1208320->1212415) req@ffff88012ced4380 x1830945991666816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.082641:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4380 with x1830945991666816 ext(1208320->1212415) 00002000:00010000:2.0:1746127004.082644:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4380 00000100:00100000:3.0:1746127004.083327:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994262272:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.083362:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 28 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.083373:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673600, rc 0) 00000100:00100000:3.0:1746127004.083412:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4291:x1830945991665792:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 14780us (14861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.083419:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21660 00000100:00100000:0.0:1746127004.084233:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.084387:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991666944 00000100:00100000:1.0:1746127004.084393:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991666944 00010000:00010000:1.0:1746127004.084414:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 28 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.084447:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10133 00000100:00100000:1.0:1746127004.084452:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991666944:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127004.084462:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127004.084473:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 28 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.084483:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 28 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.084500:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e9a00/0x34dc807b6ef9e09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53280 expref: 28 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.084512:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.084514:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.084520:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.084528:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.084562:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.084572:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994262912:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127004.084637:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00002000:00010000:3.0:1746127004.084928:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127001 -> 1746127002 00002000:00010000:3.0:1746127004.084931:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127001 -> 1746127002 00002000:00010000:3.0:1746127004.084933:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127001 -> 1746127002 00000100:00100000:3.0:1746127004.084945:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ece6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994262784:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127004.084967:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc35e00/0x34dc807b6ef9e41 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532b1 expref: 39 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.084976:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc35e00/0x34dc807b6ef9e41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532b1 expref: 39 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.084984:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc35e00, rc 0) 00000100:00100000:3.0:1746127004.085007:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991666304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3018us (3169us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127004.085014:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21662 00000100:00100000:2.0:1746127004.085180:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994262656:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127004.085201:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012158ca00/0x34dc807b6ef9e3a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532aa expref: 48 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.085210:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012158ca00/0x34dc807b6ef9e3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532aa expref: 48 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.085218:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012158ca00, rc 0) 00000100:00100000:2.0:1746127004.085239:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991666176:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3268us (3429us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127004.085245:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21661 00000100:00100000:1.0:1746127004.089075:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994262912:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127004.089095:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127004.089168:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2026:x1830945991666944:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4714us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.089180:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10133 00000100:00100000:0.0:1746127004.092036:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.092085:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.092156:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.092209:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991667584 00000100:00100000:3.0:1746127004.092211:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991667328 00000100:00100000:3.0:1746127004.092217:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991667328 00000100:00100000:1.0:1746127004.092217:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991667584 00000100:00100000:2.0:1746127004.092218:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991667456 00000100:00100000:2.0:1746127004.092221:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991667456 00000100:00100000:1.0:1746127004.092258:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21664 00002000:00100000:2.0:1746127004.092260:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88012ced4e00 x1830945991667456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.092263:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1929216->1933311) req@ffff88012ced4000 x1830945991667328/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746127004.092265:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4296:x1830945991667584:12345-192.168.203.42@tcp:101:cat.0 00002000:00100000:2.0:1746127004.092269:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4e00 with x1830945991667456 ext(3145728->4194303) 00002000:00100000:3.0:1746127004.092270:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4000 with x1830945991667328 ext(1929216->1933311) 00002000:00010000:3.0:1746127004.092274:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4000 00002000:00010000:2.0:1746127004.092274:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4e00 00010000:00010000:1.0:1746127004.092278:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.092294:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532bf expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.092320:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.092327:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.092329:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746127004.092333:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8629 00010000:00010000:1.0:1746127004.092333:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 39 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.092339:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991667328:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:1.0:1746127004.092359:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.092368:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 25 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.092384:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994263040:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.092395:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8630 00000100:00100000:2.0:1746127004.092400:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991667456:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.092443:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.092448:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991667328:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 109us (419us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127004.092453:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8629 00002000:00100000:3.0:1746127004.092462:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1929216->1933311) req@ffff88012ced4000 x1830945991667328/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.092468:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4000 with x1830945991667328 ext(1929216->1933311) 00002000:00010000:3.0:1746127004.092470:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4000 00000100:00100000:0.0:1746127004.095372:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.095434:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.095456:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991667840 00000100:00100000:0.0:1746127004.095464:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991667840 00002000:00100000:0.0:1746127004.095509:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012ced4a80 x1830945991667840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.095519:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4a80 with x1830945991667840 ext(2097152->3145727) 00002000:00010000:0.0:1746127004.095524:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4a80 00000100:00100000:1.0:1746127004.095528:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994263040:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.095547:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991667968 00000100:00100000:0.0:1746127004.095549:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991667968 00010000:00010000:1.0:1746127004.095556:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 39 pid: 9612 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746127004.095563:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3485696->4194303) req@ffff88012ced4700 x1830945991667968/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.095569:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4700 with x1830945991667968 ext(3485696->4194303) 00010000:00010000:1.0:1746127004.095572:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341ac00, rc 0) 00010000:00010000:0.0:1746127004.095575:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 26 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746127004.095586:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 26 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:0.0:1746127004.095592:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ced4700 00000100:00100000:0.0:1746127004.095604:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1901 00000100:00100000:1.0:1746127004.095610:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4296:x1830945991667584:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3344us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.095610:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991667968:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127004.095618:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21664 00000100:00100000:2.0:1746127004.095835:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8631 00000100:00100000:2.0:1746127004.095851:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991667840:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.097762:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.097988:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991668224 00000100:00100000:2.0:1746127004.097996:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991668224 00000100:00100000:2.0:1746127004.098040:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6578 00000100:00100000:2.0:1746127004.098058:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4293:x1830945991668224:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127004.098240:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4293:x1830945991668224:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 193us (482us total) trans 8589938212 rc 0/0 00000100:00100000:2.0:1746127004.098247:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6578 00000100:00100000:3.0:1746127004.107082:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991667456:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14672us (14988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.107094:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8630 00002000:00100000:3.0:1746127004.107104:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88012ced4e00 x1830945991667456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.107113:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4e00 with x1830945991667456 ext(3145728->4194303) 00002000:00010000:3.0:1746127004.107169:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4e00 00000100:00100000:3.0:1746127004.108368:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991667840:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12521us (13003us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.108375:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8631 00002000:00100000:3.0:1746127004.108381:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012ced4a80 x1830945991667840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.108388:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4a80 with x1830945991667840 ext(2097152->3145727) 00002000:00010000:3.0:1746127004.108391:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4a80 00000100:00100000:2.0:1746127004.111270:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991667968:12345-192.168.203.42@tcp:4:cat.0 Request processed in 15647us (15823us total) trans 21474842871 rc 0/0 00000100:00100000:2.0:1746127004.111284:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1901 00002000:00100000:2.0:1746127004.111296:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3485696->4194303) req@ffff88012ced4700 x1830945991667968/t21474842871(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.111306:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4700 with x1830945991667968 ext(3485696->4194303) 00010000:00010000:2.0:1746127004.111316:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.111335:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746127004.111342:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ced4700 00000100:00100000:0.0:1746127004.114095:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.114309:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.114360:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991668608 00000100:00100000:1.0:1746127004.114369:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991668608 00000100:00100000:2.0:1746127004.114386:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991668480 00000100:00100000:2.0:1746127004.114390:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991668480 00000100:00100000:2.0:1746127004.114453:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6579 00000100:00100000:1.0:1746127004.114455:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21665 00000100:00100000:2.0:1746127004.114460:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4291:x1830945991668480:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127004.114462:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4299:x1830945991668608:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.114479:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.114548:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532c6 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.114574:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.114577:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.114582:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.114594:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.114609:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0e2600, rc 0) 00000100:00100000:3.0:1746127004.114652:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4291:x1830945991668480:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 191us (565us total) trans 8589938213 rc 0/0 00000100:00100000:1.0:1746127004.114652:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4299:x1830945991668608:12345-192.168.203.42@tcp:101:cat.0 Request processed in 192us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.114658:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6579 00000100:00100000:1.0:1746127004.114658:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21665 00000100:00100000:2.0:1746127004.120645:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.120763:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991668736 00000100:00100000:1.0:1746127004.120772:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991668736 00010000:00010000:1.0:1746127004.120810:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.120836:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10134 00000100:00100000:1.0:1746127004.120843:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991668736:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127004.120856:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127004.120875:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.120886:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.120909:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc34a00/0x34dc807b6ef9e1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3485696->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5328e expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.120940:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.120942:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.120950:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 38 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.120964:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 38 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.120971:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.120973:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.120975:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.120982:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.121011:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.121022:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994263168:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127004.121117:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 38 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.121124:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994263296:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127004.121165:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.125913:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.126064:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991669120 00000100:00100000:2.0:1746127004.126074:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991669120 00000100:00100000:1.0:1746127004.126105:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994263168:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127004.126117:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994263296:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127004.126166:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746127004.126222:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012153df80 x1830945991669120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.126232:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153df80 with x1830945991669120 ext(2097152->3145727) 00002000:00010000:2.0:1746127004.126237:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153df80 00000100:00100000:2.0:1746127004.126492:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8632 00000100:00100000:1.0:1746127004.126532:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991668736:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5687us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.126542:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10134 00000100:00100000:2.0:1746127004.126558:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991669120:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127004.127108:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.127151:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991669248 00000100:00100000:0.0:1746127004.127154:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991669248 00002000:00100000:0.0:1746127004.127178:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88007ece6680 x1830945991669248/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.127184:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6680 with x1830945991669248 ext(3145728->4194303) 00002000:00010000:0.0:1746127004.127187:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece6680 00000100:00100000:3.0:1746127004.127279:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8633 00000100:00100000:3.0:1746127004.127291:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991669248:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.136038:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991669120:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9469us (10123us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.136060:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8632 00002000:00100000:2.0:1746127004.136072:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012153df80 x1830945991669120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.136082:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153df80 with x1830945991669120 ext(2097152->3145727) 00002000:00010000:2.0:1746127004.136089:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153df80 00000100:00100000:3.0:1746127004.137505:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991669248:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10209us (10391us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.137516:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8633 00002000:00100000:3.0:1746127004.137527:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88007ece6680 x1830945991669248/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.137535:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6680 with x1830945991669248 ext(3145728->4194303) 00002000:00010000:3.0:1746127004.137540:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece6680 00000100:00100000:0.0:1746127004.143330:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.143603:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991669376 00000100:00100000:1.0:1746127004.143611:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991669376 00000100:00100000:1.0:1746127004.143656:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21666 00000100:00100000:1.0:1746127004.143664:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4296:x1830945991669376:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.143679:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.143691:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532cd expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.143716:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.143722:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.143724:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.143727:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 48 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.143749:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 26 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.143758:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 26 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.143768:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994263424:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.144229:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.145707:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.145731:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994263424:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.145748:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127004.145750:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 48 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.145764:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012158de00, rc 0) 00000100:00100000:1.0:1746127004.145792:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4296:x1830945991669376:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2129us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.145799:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21666 00000100:00100000:1.0:1746127004.145818:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991669632 00000100:00100000:1.0:1746127004.145821:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991669632 00000100:00100000:1.0:1746127004.145841:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21667 00000100:00100000:1.0:1746127004.145847:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991669632:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.145858:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.145867:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012158ca00/0x34dc807b6ef9e64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532d4 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.145901:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994263552:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127004.145943:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.146085:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991669504 00000100:00100000:3.0:1746127004.146089:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991669504 00002000:00100000:3.0:1746127004.146113:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3485695) req@ffff88012153e300 x1830945991669504/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.146154:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153e300 with x1830945991669504 ext(3145728->3485695) 00010000:00010000:3.0:1746127004.146161:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.146171:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.146182:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012153e300 00000100:00100000:3.0:1746127004.146196:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1902 00000100:00100000:3.0:1746127004.146201:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991669504:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127004.146991:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.147367:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991669760 00000100:00100000:2.0:1746127004.147372:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991669760 00000100:00100000:2.0:1746127004.147405:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21668 00000100:00100000:2.0:1746127004.147412:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2029:x1830945991669760:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.147422:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.147432:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb9d000/0x34dc807b6ef9e6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532db expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.147464:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994263680:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127004.147530:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127004.149354:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994263552:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127004.149380:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012158ca00/0x34dc807b6ef9e64 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532d4 expref: 32 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.149391:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012158ca00/0x34dc807b6ef9e64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532d4 expref: 32 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.149962:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012158ca00, rc 0) 00000100:00100000:1.0:1746127004.150009:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2028:x1830945991669632:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4161us (4258us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127004.150017:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21667 00002000:00010000:2.0:1746127004.150552:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127001 -> 1746127002 00000100:00100000:2.0:1746127004.150563:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994263680:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127004.150585:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9d000/0x34dc807b6ef9e6b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532db expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.150594:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9d000/0x34dc807b6ef9e6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532db expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.150605:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9d000, rc 0) 00000100:00100000:2.0:1746127004.150624:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991669760:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3213us (3636us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127004.150629:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21668 00000100:00100000:3.0:1746127004.152828:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991669504:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6616us (7114us total) trans 17179875607 rc 0/0 00000100:00100000:3.0:1746127004.152842:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1902 00002000:00100000:3.0:1746127004.152853:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3485695) req@ffff88012153e300 x1830945991669504/t17179875607(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.152863:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153e300 with x1830945991669504 ext(3145728->3485695) 00010000:00010000:3.0:1746127004.152872:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.152887:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.152894:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012153e300 00000100:00100000:0.0:1746127004.154619:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.154685:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991670016 00000100:00100000:3.0:1746127004.154695:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991670016 00002000:00100000:3.0:1746127004.154739:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012153f800 x1830945991670016/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.154749:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f800 with x1830945991670016 ext(4194304->4829183) 00002000:00010000:3.0:1746127004.154754:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153f800 00000100:00100000:3.0:1746127004.154779:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8634 00000100:00100000:3.0:1746127004.154786:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991670016:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.160068:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.160217:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991670144 00000100:00100000:1.0:1746127004.160226:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991670144 00010000:00010000:1.0:1746127004.160257:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746127004.160265:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991670016:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5478us (5659us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127004.160276:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8634 00002000:00100000:3.0:1746127004.160285:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012153f800 x1830945991670016/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127004.160292:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10135 00002000:00100000:3.0:1746127004.160294:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f800 with x1830945991670016 ext(4194304->4829183) 00002000:00010000:3.0:1746127004.160298:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153f800 00000100:00100000:1.0:1746127004.160298:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991670144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127004.160311:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127004.160330:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.160342:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.160365:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098673600/0x34dc807b6ef9e33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532a3 expref: 29 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.160393:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.160395:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.160403:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 47 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.160411:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 47 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.160503:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 47 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127004.160518:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994263808:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127004.160928:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127004.162693:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994263808:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127004.162713:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127004.162753:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991670144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2453us (2693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.162768:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10135 00000100:00100000:0.0:1746127004.163548:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.163728:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991670272 00000100:00100000:2.0:1746127004.163735:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991670272 00000100:00100000:2.0:1746127004.163782:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21669 00000100:00100000:0.0:1746127004.163784:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.163789:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991670272:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127004.163800:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991670400 00000100:00100000:0.0:1746127004.163804:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991670400 00010000:00010000:2.0:1746127004.163806:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.163822:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb9cc00/0x34dc807b6ef9e72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532e2 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127004.163822:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21670 00000100:00100000:0.0:1746127004.163827:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991670400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127004.163832:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.163838:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532e9 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.163871:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994263936:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127004.163938:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00010000:00010000:0.0:1746127004.164165:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.164167:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.164176:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 31 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.164191:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 31 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.164199:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e200, rc 0) 00000100:00100000:0.0:1746127004.164230:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2029:x1830945991670400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 402us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.164235:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21670 00000100:00100000:2.0:1746127004.166056:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994263936:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127004.166099:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9cc00/0x34dc807b6ef9e72 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e2 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.166112:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9cc00/0x34dc807b6ef9e72 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e2 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.166164:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9cc00, rc 0) 00000100:00100000:2.0:1746127004.166219:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991670272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2429us (2671us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127004.166226:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21669 00000100:00100000:0.0:1746127004.170295:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.170435:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.170485:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.170567:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991670784 00000100:00100000:1.0:1746127004.170567:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991670912 00000100:00100000:3.0:1746127004.170576:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991670784 00000100:00100000:1.0:1746127004.170576:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991670912 00002000:00100000:3.0:1746127004.170620:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012153f480 x1830945991670784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.170620:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012153ce00 x1830945991670912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.170630:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f480 with x1830945991670784 ext(2097152->4194303) 00002000:00100000:1.0:1746127004.170630:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153ce00 with x1830945991670912 ext(3145728->4194303) 00002000:00010000:3.0:1746127004.170635:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012153f480 00002000:00010000:1.0:1746127004.170635:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153ce00 00000100:00100000:1.0:1746127004.170652:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8635 00000100:00100000:1.0:1746127004.170658:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991670912:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.170842:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991671040 00000100:00100000:2.0:1746127004.170847:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991671040 00000100:00100000:2.0:1746127004.170870:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21671 00000100:00100000:2.0:1746127004.170876:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991671040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.170885:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.170902:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb9d800/0x34dc807b6ef9e80 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532f0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.170950:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994264064:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127004.171024:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.171326:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8636 00000100:00100000:3.0:1746127004.171332:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991670784:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.178634:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994264064:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127004.178671:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9d800/0x34dc807b6ef9e80 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532f0 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.178686:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9d800/0x34dc807b6ef9e80 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532f0 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.178713:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9d800, rc 0) 00000100:00100000:0.0:1746127004.178771:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991671040:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7894us (8284us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127004.178780:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21671 00000100:00100000:3.0:1746127004.185996:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991670784:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14651us (15548us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127004.186011:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8636 00002000:00100000:3.0:1746127004.186022:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012153f480 x1830945991670784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.186031:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153f480 with x1830945991670784 ext(2097152->4194303) 00002000:00010000:3.0:1746127004.186038:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012153f480 00000100:00100000:1.0:1746127004.186461:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991670912:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15801us (16174us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127004.186468:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8635 00002000:00100000:1.0:1746127004.186474:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012153ce00 x1830945991670912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.186481:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153ce00 with x1830945991670912 ext(3145728->4194303) 00002000:00010000:1.0:1746127004.186484:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153ce00 00000100:00100000:0.0:1746127004.193543:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.193639:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991671296 00000100:00100000:1.0:1746127004.193649:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991671296 00002000:00100000:1.0:1746127004.193982:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012153c700 x1830945991671296/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.193993:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153c700 with x1830945991671296 ext(4194304->4829183) 00002000:00010000:1.0:1746127004.193998:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153c700 00000100:00100000:1.0:1746127004.194039:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8637 00000100:00100000:1.0:1746127004.194077:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991671296:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.201943:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991671296:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7763us (8278us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127004.201957:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8637 00002000:00100000:1.0:1746127004.201968:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012153c700 x1830945991671296/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.201978:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153c700 with x1830945991671296 ext(4194304->4829183) 00002000:00010000:1.0:1746127004.201983:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153c700 00000100:00100000:0.0:1746127004.219399:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.219605:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991671552 00000100:00100000:2.0:1746127004.219616:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991671552 00000100:00100000:2.0:1746127004.219678:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17279 00000100:00100000:2.0:1746127004.219686:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4308:x1830945991671552:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127004.219716:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.219737:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef9e87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532f7 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.219829:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219842:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219853:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219865:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219871:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219875:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219984:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219992:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.219997:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127004.220005:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127004.220080:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220091:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220097:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220103:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.220111:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220117:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220165:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.220482:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127004.220488:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220493:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9e9c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220525:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220531:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220535:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220539:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f45a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.220542:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220550:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220557:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127004.220559:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.220562:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220566:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220574:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220578:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220583:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220586:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f45600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.220588:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220592:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220597:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e100) 00010000:00010000:2.0:1746127004.220599:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.220601:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220606:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9e95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.220641:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef9e87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532f7 expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.220648:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6ef9e87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532f7 expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.220657:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867fe00, rc 0) 00000100:00100000:2.0:1746127004.220730:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4308:x1830945991671552:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1044us (1341us total) trans 8589938214 rc 301/301 00000100:00100000:2.0:1746127004.220737:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17279 00000100:00100000:0.0:1746127004.229641:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.229712:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991671808 00000100:00100000:3.0:1746127004.229722:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991671808 00000100:00100000:3.0:1746127004.229773:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6580 00000100:00100000:3.0:1746127004.229781:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4308:x1830945991671808:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127004.230101:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4308:x1830945991671808:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 319us (469us total) trans 8589938215 rc 0/0 00000100:00100000:3.0:1746127004.230108:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6580 00000100:00100000:2.0:1746127004.270185:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994264192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746127004.270261:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.270870:0:9236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994264192 00000100:00100000:1.0:1746127004.270879:0:9236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994264192 00000100:00100000:1.0:1746127004.270930:0:9236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1746127004.270938:0:9236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3782:x1830945994264192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746127004.270973:0:9236:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445584896 avail 1316122624 00000100:00100000:1.0:1746127004.271027:0:9236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3782:x1830945994264192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.271032:0:9236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1746127004.271111:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994264192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746127004.287023:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:444fe009-ee02-43e3-bd8f-cf01026dcff4:3783:1830945994264320:0@lo:400:kworker.0 00000100:00100000:3.0:1746127004.287107:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.287178:0:8221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994264320 00000100:00100000:2.0:1746127004.287186:0:8221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994264320 00000100:00100000:2.0:1746127004.287226:0:8221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1746127004.287233:0:8221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3783:x1830945994264320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127004.287292:0:8221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3783:x1830945994264320:12345-0@lo:400:kworker.0 Request processed in 59us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.287298:0:8221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1746127004.287300:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:444fe009-ee02-43e3-bd8f-cf01026dcff4:3783:1830945994264320:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.287436:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3785:1830945994264576:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.287463:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.287480:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3785:1830945994265088:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.287495:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.287509:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746127004.287513:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994264448:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.287530:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.287541:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3785:1830945994264960:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.287554:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.287564:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3785:1830945994265472:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.287577:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.287596:0:9236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994264448 00000100:00100000:1.0:1746127004.287599:0:9236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994264448 00000100:00100000:1.0:1746127004.287622:0:9236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1746127004.287626:0:9236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3785:x1830945994264448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.287652:0:9236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3785:x1830945994264448:12345-0@lo:400:kworker.0 Request processed in 26us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.287657:0:9236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1746127004.287858:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994264576 00000100:00100000:2.0:1746127004.287862:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994264576 00000100:00100000:0.0:1746127004.287870:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994265088 00000100:00100000:0.0:1746127004.287873:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994265088 00000100:00100000:2.0:1746127004.287884:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994264960 00000100:00100000:2.0:1746127004.287886:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994264960 00000100:00080000:0.0:1746127004.287893:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746127004.287896:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746127004.287900:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994265472 00000100:00100000:2.0:1746127004.287902:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994265472 00000100:00100000:2.0:1746127004.287913:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1746127004.287918:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3785:x1830945994264576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127004.287919:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1746127004.287924:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3785:x1830945994264960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127004.287972:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1746127004.287981:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3785:x1830945994265088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127004.288554:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3785:x1830945994264960:12345-0@lo:400:kworker.0 Request processed in 629us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.288560:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1746127004.288573:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1746127004.288578:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3785:x1830945994265472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127004.288600:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3785:x1830945994265472:12345-0@lo:400:kworker.0 Request processed in 22us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.288604:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1746127004.288633:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994264704:0@lo:400:kworker.0 00000100:00100000:0.0:1746127004.288658:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.288860:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994264448:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.288872:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3785:1830945994264960:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.288882:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3785:1830945994265472:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.288908:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994264704 00000100:00100000:1.0:1746127004.288910:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994264704 00000100:00080000:1.0:1746127004.288924:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746127004.288952:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1746127004.288957:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994264704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127004.288961:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3785:x1830945994264576:12345-0@lo:400:kworker.0 Request processed in 1043us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.288966:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1746127004.288982:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994264704:12345-0@lo:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.288987:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1746127004.288993:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994264832:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.289004:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3785:1830945994264576:0@lo:400:kworker.0 00000100:00100000:2.0:1746127004.289011:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.289024:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994264832 00000100:00100000:1.0:1746127004.289027:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994264832 00000100:00100000:2.0:1746127004.289034:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3783:1830945994265344:0@lo:400:kworker.0 00000100:00080000:1.0:1746127004.289039:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746127004.289062:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.289065:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1746127004.289069:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994264832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127004.289081:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994265344 00000100:00100000:2.0:1746127004.289083:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994265344 00000100:00100000:1.0:1746127004.289092:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994264832:12345-0@lo:400:kworker.0 Request processed in 23us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.289097:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1746127004.289101:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1746127004.289104:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3783:x1830945994265344:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1746127004.289105:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746127004.289125:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3783:x1830945994265344:12345-0@lo:400:kworker.0 Request processed in 20us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.289156:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1746127004.289179:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994264832:0@lo:400:kworker.0 00000100:00100000:2.0:1746127004.289185:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3783:1830945994265344:0@lo:400:kworker.0 00000100:00100000:3.0:1746127004.289268:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3785:x1830945994265088:12345-0@lo:400:kworker.0 Request processed in 1288us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.289274:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:1.0:1746127004.289278:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3785:1830945994265088:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.289761:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994264704:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.289768:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3782:1830945994265216:0@lo:400:kworker.0 00000100:00100000:1.0:1746127004.289785:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.292426:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994265216 00000100:00100000:2.0:1746127004.292438:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994265216 00000100:00100000:2.0:1746127004.292505:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1746127004.292519:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3782:x1830945994265216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127004.292599:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3782:x1830945994265216:12345-0@lo:400:kworker.0 Request processed in 86us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.292605:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1746127004.292680:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3782:1830945994265216:0@lo:400:kworker.0 00000100:00080000:1.0:1746127004.292733:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746127004.322607:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.322686:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991672064 00000100:00100000:2.0:1746127004.322695:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991672064 00000100:00100000:2.0:1746127004.322762:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17280 00000100:00100000:2.0:1746127004.322770:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4312:x1830945991672064:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.322796:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.322815:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef9eaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e532fe expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.322890:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.322903:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.322914:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.322928:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.322933:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.322937:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.323031:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.323040:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.323059:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127004.323073:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127004.324742:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324753:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324760:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324766:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.324770:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324776:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324788:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.324791:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127004.324795:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324800:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ebf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324838:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324844:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324849:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324856:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.324858:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324863:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324870:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127004.324872:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.324875:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324879:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9eb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324887:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324891:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324895:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324899:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f45600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.324901:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324905:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324910:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e600) 00010000:00010000:2.0:1746127004.324912:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.324915:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324918:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9eb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.324960:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef9eaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532fe expref: 33 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.324966:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef9eaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532fe expref: 33 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.324975:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44400, rc 0) 00000100:00100000:2.0:1746127004.325058:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4312:x1830945991672064:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2288us (2458us total) trans 8589938216 rc 301/301 00000100:00100000:2.0:1746127004.325066:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17280 00000100:00100000:0.0:1746127004.326960:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.327815:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991672320 00000100:00100000:3.0:1746127004.327824:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991672320 00000100:00100000:3.0:1746127004.327871:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6581 00000100:00100000:3.0:1746127004.327879:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4312:x1830945991672320:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127004.329054:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4312:x1830945991672320:12345-192.168.203.42@tcp:35:cat.0 Request processed in 1162us (2086us total) trans 8589938217 rc 0/0 00000100:00100000:3.0:1746127004.329063:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6581 00000100:00100000:0.0:1746127004.330801:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.330879:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991672448 00000100:00100000:2.0:1746127004.330886:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991672448 00000100:00100000:2.0:1746127004.330970:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17281 00000100:00100000:2.0:1746127004.330978:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4312:x1830945991672448:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.330998:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.331018:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef9ecd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53305 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.331115:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.331249:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.331262:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127004.331289:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127004.331293:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127004.331309:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.331329:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44400/0x34dc807b6ef9ecd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 35 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.331864:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.331874:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.331876:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127004.331879:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45600, rc 0) 00000100:00100000:2.0:1746127004.331978:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4312:x1830945991672448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 999us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.331985:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17281 00000100:00100000:0.0:1746127004.339958:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.340001:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.340699:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991672704 00000100:00100000:1.0:1746127004.340710:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991672704 00002000:00100000:1.0:1746127004.340758:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012ba57480 x1830945991672704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.340768:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba57480 with x1830945991672704 ext(0->1048575) 00002000:00010000:1.0:1746127004.340774:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba57480 00000100:00100000:1.0:1746127004.340791:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991672960 00000100:00100000:1.0:1746127004.340793:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991672960 00002000:00100000:1.0:1746127004.340803:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba54e00 x1830945991672960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 504/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.340810:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54e00 with x1830945991672960 ext(1048576->2097151) 00002000:00010000:1.0:1746127004.340813:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba54e00 00000100:00100000:1.0:1746127004.341370:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8638 00000100:00100000:1.0:1746127004.341380:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991672704:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.342492:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8639 00000100:00100000:0.0:1746127004.342502:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991672960:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.342836:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.343621:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991673216 00000100:00100000:2.0:1746127004.343630:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991673216 00000100:00100000:2.0:1746127004.344788:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17282 00000100:00100000:2.0:1746127004.344799:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4314:x1830945991673216:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127004.344827:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.344847:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5330c expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.344932:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.344949:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.344959:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.344971:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.344975:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.344980:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345080:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345087:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345091:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127004.345099:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127004.345172:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345178:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345183:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345188:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009867fa00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.345191:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345197:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345205:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.345208:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127004.345211:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345215:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fa00/0x34dc807b6ef9ef0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345233:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345237:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345241:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345244:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.345246:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345250:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345254:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127004.345255:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.345257:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345264:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6ef9ee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345269:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345273:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345276:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345279:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f45a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.345281:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345284:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345288:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e600) 00010000:00010000:2.0:1746127004.345289:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.345291:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345294:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45a00/0x34dc807b6ef9ee9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127004.345336:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9edb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5330c expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.345342:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6ef9edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5330c expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.345352:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44800, rc 0) 00000100:00100000:2.0:1746127004.345401:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4314:x1830945991673216:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 604us (2565us total) trans 8589938218 rc 301/301 00000100:00100000:2.0:1746127004.345407:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17282 00000100:00100000:3.0:1746127004.350112:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746127004.350150:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994265600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746127004.350218:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127004.350266:0:7265:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994265600 00000100:00100000:1.0:1746127004.350275:0:7265:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994265600 00000100:00100000:1.0:1746127004.350314:0:7265:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1746127004.350320:0:7265:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3784:x1830945994265600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746127004.350353:0:7265:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445507072 avail 1316044800 00000100:00100000:1.0:1746127004.350390:0:7265:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3784:x1830945994265600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.350395:0:7265:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1746127004.351040:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994265600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746127004.357480:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991672704:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16089us (17517us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127004.357493:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8638 00002000:00100000:1.0:1746127004.357506:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012ba57480 x1830945991672704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.357529:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba57480 with x1830945991672704 ext(0->1048575) 00002000:00010000:1.0:1746127004.357535:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba57480 00000100:00100000:2.0:1746127004.357879:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.358825:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991673472 00000100:00100000:3.0:1746127004.358834:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991673472 00000100:00100000:3.0:1746127004.358876:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17283 00000100:00100000:3.0:1746127004.358883:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4316:x1830945991673472:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127004.358900:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.358918:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096629c00/0x34dc807b6ef9efe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53313 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.358990:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359002:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359012:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359025:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359029:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359038:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359170:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359178:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359184:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127004.359192:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127004.359259:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359265:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359270:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359276:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800809d7000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.359279:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359285:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359295:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127004.359298:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127004.359301:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359309:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7000/0x34dc807b6ef9f13 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359334:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359338:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359342:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359346:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096629600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.359348:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359353:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359359:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127004.359360:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.359363:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.359367:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096629600/0x34dc807b6ef9f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361633:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361649:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361656:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361661:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800809d7800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.361665:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361671:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361687:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829b00) 00010000:00010000:3.0:1746127004.361689:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.361692:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361696:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800809d7800/0x34dc807b6ef9f0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.361759:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096629c00/0x34dc807b6ef9efe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53313 expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.361767:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096629c00/0x34dc807b6ef9efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53313 expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.361775:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096629c00, rc 0) 00000100:00100000:3.0:1746127004.361837:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4316:x1830945991673472:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2953us (3958us total) trans 8589938219 rc 301/301 00000100:00100000:3.0:1746127004.361846:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17283 00000100:00100000:3.0:1746127004.361944:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991672960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19445us (21942us total) trans 0 rc 323584/323584 00000100:00100000:3.0:1746127004.361952:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8639 00002000:00100000:3.0:1746127004.361960:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba54e00 x1830945991672960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 504/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 323584/323584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.361969:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54e00 with x1830945991672960 ext(1048576->2097151) 00002000:00010000:3.0:1746127004.361974:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba54e00 00000100:00100000:0.0:1746127004.380393:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.380495:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991673600 00000100:00100000:1.0:1746127004.380553:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991673600 00000100:00100000:1.0:1746127004.380614:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21672 00000100:00100000:1.0:1746127004.380624:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4314:x1830945991673600:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127004.380646:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.380665:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5331a expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.380695:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 38 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.380703:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.380709:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.380711:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.380714:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3702784->4022271] (req 3702784->4022271) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.380745:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.380756:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.380768:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994265728:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127004.381246:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746127004.381263:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994265856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746127004.381301:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127004.381645:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994265856 00000100:00100000:3.0:1746127004.381650:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994265856 00000100:00100000:3.0:1746127004.381685:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1746127004.381691:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3783:x1830945994265856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746127004.381707:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1135037760 pending 6803456 free 3907129344 avail 3675607040 00000100:00100000:3.0:1746127004.381748:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3783:x1830945994265856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.381754:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00010000:00010000:1.0:1746127004.382698:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 38 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.382713:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 38 pid: 9612 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.382729:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994265984:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.382850:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994265856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746127004.384402:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127004.384892:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994265728:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.387369:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994265984:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127004.387407:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3702784->4022271] (req 3702784->4022271) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.387425:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfd400, rc 0) 00000100:00100000:1.0:1746127004.387473:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4314:x1830945991673600:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6849us (7089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.387482:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21672 00000100:00100000:0.0:1746127004.396525:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.396565:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.396610:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.396654:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991673856 00000100:00100000:0.0:1746127004.396662:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991673856 00000100:00100000:0.0:1746127004.396717:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21673 00000100:00100000:0.0:1746127004.396725:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991673856:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127004.396747:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.396764:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6ef9f28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53321 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.396788:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.396800:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6ef9f28 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53321 expref: 40 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.396809:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6ef9f28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53321 expref: 40 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.396827:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213f800, rc 0) 00000100:00100000:0.0:1746127004.396871:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991673856:12345-192.168.203.42@tcp:101:cat.0 Request processed in 146us (259us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127004.396876:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21673 00000100:00100000:2.0:1746127004.397644:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991673728 00000100:00100000:2.0:1746127004.397650:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991673728 00010000:00010000:2.0:1746127004.397675:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.397694:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991673984 00000100:00100000:2.0:1746127004.397696:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991673984 00010000:00010000:2.0:1746127004.397705:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 39 pid: 9612 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.397719:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10136 00000100:00100000:2.0:1746127004.397724:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991673728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.397734:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.397754:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.397763:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.397786:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d0e2600/0x34dc807b6ef9e56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532c6 expref: 29 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.397801:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.397822:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991673728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 98us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.397827:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10136 00000100:00100000:2.0:1746127004.397837:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10137 00000100:00100000:2.0:1746127004.397841:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991673984:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.397848:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.397853:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 39 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.397860:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 39 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.397871:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6ef9e4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532bf expref: 39 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.397878:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.397879:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.397885:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.397893:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.397924:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.397937:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994266112:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.397994:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.399312:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994266240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746127004.399358:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127004.399486:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994266240 00000100:00100000:2.0:1746127004.399491:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994266240 00000100:00100000:2.0:1746127004.399527:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1746127004.399533:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+54:3783:x1830945994266240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746127004.399553:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 749568 granted 1112366400 pending 9076736 free 3910705152 avail 3679182848 00000100:00100000:2.0:1746127004.399598:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+54:3783:x1830945994266240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.399604:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1746127004.399677:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994266240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746127004.399777:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.400523:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994266112:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127004.400537:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.400565:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991673984:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2724us (4000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.400573:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10137 00000100:00100000:3.0:1746127004.400865:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991674112 00000100:00100000:3.0:1746127004.400870:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991674112 00000100:00100000:3.0:1746127004.400998:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21674 00000100:00100000:3.0:1746127004.401005:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4312:x1830945991674112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127004.401019:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.401035:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53328 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.401070:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.401077:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127004.401079:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127004.401082:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 39 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.401104:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 27 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.401116:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 27 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746127004.401126:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994266368:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127004.401194:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.401265:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.401529:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991674368 00000100:00100000:3.0:1746127004.401533:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991674368 00002000:00100000:3.0:1746127004.401562:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3702784->3706879) req@ffff880099197b80 x1830945991674368/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.401571:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197b80 with x1830945991674368 ext(3702784->3706879) 00010000:00010000:3.0:1746127004.401576:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.401585:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.401592:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099197b80 00000100:00100000:3.0:1746127004.401842:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1903 00000100:00100000:3.0:1746127004.401850:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991674368:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127004.402126:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991674368:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 276us (860us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127004.402149:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1903 00000100:00100000:0.0:1746127004.402227:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994266368:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127004.402244:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 39 pid: 11152 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746127004.402277:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3702784->3706879) req@ffff880099197b80 x1830945991674368/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.402285:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099197b80 with x1830945991674368 ext(3702784->3706879) 00010000:00010000:3.0:1746127004.402290:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.402299:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.402305:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099197b80 00010000:00010000:0.0:1746127004.402693:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098672000, rc 0) 00000100:00100000:0.0:1746127004.402719:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4312:x1830945991674112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1714us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.402725:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21674 00000100:00100000:0.0:1746127004.408504:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.408705:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991674624 00000100:00100000:3.0:1746127004.408715:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991674624 00002000:00100000:3.0:1746127004.408765:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4018176->4022271) req@ffff8800a8eeb480 x1830945991674624/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.408776:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb480 with x1830945991674624 ext(4018176->4022271) 00010000:00010000:3.0:1746127004.408786:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.408800:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.408813:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8eeb480 00000100:00100000:3.0:1746127004.409232:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1904 00000100:00100000:3.0:1746127004.409241:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991674624:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127004.409864:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991674624:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 620us (1368us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127004.409872:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1904 00002000:00100000:3.0:1746127004.409879:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4018176->4022271) req@ffff8800a8eeb480 x1830945991674624/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.409887:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb480 with x1830945991674624 ext(4018176->4022271) 00010000:00010000:3.0:1746127004.409893:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.409906:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.409912:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8eeb480 00000100:00100000:0.0:1746127004.410222:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.410379:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991674880 00000100:00100000:3.0:1746127004.410384:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991674880 00000100:00100000:3.0:1746127004.411066:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17284 00000100:00100000:3.0:1746127004.411074:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4319:x1830945991674880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127004.411094:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.411112:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47000/0x34dc807b6ef9f36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5332f expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.411208:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411222:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411232:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411244:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411249:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411254:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411349:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411357:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411363:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127004.411371:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127004.411435:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411441:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411450:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411456:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f87000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.411459:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411465:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411474:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127004.411477:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127004.411480:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411484:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87000/0x34dc807b6ef9f4b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411519:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411524:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411528:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411532:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc34600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.411534:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411540:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411548:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127004.411550:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.411553:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411557:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc34600/0x34dc807b6ef9f3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411564:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411569:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411573:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411576:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f87200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.411578:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411582:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411586:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829500) 00010000:00010000:3.0:1746127004.411587:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.411589:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.411592:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f87200/0x34dc807b6ef9f44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.412314:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47000/0x34dc807b6ef9f36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5332f expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.412322:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47000/0x34dc807b6ef9f36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5332f expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.412446:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f47000, rc 0) 00000100:00100000:3.0:1746127004.412792:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4319:x1830945991674880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1715us (2567us total) trans 8589938220 rc 301/301 00000100:00100000:3.0:1746127004.412799:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17284 00000100:00100000:0.0:1746127004.413906:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.413962:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.414307:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991675264 00000100:00100000:3.0:1746127004.414316:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991675264 00000100:00100000:2.0:1746127004.414503:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991675392 00000100:00100000:2.0:1746127004.414516:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991675392 00002000:00100000:2.0:1746127004.414557:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3702784->4022271) req@ffff8800a8eeb800 x1830945991675392/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746127004.414563:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6582 00002000:00100000:2.0:1746127004.414566:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb800 with x1830945991675392 ext(3702784->4022271) 00000100:00100000:3.0:1746127004.414571:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4314:x1830945991675264:12345-192.168.203.42@tcp:35:multiop.0 00010000:00010000:2.0:1746127004.414575:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.414587:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746127004.414593:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8eeb800 00000100:00100000:2.0:1746127004.414616:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1905 00000100:00100000:2.0:1746127004.414621:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991675392:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127004.414871:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4314:x1830945991675264:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 300us (967us total) trans 8589938221 rc 0/0 00000100:00100000:3.0:1746127004.414878:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6582 00000100:00100000:1.0:1746127004.417360:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.417435:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991675648 00000100:00100000:3.0:1746127004.417442:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991675648 00000100:00100000:3.0:1746127004.417479:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6583 00000100:00100000:3.0:1746127004.417574:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4319:x1830945991675648:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127004.417763:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4319:x1830945991675648:12345-192.168.203.42@tcp:35:cat.0 Request processed in 276us (409us total) trans 8589938222 rc 0/0 00000100:00100000:3.0:1746127004.417769:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6583 00000100:00100000:0.0:1746127004.419570:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.419633:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991675776 00000100:00100000:3.0:1746127004.419641:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991675776 00000100:00100000:3.0:1746127004.419682:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17285 00000100:00100000:3.0:1746127004.419688:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4319:x1830945991675776:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127004.419716:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.419735:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef9f59 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53336 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.419812:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.419825:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.419836:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127004.419860:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127004.419864:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127004.419879:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.419899:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86c00/0x34dc807b6ef9f59 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 16 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.419914:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.419923:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127004.419925:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127004.419928:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f86200, rc 0) 00000100:00100000:3.0:1746127004.419972:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4319:x1830945991675776:12345-192.168.203.42@tcp:101:cat.0 Request processed in 283us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.419977:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17285 00000100:00100000:1.0:1746127004.420327:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991675392:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 5703us (6362us total) trans 21474842872 rc 0/0 00000100:00100000:1.0:1746127004.420336:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1905 00002000:00100000:1.0:1746127004.420345:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3702784->4022271) req@ffff8800a8eeb800 x1830945991675392/t21474842872(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.420354:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb800 with x1830945991675392 ext(3702784->4022271) 00010000:00010000:1.0:1746127004.420362:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 30 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.420376:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 30 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746127004.420383:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8eeb800 00000100:00100000:0.0:1746127004.423051:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.423095:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.423161:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991676032 00000100:00100000:2.0:1746127004.423170:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991675904 00000100:00100000:1.0:1746127004.423170:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991676032 00000100:00100000:2.0:1746127004.423175:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991675904 00000100:00100000:0.0:1746127004.423185:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.423217:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991676160 00000100:00100000:2.0:1746127004.423217:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21675 00000100:00100000:3.0:1746127004.423221:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991676160 00000100:00100000:0.0:1746127004.423224:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21676 00000100:00100000:0.0:1746127004.423231:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991675904:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127004.423243:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 31 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746127004.423247:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.423263:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213e800/0x34dc807b6ef9f67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5333d expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.423290:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10138 00000100:00100000:3.0:1746127004.423296:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2027:x1830945991676160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.423305:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127004.423319:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994266496:192.168.203.42@tcp:106: 00002000:00010000:3.0:1746127004.423321:0:11948:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127002 -> 1746127003 00002000:00010000:3.0:1746127004.423324:0:11948:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127002 -> 1746127003 00010000:00010000:3.0:1746127004.423334:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 31 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.423346:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 31 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.423366:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbfd400/0x34dc807b6ef9f21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->4022271) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5331a expref: 31 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.423378:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.423380:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.423387:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 38 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127004.423394:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746127004.423395:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 38 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.423395:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991676032:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.423402:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.423410:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53344 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.423416:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 38 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.423420:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.423422:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.423427:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 31 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127004.423436:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994266624:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127004.423436:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 31 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.423444:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6c00, rc 0) 00000100:00100000:3.0:1746127004.423459:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.423465:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991676032:12345-192.168.203.42@tcp:101:cat.0 Request processed in 242us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.423471:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21675 00002000:00010000:2.0:1746127004.425864:0:9613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127002 -> 1746127003 00000100:00100000:2.0:1746127004.425889:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994266496:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127004.425921:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213e800/0x34dc807b6ef9f67 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5333d expref: 30 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.425933:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213e800/0x34dc807b6ef9f67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5333d expref: 30 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.425951:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e800, rc 0) 00000100:00100000:2.0:1746127004.426014:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991675904:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2781us (2914us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127004.426021:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21676 00000100:00100000:3.0:1746127004.426122:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994266624:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127004.426163:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127004.426185:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991676160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2890us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.426198:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10138 00000100:00100000:0.0:1746127004.429523:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.429593:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991676416 00000100:00100000:1.0:1746127004.429601:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991676416 00002000:00100000:1.0:1746127004.429650:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0d500 x1830945991676416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.429659:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d500 with x1830945991676416 ext(4194304->4829183) 00002000:00010000:1.0:1746127004.429665:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0d500 00000100:00100000:1.0:1746127004.429697:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8640 00000100:00100000:1.0:1746127004.429703:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991676416:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.433779:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.433952:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991676672 00000100:00100000:3.0:1746127004.433961:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991676672 00002000:00100000:3.0:1746127004.434113:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009ab0e680 x1830945991676672/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.434124:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0e680 with x1830945991676672 ext(0->1048575) 00002000:00010000:3.0:1746127004.434151:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0e680 00000100:00100000:3.0:1746127004.434185:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8641 00000100:00100000:3.0:1746127004.434194:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991676672:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.440494:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991676416:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10778us (10970us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127004.440508:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8640 00002000:00100000:1.0:1746127004.440521:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0d500 x1830945991676416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.440531:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d500 with x1830945991676416 ext(4194304->4829183) 00002000:00010000:1.0:1746127004.440536:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0d500 00000100:00100000:3.0:1746127004.443094:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991676672:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8890us (9312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.443107:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8641 00002000:00100000:3.0:1746127004.443117:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009ab0e680 x1830945991676672/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.443126:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0e680 with x1830945991676672 ext(0->1048575) 00002000:00010000:3.0:1746127004.445099:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0e680 00000100:00100000:2.0:1746127004.451537:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.452417:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991676800 00000100:00100000:0.0:1746127004.452428:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991676800 00000100:00100000:0.0:1746127004.453750:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21677 00000100:00100000:0.0:1746127004.453760:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4319:x1830945991676800:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127004.453781:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.453802:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5334b expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.453832:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 47 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.453839:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127004.453841:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127004.453844:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 30 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.453875:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 47 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.453886:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 47 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746127004.453903:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994266752:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.455220:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.472943:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994266752:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.472944:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127004.472976:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 30 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.472994:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096629600, rc 0) 00000100:00100000:0.0:1746127004.473071:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4319:x1830945991676800:12345-192.168.203.42@tcp:101:cat.0 Request processed in 19311us (21540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.473079:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21677 00000100:00100000:3.0:1746127004.473398:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991676928 00000100:00100000:3.0:1746127004.473406:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991676928 00002000:00100000:3.0:1746127004.473444:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1208320->1933311) req@ffff88009c748a80 x1830945991676928/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.473457:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748a80 with x1830945991676928 ext(1208320->1933311) 00010000:00010000:3.0:1746127004.473464:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 48 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.473476:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 48 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.473482:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c748a80 00000100:00100000:3.0:1746127004.473504:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1906 00000100:00100000:3.0:1746127004.473511:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991676928:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127004.480854:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991676928:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7332us (7907us total) trans 17179875608 rc 0/0 00000100:00100000:3.0:1746127004.480867:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1906 00002000:00100000:3.0:1746127004.480878:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1208320->1933311) req@ffff88009c748a80 x1830945991676928/t17179875608(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.480887:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748a80 with x1830945991676928 ext(1208320->1933311) 00010000:00010000:3.0:1746127004.480897:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 50 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.480915:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 50 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.480927:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c748a80 00000001:00080000:0.0:1746127004.483187:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875608 is committed 00000001:00080000:0.0:1746127004.483202:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875607 is committed 00000001:00080000:0.0:1746127004.483210:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875606 is committed 00000001:00080000:0.0:1746127004.483292:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875566 is committed 00000100:00100000:0.0:1746127004.487486:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.488064:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991677056 00000100:00100000:3.0:1746127004.488074:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991677056 00010000:00010000:3.0:1746127004.488115:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746127004.488298:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10139 00000100:00100000:3.0:1746127004.488307:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991677056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.488322:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746127004.488344:0:11948:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127002 -> 1746127003 00010000:00010000:3.0:1746127004.488351:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.488364:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.488386:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e88f200/0x34dc807b6ef9e2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1933311) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5329c expref: 28 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.488901:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.488904:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.488912:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.488922:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.488970:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.488984:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994266880:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127004.491220:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.491342:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.491376:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994266880:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127004.491394:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127004.491432:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991677056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3125us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.491443:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10139 00000100:00100000:1.0:1746127004.491542:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991677184 00000100:00100000:1.0:1746127004.491549:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991677184 00000100:00100000:1.0:1746127004.491590:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21678 00000100:00100000:1.0:1746127004.491595:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4316:x1830945991677184:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127004.491616:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.491636:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53352 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.491666:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.491674:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 7 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.491680:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.491682:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.491685:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2461696->3145727] (req 2461696->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 28 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.491711:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 7 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.491722:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 7 pid: 11152 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.491733:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994267008:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127004.491774:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 28 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.491782:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 28 pid: 9612 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.491791:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994267136:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.491806:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.495491:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.497105:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991677440 00000100:00100000:3.0:1746127004.497117:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991677440 00000100:00100000:0.0:1746127004.497180:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127004.497183:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009ab0ce00 x1830945991677440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.497195:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ce00 with x1830945991677440 ext(1048576->2097151) 00002000:00010000:3.0:1746127004.497200:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0ce00 00000100:00100000:3.0:1746127004.497223:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8642 00000100:00100000:3.0:1746127004.497231:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991677440:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.497239:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994267008:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.497247:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994267136:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.497270:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991677568 00000100:00100000:2.0:1746127004.497275:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991677568 00010000:00010000:1.0:1746127004.497278:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2461696->3145727] (req 2461696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 28 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.497294:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 9 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746127004.497295:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be42000, rc 0) 00000100:00100000:2.0:1746127004.497315:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10140 00000100:00100000:2.0:1746127004.497321:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991677568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.497330:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127004.497334:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4316:x1830945991677184:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5739us (6122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.497341:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21678 00010000:00010000:2.0:1746127004.497345:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 9 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.497358:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 9 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.497379:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213e200/0x34dc807b6ef9e79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532e9 expref: 9 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.497395:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.497414:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991677568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.497419:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10140 00000100:00100000:0.0:1746127004.497957:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.497999:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991677696 00000100:00100000:2.0:1746127004.498003:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991677696 00010000:00010000:2.0:1746127004.498016:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 28 pid: 9612 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.498034:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10141 00000100:00100000:2.0:1746127004.498038:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991677696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.498059:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.498066:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 28 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.498075:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 28 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.498088:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012158de00/0x34dc807b6ef9e5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e532cd expref: 28 pid: 9612 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.498097:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.498099:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.498105:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 27 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.498114:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 27 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.498169:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 27 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.498182:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994267264:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.498252:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.504608:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994267264:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127004.504630:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.507958:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991677696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 9915us (9998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.507972:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10141 00000100:00100000:3.0:1746127004.508013:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2027:x1830945991677440:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10683us (12430us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.508025:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8642 00002000:00100000:3.0:1746127004.508085:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009ab0ce00 x1830945991677440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.508101:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ce00 with x1830945991677440 ext(1048576->2097151) 00002000:00010000:3.0:1746127004.508106:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0ce00 00000100:00100000:0.0:1746127004.508358:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.508548:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991677952 00000100:00100000:3.0:1746127004.508556:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991677952 00002000:00100000:3.0:1746127004.508590:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2461696->2465791) req@ffff88009ab0ea00 x1830945991677952/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.508598:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ea00 with x1830945991677952 ext(2461696->2465791) 00002000:00010000:3.0:1746127004.508602:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0ea00 00000100:00100000:3.0:1746127004.508627:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8643 00000100:00100000:3.0:1746127004.508634:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991677952:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127004.508978:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991677952:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 344us (619us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127004.508983:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8643 00002000:00100000:3.0:1746127004.508988:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2461696->2465791) req@ffff88009ab0ea00 x1830945991677952/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.508995:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ea00 with x1830945991677952 ext(2461696->2465791) 00002000:00010000:3.0:1746127004.508997:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0ea00 00000100:00100000:0.0:1746127004.518963:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.519028:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.519038:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991678080 00000100:00100000:1.0:1746127004.519072:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991678080 00000100:00100000:3.0:1746127004.519146:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991678336 00000100:00100000:3.0:1746127004.519150:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991678336 00000100:00100000:1.0:1746127004.519154:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21679 00000100:00100000:1.0:1746127004.519162:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4316:x1830945991678080:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127004.519177:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746127004.519181:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff8800a2fdbb80 x1830945991678336/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.519189:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdbb80 with x1830945991678336 ext(2097152->3145727) 00010000:00010000:1.0:1746127004.519193:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53359 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127004.519194:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fdbb80 00000100:00100000:3.0:1746127004.519209:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8644 00000100:00100000:3.0:1746127004.519213:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991678336:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:1.0:1746127004.519221:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.519227:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.519232:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.519234:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.519238:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->3321855] (req 3145728->3321855) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 40 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.519266:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.519275:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746127004.519285:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994267392:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127004.519367:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.519374:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 40 pid: 11152 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.519381:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994267520:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.519399:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.529197:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991678336:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9966us (10153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.529211:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8644 00002000:00100000:3.0:1746127004.529222:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff8800a2fdbb80 x1830945991678336/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.529231:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdbb80 with x1830945991678336 ext(2097152->3145727) 00010000:00010000:3.0:1746127004.529241:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.529256:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 999 lvb_type: 1 00002000:00010000:3.0:1746127004.529262:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdbb80 00000100:00100000:0.0:1746127004.530676:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.530766:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991678464 00000100:00100000:1.0:1746127004.530772:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994267392:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.530773:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991678464 00000100:00100000:1.0:1746127004.530782:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994267520:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.530805:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 41 pid: 11152 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746127004.530808:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->3321855] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 41 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.530824:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be42e00, rc 0) 00000100:00100000:2.0:1746127004.530843:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10142 00000100:00100000:2.0:1746127004.530850:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991678464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127004.530855:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4316:x1830945991678080:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 11694us (11904us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127004.530863:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127004.530865:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21679 00010000:00010000:2.0:1746127004.530882:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 40 pid: 11152 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.530892:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 40 pid: 11152 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.530913:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098672000/0x34dc807b6ef9f2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53328 expref: 40 pid: 11152 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.530929:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.530947:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991678464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 98us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.530952:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10142 00000100:00100000:0.0:1746127004.536421:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.536733:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991678592 00000100:00100000:1.0:1746127004.536742:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991678592 00000100:00100000:1.0:1746127004.538803:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21680 00000100:00100000:1.0:1746127004.538821:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4319:x1830945991678592:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.538841:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.538861:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53360 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.538892:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 26 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.538899:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.538901:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.538904:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 8 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.538936:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 26 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.538948:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 26 pid: 9613 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.538960:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994267648:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.539076:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.539747:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.539840:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991678720 00000100:00100000:2.0:1746127004.539848:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991678720 00010000:00010000:2.0:1746127004.539877:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.539915:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10143 00000100:00100000:2.0:1746127004.539921:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991678720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.539932:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.539953:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.539965:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.539985:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9f6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53344 expref: 30 pid: 11152 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.540009:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.540011:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.540017:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 38 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.540024:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 38 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.540057:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 38 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.540066:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994267776:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.540147:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.540473:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.540548:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991678976 00000100:00100000:2.0:1746127004.540552:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991678976 00000100:00100000:2.0:1746127004.540587:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17286 00000100:00100000:2.0:1746127004.540593:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4323:x1830945991678976:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127004.540606:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.540618:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6ef9f91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53367 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.540680:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540694:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540703:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540715:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540721:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540726:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540811:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540819:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540824:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:2.0:1746127004.540832:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127004.540888:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540893:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540899:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540903:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.540907:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540913:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540920:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.540922:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127004.540925:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540929:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6a00/0x34dc807b6ef9fa6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540940:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540944:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540949:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540952:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540955:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.540957:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540960:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540964:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127004.540966:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.540969:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540973:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9f98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540977:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540981:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540984:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540987:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb7200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.540989:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540992:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.540996:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e600) 00010000:00010000:2.0:1746127004.540998:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.540999:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.541003:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9f9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.541028:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6ef9f91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53367 expref: 17 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.541034:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6ef9f91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53367 expref: 17 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.541051:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6200, rc 0) 00000100:00100000:2.0:1746127004.541077:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4323:x1830945991678976:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 484us (604us total) trans 8589938223 rc 301/301 00000100:00100000:2.0:1746127004.541082:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17286 00000100:00100000:1.0:1746127004.541929:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994267648:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127004.541953:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 8 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.541965:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800809d7800, rc 0) 00000100:00100000:1.0:1746127004.541988:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4319:x1830945991678592:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3175us (5577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.541995:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21680 00000100:00100000:0.0:1746127004.543319:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.543382:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991679104 00000100:00100000:2.0:1746127004.543392:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994267776:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127004.543406:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.543430:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991678720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3510us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.543439:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10143 00000100:00100000:3.0:1746127004.543570:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991679104 00002000:00100000:3.0:1746127004.543611:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2461696->3145727) req@ffff8800a7c52d80 x1830945991679104/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.543620:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52d80 with x1830945991679104 ext(2461696->3145727) 00010000:00010000:3.0:1746127004.543627:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 27 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.543640:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 27 pid: 9613 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.543650:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c52d80 00000100:00100000:3.0:1746127004.543682:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1907 00000100:00100000:3.0:1746127004.543688:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991679104:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127004.544502:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.544552:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991679360 00000100:00100000:1.0:1746127004.544557:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991679360 00002000:00100000:1.0:1746127004.544579:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3317760->3321855) req@ffff8800a7c53800 x1830945991679360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.544587:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53800 with x1830945991679360 ext(3317760->3321855) 00002000:00010000:1.0:1746127004.544591:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53800 00000100:00100000:1.0:1746127004.544604:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8645 00000100:00100000:1.0:1746127004.544608:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991679360:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127004.545327:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991679360:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 716us (825us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127004.545335:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8645 00002000:00100000:1.0:1746127004.545342:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3317760->3321855) req@ffff8800a7c53800 x1830945991679360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.545349:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53800 with x1830945991679360 ext(3317760->3321855) 00002000:00010000:1.0:1746127004.545353:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53800 00000100:00100000:0.0:1746127004.548487:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.549062:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991679616 00000100:00100000:3.0:1746127004.549072:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991679616 00000100:00100000:3.0:1746127004.549117:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6584 00000100:00100000:3.0:1746127004.549126:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4316:x1830945991679616:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127004.549347:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4316:x1830945991679616:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 222us (869us total) trans 8589938224 rc 0/0 00000100:00100000:3.0:1746127004.549355:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6584 00000100:00100000:3.0:1746127004.553483:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991679104:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 9784us (10157us total) trans 17179875609 rc 0/0 00000100:00100000:3.0:1746127004.553497:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1907 00002000:00100000:3.0:1746127004.553508:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2461696->3145727) req@ffff8800a7c52d80 x1830945991679104/t17179875609(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.553517:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52d80 with x1830945991679104 ext(2461696->3145727) 00010000:00010000:3.0:1746127004.553527:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 29 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.553543:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 29 pid: 9613 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.553550:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a7c52d80 00000100:00100000:0.0:1746127004.556452:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.557997:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991679744 00000100:00100000:2.0:1746127004.558008:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991679744 00010000:00010000:2.0:1746127004.558063:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 29 pid: 9613 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.558107:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10144 00000100:00100000:2.0:1746127004.558116:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991679744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.558146:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746127004.558162:0:7247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127002 -> 1746127003 00002000:00010000:2.0:1746127004.558166:0:7247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127002 -> 1746127003 00010000:00010000:2.0:1746127004.558172:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 29 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.558184:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 29 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.558217:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be42000/0x34dc807b6ef9f7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53352 expref: 29 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.558242:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.558244:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.558252:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.558260:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.558294:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.558306:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994267904:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.558393:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.560818:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994267904:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127004.560837:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.560874:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991679744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2758us (4429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.560883:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10144 00000100:00100000:0.0:1746127004.565240:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.565314:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991680000 00000100:00100000:3.0:1746127004.565323:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991680000 00002000:00100000:3.0:1746127004.565375:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff8800a7c52a00 x1830945991680000/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.565386:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52a00 with x1830945991680000 ext(2097152->3145727) 00002000:00010000:3.0:1746127004.565392:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c52a00 00000100:00100000:3.0:1746127004.565413:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8646 00000100:00100000:3.0:1746127004.565496:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991680000:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127004.571871:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991680000:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6439us (6632us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127004.571884:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8646 00002000:00100000:3.0:1746127004.571896:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff8800a7c52a00 x1830945991680000/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.571907:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52a00 with x1830945991680000 ext(2097152->3145727) 00002000:00010000:3.0:1746127004.571912:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c52a00 00000100:00100000:0.0:1746127004.574638:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.574714:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991680128 00000100:00100000:1.0:1746127004.574724:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991680128 00000100:00100000:1.0:1746127004.574778:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21681 00000100:00100000:1.0:1746127004.574787:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4319:x1830945991680128:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.574805:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.574823:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5336e expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.574858:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 38 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.574866:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.574867:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127004.574870:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 30 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.574901:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 38 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.574913:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 38 pid: 9613 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.574925:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994268032:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127004.575020:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b776c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127004.576695:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994268032:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127004.576720:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 30 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.576736:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be43800, rc 0) 00000100:00100000:1.0:1746127004.576782:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4319:x1830945991680128:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1995us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.576790:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21681 00000100:00100000:0.0:1746127004.577274:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.577355:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991680256 00000100:00100000:3.0:1746127004.577361:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991680256 00002000:00100000:3.0:1746127004.577398:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3321855) req@ffff8800a7c51c00 x1830945991680256/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.577407:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51c00 with x1830945991680256 ext(3145728->3321855) 00010000:00010000:3.0:1746127004.577414:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 39 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.577425:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 39 pid: 9613 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.577436:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c51c00 00000100:00100000:3.0:1746127004.577487:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1908 00000100:00100000:3.0:1746127004.577494:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991680256:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127004.581603:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991680256:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 4097us (4317us total) trans 21474842873 rc 0/0 00000100:00100000:3.0:1746127004.581617:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1908 00002000:00100000:3.0:1746127004.581632:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3321855) req@ffff8800a7c51c00 x1830945991680256/t21474842873(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.581642:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51c00 with x1830945991680256 ext(3145728->3321855) 00010000:00010000:3.0:1746127004.581654:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 41 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.581670:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 41 pid: 9613 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746127004.581677:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c51c00 00000100:00100000:0.0:1746127004.585223:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.585298:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991680384 00000100:00100000:2.0:1746127004.585311:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991680384 00010000:00010000:2.0:1746127004.585353:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 41 pid: 9613 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.585414:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10145 00000100:00100000:2.0:1746127004.585424:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991680384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.585442:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.585466:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 41 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.585479:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 41 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.585502:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6ef9f83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53359 expref: 41 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.585540:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.585544:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.585552:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.585561:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.585601:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.585615:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994268160:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.585724:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.587619:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994268160:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127004.587632:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.587675:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991680384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2253us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.587682:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10145 00000100:00100000:0.0:1746127004.594204:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.594281:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.594406:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991680640 00000100:00100000:1.0:1746127004.594416:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991680640 00002000:00100000:1.0:1746127004.594472:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800997d9f80 x1830945991680640/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.594483:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9f80 with x1830945991680640 ext(3145728->4194303) 00002000:00010000:1.0:1746127004.594489:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997d9f80 00000100:00100000:1.0:1746127004.594509:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991680896 00000100:00100000:1.0:1746127004.594512:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991680896 00002000:00100000:1.0:1746127004.594523:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800997d8700 x1830945991680896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.594530:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d8700 with x1830945991680896 ext(3145728->4194303) 00002000:00010000:1.0:1746127004.594533:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d8700 00000100:00100000:1.0:1746127004.594575:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8647 00000100:00100000:1.0:1746127004.594585:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991680640:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.595117:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8648 00000100:00100000:2.0:1746127004.595126:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991680896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.601440:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991680640:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6845us (7300us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127004.601453:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8647 00002000:00100000:1.0:1746127004.601464:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800997d9f80 x1830945991680640/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.601474:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9f80 with x1830945991680640 ext(3145728->4194303) 00002000:00010000:1.0:1746127004.601480:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997d9f80 00000100:00100000:2.0:1746127004.602219:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991680896:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7093us (7938us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.602227:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8648 00002000:00100000:2.0:1746127004.602233:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800997d8700 x1830945991680896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.602240:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d8700 with x1830945991680896 ext(3145728->4194303) 00002000:00010000:2.0:1746127004.602244:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800997d8700 00000100:00100000:0.0:1746127004.606448:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.606621:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991681152 00000100:00100000:2.0:1746127004.606631:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991681152 00002000:00100000:2.0:1746127004.606680:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800997db480 x1830945991681152/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.606690:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997db480 with x1830945991681152 ext(4194304->4829183) 00002000:00010000:2.0:1746127004.606696:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997db480 00000100:00100000:2.0:1746127004.606732:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8649 00000100:00100000:2.0:1746127004.606740:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991681152:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.610926:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991681152:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4179us (4479us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127004.610963:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8649 00002000:00100000:2.0:1746127004.611086:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800997db480 x1830945991681152/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.611095:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997db480 with x1830945991681152 ext(4194304->4829183) 00002000:00010000:2.0:1746127004.611100:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800997db480 00000100:00100000:0.0:1746127004.666829:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.666951:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991681408 00000100:00100000:2.0:1746127004.666961:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991681408 00000100:00100000:2.0:1746127004.667212:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17287 00000100:00100000:2.0:1746127004.667221:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4330:x1830945991681408:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.667245:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.667263:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9fbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53375 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.667332:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667342:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667351:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667359:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667363:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667366:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667445:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667451:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667454:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:2.0:1746127004.667460:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127004.667518:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667522:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667526:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667529:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.667532:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667536:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667543:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.667545:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127004.667547:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667550:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6ef9fd0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667576:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667581:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667585:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667590:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667593:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.667595:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667600:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667606:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127004.667608:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.667611:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667616:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6ef9fc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667622:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667626:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667632:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667636:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb7200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.667638:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667643:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667648:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662ed00) 00010000:00010000:2.0:1746127004.667650:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.667652:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667655:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6ef9fc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.667686:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9fbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53375 expref: 38 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.667692:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6ef9fbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53375 expref: 38 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.667699:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb7000, rc 0) 00000100:00100000:2.0:1746127004.667757:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4330:x1830945991681408:12345-192.168.203.42@tcp:101:cat.0 Request processed in 537us (940us total) trans 8589938225 rc 301/301 00000100:00100000:2.0:1746127004.667764:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17287 00000100:00100000:0.0:1746127004.668984:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.669073:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991681664 00000100:00100000:1.0:1746127004.669079:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991681664 00000100:00100000:1.0:1746127004.669120:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6585 00000100:00100000:1.0:1746127004.669125:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4330:x1830945991681664:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127004.669286:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4330:x1830945991681664:12345-192.168.203.42@tcp:35:cat.0 Request processed in 160us (306us total) trans 8589938226 rc 0/0 00000100:00100000:1.0:1746127004.669292:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6585 00000100:00100000:0.0:1746127004.672617:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.672724:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991681920 00000100:00100000:2.0:1746127004.672736:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991681920 00000100:00100000:2.0:1746127004.672793:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17288 00000100:00100000:2.0:1746127004.672802:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4329:x1830945991681920:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127004.672828:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.672846:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7e00/0x34dc807b6ef9fde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5337c expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.672925:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.672938:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.672948:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746127004.672948:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127004.672962:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.672967:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.672972:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746127004.672976:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.673007:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.673034:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991682048 00000100:00100000:0.0:1746127004.673037:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991682048 00000100:00100000:1.0:1746127004.673072:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991682304 00000100:00100000:0.0:1746127004.673073:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991682176 00000100:00100000:0.0:1746127004.673075:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991682176 00000100:00100000:1.0:1746127004.673077:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991682304 00010000:00010000:2.0:1746127004.673094:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673104:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673111:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:2.0:1746127004.673118:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127004.673210:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673220:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673226:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673232:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.673235:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673242:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673252:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127004.673254:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127004.673258:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673262:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6ef9ff3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673276:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673281:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673286:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673290:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673294:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.673296:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673301:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673307:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127004.673309:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.673312:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673316:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6ef9fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673322:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673327:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673331:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673334:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb7400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127004.673335:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673339:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673343:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e900) 00010000:00010000:2.0:1746127004.673344:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127004.673346:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673353:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6ef9fec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127004.673385:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7e00/0x34dc807b6ef9fde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5337c expref: 40 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.673392:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7e00/0x34dc807b6ef9fde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5337c expref: 40 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.673399:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb7e00, rc 0) 00000100:00100000:2.0:1746127004.673439:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4329:x1830945991681920:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 639us (831us total) trans 8589938227 rc 301/301 00000100:00100000:2.0:1746127004.673445:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17288 00000100:00100000:0.0:1746127004.673790:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21682 00000100:00100000:0.0:1746127004.673796:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991682048:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127004.673805:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.673816:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53383 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.673836:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.673838:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.673846:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.673858:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.673867:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46a00, rc 0) 00000100:00100000:0.0:1746127004.673890:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991682048:12345-192.168.203.42@tcp:101:cat.0 Request processed in 94us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.673897:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21683 00000100:00100000:1.0:1746127004.673904:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991682176:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.673911:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.673921:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5338a expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.673935:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.673936:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.673941:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 41 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.673951:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 41 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.673958:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be42e00, rc 0) 00000100:00100000:1.0:1746127004.673977:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991682176:12345-192.168.203.42@tcp:101:cat.0 Request processed in 74us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.674616:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21682 00000100:00100000:1.0:1746127004.674623:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21683 00000100:00100000:0.0:1746127004.674632:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21684 00000100:00100000:0.0:1746127004.674638:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991682304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127004.674646:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.674654:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53391 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.674665:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.674666:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.674671:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674680:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 30 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674697:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46000, rc 0) 00000100:00100000:1.0:1746127004.674708:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.674715:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991682304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 78us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.674720:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21684 00000100:00100000:0.0:1746127004.674730:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991682432 00000100:00100000:0.0:1746127004.674733:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991682432 00000100:00100000:0.0:1746127004.674761:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21685 00000100:00100000:0.0:1746127004.674766:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4323:x1830945991682432:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127004.674773:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.674781:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53398 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.674796:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674803:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 31 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674810:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 40 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674816:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.674817:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127004.674819:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.674851:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 40 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674861:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 40 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746127004.674873:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268288:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127004.674951:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 31 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674959:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 31 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746127004.674967:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268416:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127004.674991:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127004.674999:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 13 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746127004.675005:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268544:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.675016:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.676552:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268288:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.676560:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268416:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.676564:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268544:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.677090:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.677106:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46400, rc 0) 00000100:00100000:2.0:1746127004.677268:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4323:x1830945991682432:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2500us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.677275:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21685 00000100:00100000:0.0:1746127004.678325:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.678369:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.678435:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991682688 00000100:00100000:2.0:1746127004.678441:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991682688 00010000:00010000:2.0:1746127004.678472:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 14 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.678494:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991682560 00000100:00100000:2.0:1746127004.678496:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991682560 00010000:00010000:2.0:1746127004.678505:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 31 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.678526:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10146 00000100:00100000:2.0:1746127004.678533:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991682688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.678545:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.678564:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 14 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.678573:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 14 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.678596:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd02c00/0x34dc807b6ef9d29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531fb expref: 14 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.678609:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.678637:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991682688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.678642:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10146 00000100:00100000:2.0:1746127004.678680:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10147 00000100:00100000:2.0:1746127004.678685:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2028:x1830945991682560:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.678690:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.678696:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 31 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.678703:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 31 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.678881:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6dc00/0x34dc807b6ef9dfb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53272 expref: 31 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.678889:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.678907:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991682560:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 222us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.678912:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10147 00000100:00100000:0.0:1746127004.686782:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.686929:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991682816 00000100:00100000:2.0:1746127004.686992:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991682816 00010000:00010000:2.0:1746127004.687032:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 41 pid: 3542 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.687074:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10148 00000100:00100000:2.0:1746127004.687082:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991682816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.687097:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.687119:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 41 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.687162:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 41 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.687307:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6ef9dd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53248 expref: 41 pid: 3542 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746127004.687686:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.687689:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.687696:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.687704:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.687741:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.687755:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994268672:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.687863:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746127004.689240:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.689292:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991683072 00000100:00100000:2.0:1746127004.689298:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991683072 00002000:00100000:2.0:1746127004.689346:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c748000 x1830945991683072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.689357:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748000 with x1830945991683072 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.689362:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c748000 00000100:00100000:2.0:1746127004.689396:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8650 00000100:00100000:2.0:1746127004.689404:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991683072:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.691349:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.692966:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991683328 00000100:00100000:1.0:1746127004.692979:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991683328 00002000:00100000:1.0:1746127004.693033:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (2007040->2011135) req@ffff88008c5bc380 x1830945991683328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127004.693051:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bc380 with x1830945991683328 ext(2007040->2011135) 00002000:00010000:1.0:1746127004.693057:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bc380 00000100:00100000:1.0:1746127004.693084:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8651 00000100:00100000:1.0:1746127004.693091:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991683328:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127004.693272:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991683328:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 181us (1929us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127004.693279:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8651 00002000:00100000:1.0:1746127004.693284:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (2007040->2011135) req@ffff88008c5bc380 x1830945991683328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746127004.693289:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994268672:192.168.203.42@tcp:105: 00002000:00100000:1.0:1746127004.693291:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bc380 with x1830945991683328 ext(2007040->2011135) 00002000:00010000:1.0:1746127004.693294:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bc380 00010000:00010000:2.0:1746127004.693311:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.693339:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991682816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6258us (6575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.693348:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10148 00000100:00100000:2.0:1746127004.697344:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991683072:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7931us (8099us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.697356:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8650 00002000:00100000:2.0:1746127004.697369:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c748000 x1830945991683072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.697378:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c748000 with x1830945991683072 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.697383:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c748000 00000100:00100000:0.0:1746127004.698198:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.698285:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991683456 00000100:00100000:2.0:1746127004.698293:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991683456 00000100:00100000:2.0:1746127004.698343:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21686 00000100:00100000:2.0:1746127004.698350:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4323:x1830945991683456:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127004.698367:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.698384:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5339f expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.698414:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.698422:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 39 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.698428:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.698431:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.698435:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2977791] (req 2097152->2977791) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.698463:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 39 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.698478:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 39 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.698490:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268800:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.698564:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.698571:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 31 pid: 9613 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.698577:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268928:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.698591:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.701729:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.701993:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268800:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.702008:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994268928:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.702057:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2977791] (req 2097152->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.702080:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6e00, rc 0) 00000100:00100000:0.0:1746127004.702243:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.702249:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4323:x1830945991683456:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3894us (4050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.702260:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21686 00000100:00100000:2.0:1746127004.702290:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991683712 00000100:00100000:2.0:1746127004.702297:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991683712 00000100:00100000:3.0:1746127004.702303:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991683584 00000100:00100000:3.0:1746127004.702307:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991683584 00010000:00010000:3.0:1746127004.702328:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 41 pid: 9613 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.702345:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21687 00000100:00100000:2.0:1746127004.702354:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4330:x1830945991683712:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127004.702357:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.702359:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10149 00000100:00100000:3.0:1746127004.702370:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991683840 00010000:00010000:2.0:1746127004.702370:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127004.702373:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991683840 00010000:00010000:3.0:1746127004.702385:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 31 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.702386:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533a6 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.702398:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10150 00000100:00100000:3.0:1746127004.702402:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2029:x1830945991683840:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.702411:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.702413:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.702421:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127004.702422:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127004.702426:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.702430:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 31 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.702439:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 31 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.702455:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.702457:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6ef9fb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5336e expref: 31 pid: 9613 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.702466:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 30 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.702478:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994269056:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.702481:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127004.702503:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991683840:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 100us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.702514:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10150 00000100:00100000:3.0:1746127004.702530:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991683584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.702537:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127004.702537:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746127004.702549:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 42 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.702557:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 42 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.702572:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be42e00/0x34dc807b6efa008 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5338a expref: 42 pid: 9613 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.702580:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.702581:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.702587:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.702595:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.702613:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.702621:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994269184:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127004.702644:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.703811:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994269056:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.703830:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.703842:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6c00, rc 0) 00000100:00100000:3.0:1746127004.703851:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994269184:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127004.703860:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.703867:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4330:x1830945991683712:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1515us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.703872:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991683584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1509us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.703873:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21687 00000100:00100000:3.0:1746127004.703878:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10149 00000100:00100000:0.0:1746127004.705023:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.705439:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991683968 00000100:00100000:2.0:1746127004.705448:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991683968 00002000:00100000:2.0:1746127004.705492:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (2007040->2097151) req@ffff8801220f1880 x1830945991683968/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.705502:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1880 with x1830945991683968 ext(2007040->2097151) 00010000:00010000:2.0:1746127004.705511:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 30 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.705524:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 30 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746127004.705531:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f1880 00000100:00100000:2.0:1746127004.705550:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1909 00000100:00100000:2.0:1746127004.705558:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991683968:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127004.711517:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991683968:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 5948us (6486us total) trans 21474842874 rc 0/0 00000100:00100000:0.0:1746127004.711531:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1909 00002000:00100000:0.0:1746127004.711543:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (2007040->2097151) req@ffff8801220f1880 x1830945991683968/t21474842874(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.711553:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1880 with x1830945991683968 ext(2007040->2097151) 00010000:00010000:0.0:1746127004.711564:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 32 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746127004.711583:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 32 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:0.0:1746127004.711590:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f1880 00000100:00100000:0.0:1746127004.712512:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.713301:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.713388:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991684224 00000100:00100000:2.0:1746127004.713397:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991684224 00002000:00100000:2.0:1746127004.713438:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2973696->2977791) req@ffff8801220f1180 x1830945991684224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.713447:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1180 with x1830945991684224 ext(2973696->2977791) 00002000:00010000:2.0:1746127004.713452:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801220f1180 00000100:00100000:2.0:1746127004.713470:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8652 00000100:00100000:2.0:1746127004.713477:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2029:x1830945991684224:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127004.713606:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2029:x1830945991684224:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 128us (1096us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127004.713611:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8652 00002000:00100000:2.0:1746127004.713616:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2973696->2977791) req@ffff8801220f1180 x1830945991684224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.713623:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1180 with x1830945991684224 ext(2973696->2977791) 00002000:00010000:2.0:1746127004.713626:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801220f1180 00000100:00100000:3.0:1746127004.713944:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991684352 00000100:00100000:3.0:1746127004.713948:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991684352 00010000:00010000:3.0:1746127004.713969:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 32 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746127004.714002:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10151 00000100:00100000:3.0:1746127004.714007:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2028:x1830945991684352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.714016:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746127004.714027:0:7247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127001 -> 1746127003 00002000:00010000:3.0:1746127004.714030:0:7247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127001 -> 1746127003 00010000:00010000:3.0:1746127004.714034:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 32 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.714052:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 32 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.714072:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a46400/0x34dc807b6efa016 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53398 expref: 32 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746127004.714088:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.714090:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.714096:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 39 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.714104:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 39 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.714152:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 39 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.714167:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994269312:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127004.714228:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.716526:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994269312:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127004.716550:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127004.716610:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2028:x1830945991684352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2600us (3308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.716620:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10151 00000100:00100000:0.0:1746127004.721478:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.722204:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991684608 00000100:00100000:2.0:1746127004.722213:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991684608 00002000:00100000:2.0:1746127004.722263:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8801220f0700 x1830945991684608/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.722272:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0700 with x1830945991684608 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.722277:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801220f0700 00000100:00100000:2.0:1746127004.722303:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8653 00000100:00100000:2.0:1746127004.722310:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991684608:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.723285:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.724184:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991684864 00000100:00100000:0.0:1746127004.724191:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991684864 00000100:00100000:0.0:1746127004.724240:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6586 00000100:00100000:0.0:1746127004.724247:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4323:x1830945991684864:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746127004.724456:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4323:x1830945991684864:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 208us (1172us total) trans 8589938228 rc 0/0 00000100:00100000:0.0:1746127004.724461:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6586 00000100:00100000:2.0:1746127004.728215:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991684608:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5894us (6736us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127004.728228:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8653 00002000:00100000:2.0:1746127004.728239:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8801220f0700 x1830945991684608/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.728254:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0700 with x1830945991684608 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.728259:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801220f0700 00000100:00100000:0.0:1746127004.736803:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.736853:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.736897:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991685248 00000100:00100000:0.0:1746127004.736906:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991685248 00000100:00100000:0.0:1746127004.736960:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21688 00000100:00100000:0.0:1746127004.736968:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4330:x1830945991685248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127004.736988:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127004.737009:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533b4 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.737038:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 30 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.737057:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127004.737059:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127004.737063:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.737100:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 30 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127004.737114:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 30 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746127004.737166:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994269440:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127004.737260:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127004.738363:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991685120 00000100:00100000:3.0:1746127004.738370:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991685120 00000100:00100000:3.0:1746127004.738420:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17289 00000100:00100000:3.0:1746127004.738427:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4333:x1830945991685120:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127004.738446:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.738461:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47000/0x34dc807b6efa032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533ad expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.738529:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.738539:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.738551:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.738565:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.738570:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.738576:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.739678:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.739696:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.739707:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127004.739719:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127004.741007:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741019:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741026:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741031:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013084ec00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.741034:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741053:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741065:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127004.741067:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127004.741071:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741079:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013084ec00/0x34dc807b6efa047 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746127004.741094:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127004.741117:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741122:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741126:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741154:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741158:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f47c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.741160:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741164:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741171:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127004.741173:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.741176:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741180:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47c00/0x34dc807b6efa039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741187:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741192:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741197:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741201:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013084e600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.741203:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741206:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741211:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cc2ae00) 00010000:00010000:3.0:1746127004.741213:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.741215:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741218:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013084e600/0x34dc807b6efa040 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.741260:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47000/0x34dc807b6efa032 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533ad expref: 19 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.741267:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f47000/0x34dc807b6efa032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533ad expref: 19 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.741274:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f47000, rc 0) 00000100:00100000:2.0:1746127004.741283:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991685376 00000100:00100000:2.0:1746127004.741290:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991685376 00000100:00100000:3.0:1746127004.741322:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4333:x1830945991685120:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2895us (4528us total) trans 8589938229 rc 301/301 00000100:00100000:3.0:1746127004.741329:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17289 00002000:00100000:2.0:1746127004.741333:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2977791) req@ffff8801220f2d80 x1830945991685376/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.741342:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f2d80 with x1830945991685376 ext(2097152->2977791) 00010000:00010000:2.0:1746127004.741350:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 31 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.741365:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 31 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746127004.741365:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994269440:192.168.203.42@tcp:104: 00002000:00010000:2.0:1746127004.741371:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f2d80 00010000:00010000:1.0:1746127004.741389:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.741398:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1910 00010000:00010000:1.0:1746127004.741402:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007602ec00, rc 0) 00000100:00100000:2.0:1746127004.741405:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991685376:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746127004.741438:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4330:x1830945991685248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4471us (4584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.741445:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21688 00000100:00100000:0.0:1746127004.745399:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.745757:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991685632 00000100:00100000:1.0:1746127004.745765:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991685632 00000100:00100000:1.0:1746127004.745910:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6587 00000100:00100000:1.0:1746127004.745919:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4333:x1830945991685632:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127004.746227:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4333:x1830945991685632:12345-192.168.203.42@tcp:35:cat.0 Request processed in 308us (836us total) trans 8589938230 rc 0/0 00000100:00100000:1.0:1746127004.746233:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6587 00000100:00100000:0.0:1746127004.749902:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.749947:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.749994:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991685760 00000100:00100000:2.0:1746127004.750003:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991685760 00000100:00100000:1.0:1746127004.750037:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991685888 00000100:00100000:1.0:1746127004.750049:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991685888 00000100:00100000:1.0:1746127004.750085:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21689 00000100:00100000:1.0:1746127004.750093:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991685760:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.750110:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127004.750117:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21690 00000100:00100000:3.0:1746127004.750125:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991685888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.750152:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533bb expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.750156:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.750164:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa05c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533c2 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.750177:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.750180:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127004.750189:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 36 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.750206:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 36 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127004.750208:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994269568:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127004.750216:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213f800, rc 0) 00000100:00100000:1.0:1746127004.750257:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2028:x1830945991685760:12345-192.168.203.42@tcp:101:cat.0 Request processed in 166us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.750263:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21689 00000100:00100000:3.0:1746127004.750311:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2540 going to sleep for 11 seconds 00002000:00010000:3.0:1746127004.752279:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127002 -> 1746127003 00000100:00100000:3.0:1746127004.752297:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994269568:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127004.752328:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa05c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c2 expref: 37 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.752340:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa05c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c2 expref: 37 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.752350:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013084e200, rc 0) 00000100:00100000:3.0:1746127004.752384:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2028:x1830945991685888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2260us (2436us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127004.752390:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21690 00000100:00100000:2.0:1746127004.753224:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991685376:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 11818us (12134us total) trans 21474842875 rc 0/0 00000100:00100000:2.0:1746127004.753233:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1910 00002000:00100000:2.0:1746127004.753242:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2977791) req@ffff8801220f2d80 x1830945991685376/t21474842875(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/448 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.753250:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f2d80 with x1830945991685376 ext(2097152->2977791) 00010000:00010000:2.0:1746127004.753259:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 34 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.753270:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 34 pid: 1507 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746127004.753561:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f2d80 00000100:00100000:1.0:1746127004.759299:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.759353:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991686016 00000100:00100000:3.0:1746127004.759361:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991686016 00000100:00100000:3.0:1746127004.759406:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21691 00000100:00100000:3.0:1746127004.759412:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4329:x1830945991686016:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127004.759429:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127004.759445:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533c9 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.759475:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.759484:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.759489:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.759491:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.759494:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1253376->1986559] (req 1253376->1986559) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 42 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.759524:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127004.759534:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 33 pid: 1507 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.759546:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994269696:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127004.759701:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.759709:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746127004.759717:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994269824:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127004.759848:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127004.759888:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.759948:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991686272 00000100:00100000:3.0:1746127004.759952:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991686272 00002000:00100000:3.0:1746127004.759979:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007ec79c00 x1830945991686272/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127004.759987:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79c00 with x1830945991686272 ext(1048576->2097151) 00010000:00010000:3.0:1746127004.759992:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 34 pid: 1507 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.760000:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 34 pid: 1507 timeout: 999 lvb_type: 1 00002000:00010000:3.0:1746127004.760005:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ec79c00 00000100:00100000:3.0:1746127004.760018:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1911 00000100:00100000:3.0:1746127004.760023:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991686272:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127004.760328:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.760372:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991686400 00000100:00100000:2.0:1746127004.760376:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991686400 00010000:00010000:2.0:1746127004.760392:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 36 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.760412:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10152 00000100:00100000:2.0:1746127004.760417:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2027:x1830945991686400:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.760425:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.760504:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 36 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.760513:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 36 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.760532:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa01d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5339f expref: 36 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.760555:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.760557:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.760562:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.760575:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.760596:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.760605:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994269952:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127004.760646:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.761486:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994269696:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.761496:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994269824:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.761516:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1253376->1986559] (req 1253376->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 42 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.761527:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013084e200, rc 0) 00000100:00100000:2.0:1746127004.761551:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4329:x1830945991686016:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2138us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.761558:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21691 00000100:00100000:0.0:1746127004.762542:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.763289:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991686528 00000100:00100000:2.0:1746127004.763296:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991686528 00010000:00010000:2.0:1746127004.763323:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746127004.763347:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10153 00000100:00100000:2.0:1746127004.763353:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991686528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.763365:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.763383:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.763394:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.763412:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efa024 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533a6 expref: 42 pid: 1507 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746127004.763427:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127004.763495:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994269952:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127004.763507:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.763687:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991686528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 332us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.763694:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10153 00000100:00100000:3.0:1746127004.763746:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2027:x1830945991686400:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3328us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127004.763752:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10152 00000100:00100000:0.0:1746127004.768537:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991686272:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8500us (8636us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127004.768550:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1911 00002000:00100000:0.0:1746127004.768562:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007ec79c00 x1830945991686272/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127004.768572:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79c00 with x1830945991686272 ext(1048576->2097151) 00010000:00010000:0.0:1746127004.768583:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 33 pid: 1507 timeout: 999 lvb_type: 1 00010000:00010000:0.0:1746127004.768598:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 33 pid: 1507 timeout: 999 lvb_type: 1 00002000:00010000:0.0:1746127004.768604:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ec79c00 00000100:00100000:0.0:1746127004.769605:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.769694:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.770180:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991686784 00000100:00100000:2.0:1746127004.770190:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991686784 00002000:00100000:2.0:1746127004.770229:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ec78380 x1830945991686784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.770236:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec78380 with x1830945991686784 ext(2097152->4194303) 00002000:00010000:2.0:1746127004.770246:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec78380 00000100:00100000:2.0:1746127004.770267:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991687040 00000100:00100000:2.0:1746127004.770269:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991687040 00002000:00100000:2.0:1746127004.770280:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007ec79f80 x1830945991687040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.770286:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79f80 with x1830945991687040 ext(2097152->4194303) 00002000:00010000:2.0:1746127004.770289:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec79f80 00000100:00100000:2.0:1746127004.770313:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8654 00000100:00100000:2.0:1746127004.770321:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991686784:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127004.770779:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8655 00000100:00100000:0.0:1746127004.770788:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991687040:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127004.775241:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.775273:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991687168 00000100:00100000:2.0:1746127004.775280:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991687168 00000100:00100000:3.0:1746127004.775477:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.775493:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991687296 00000100:00100000:3.0:1746127004.775495:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991687296 00010000:00010000:3.0:1746127004.775516:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 34 pid: 1507 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746127004.775546:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10154 00000100:00100000:3.0:1746127004.775552:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2029:x1830945991687296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.775564:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127004.775583:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 34 pid: 1507 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.775593:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 34 pid: 1507 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746127004.775613:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012213f800/0x34dc807b6efa055 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533bb expref: 34 pid: 1507 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746127004.776288:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21692 00000100:00100000:2.0:1746127004.776296:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4333:x1830945991687168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.776311:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.776323:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533d0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.776339:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.776341:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.776349:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 34 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.776360:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 34 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.776369:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6e00, rc 0) 00000100:00100000:2.0:1746127004.776396:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+34:4333:x1830945991687168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 102us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.776402:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21692 00010000:00010000:3.0:1746127004.777860:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.777866:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.777877:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 42 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.777886:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 42 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.777924:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 42 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.777937:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994270080:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127004.778015:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.782931:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.782962:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991687552 00000100:00100000:2.0:1746127004.782970:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991687552 00002000:00100000:2.0:1746127004.783015:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1253376->1257471) req@ffff880099194a80 x1830945991687552/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.783026:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099194a80 with x1830945991687552 ext(1253376->1257471) 00002000:00010000:2.0:1746127004.783031:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099194a80 00000100:00100000:2.0:1746127004.783718:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8656 00000100:00100000:2.0:1746127004.783727:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991687552:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127004.783905:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991687552:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 178us (984us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127004.783912:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8656 00002000:00100000:2.0:1746127004.783918:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1253376->1257471) req@ffff880099194a80 x1830945991687552/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.783925:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099194a80 with x1830945991687552 ext(1253376->1257471) 00002000:00010000:2.0:1746127004.783928:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099194a80 00000100:00100000:0.0:1746127004.784240:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994270080:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127004.784258:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127004.784295:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991687296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8742us (8817us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127004.784303:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10154 00000100:00100000:0.0:1746127004.795106:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.795361:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991686784:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 25037us (25757us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127004.795373:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8654 00002000:00100000:3.0:1746127004.795386:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ec78380 x1830945991686784/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746127004.795567:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991687808 00000100:00100000:2.0:1746127004.795575:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991687808 00002000:00100000:2.0:1746127004.795612:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ec79180 x1830945991687808/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.795618:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79180 with x1830945991687808 ext(2097152->4194303) 00002000:00010000:2.0:1746127004.795624:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec79180 00000100:00100000:2.0:1746127004.795654:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8657 00000100:00100000:2.0:1746127004.795660:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991687808:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:3.0:1746127004.795709:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec78380 with x1830945991686784 ext(2097152->4194303) 00002000:00010000:3.0:1746127004.795714:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec78380 00000100:00100000:1.0:1746127004.807889:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.808125:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991687040:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 37331us (38423us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127004.808165:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8655 00002000:00100000:2.0:1746127004.808176:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007ec79f80 x1830945991687040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.808184:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79f80 with x1830945991687040 ext(2097152->4194303) 00002000:00010000:2.0:1746127004.808188:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec79f80 00000100:00100000:2.0:1746127004.808209:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991688064 00000100:00100000:2.0:1746127004.808215:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991688064 00002000:00100000:2.0:1746127004.808237:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1982464->1986559) req@ffff88009c749880 x1830945991688064/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.808243:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749880 with x1830945991688064 ext(1982464->1986559) 00002000:00010000:2.0:1746127004.808245:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c749880 00000100:00100000:2.0:1746127004.808273:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8658 00000100:00100000:2.0:1746127004.808279:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991688064:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127004.808364:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991688064:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 85us (484us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127004.808369:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8658 00002000:00100000:2.0:1746127004.808374:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1982464->1986559) req@ffff88009c749880 x1830945991688064/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/4536 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.808380:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749880 with x1830945991688064 ext(1982464->1986559) 00002000:00010000:2.0:1746127004.808383:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c749880 00000100:00100000:2.0:1746127004.813532:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991687808:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17858us (18421us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127004.813545:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8657 00002000:00100000:2.0:1746127004.813557:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ec79180 x1830945991687808/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.813574:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79180 with x1830945991687808 ext(2097152->4194303) 00002000:00010000:2.0:1746127004.813579:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec79180 00000100:00100000:0.0:1746127004.817177:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.817220:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991688320 00000100:00100000:1.0:1746127004.817230:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991688320 00000100:00100000:1.0:1746127004.817287:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6588 00000100:00100000:1.0:1746127004.817295:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4329:x1830945991688320:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127004.817533:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4329:x1830945991688320:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 238us (409us total) trans 8589938231 rc 0/0 00000100:00100000:1.0:1746127004.817540:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6588 00000100:00100000:0.0:1746127004.821533:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.821589:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.821625:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991688448 00000100:00100000:1.0:1746127004.821634:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991688448 00000100:00100000:2.0:1746127004.821656:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991688704 00000100:00100000:2.0:1746127004.821660:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991688704 00000100:00100000:1.0:1746127004.821691:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21693 00002000:00100000:2.0:1746127004.821697:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ec7aa00 x1830945991688704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127004.821699:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991688448:12345-192.168.203.42@tcp:101:cat.0 00002000:00100000:2.0:1746127004.821711:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7aa00 with x1830945991688704 ext(4194304->4829183) 00010000:00010000:1.0:1746127004.821714:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746127004.821717:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec7aa00 00010000:00010000:1.0:1746127004.821733:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc35a00/0x34dc807b6efa071 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533d7 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.821741:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8659 00000100:00100000:2.0:1746127004.821746:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991688704:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127004.821788:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994270208:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127004.821870:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746127004.824090:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127001 -> 1746127003 00000100:00100000:1.0:1746127004.824114:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994270208:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127004.824173:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc35a00/0x34dc807b6efa071 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d7 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.824186:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc35a00/0x34dc807b6efa071 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d7 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127004.824214:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc35a00, rc 0) 00000100:00100000:1.0:1746127004.824291:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991688448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2591us (2764us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127004.824299:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21693 00000100:00100000:2.0:1746127004.824808:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991688704:12345-192.168.203.42@tcp:3:cat.0 Request processed in 3061us (3218us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127004.824814:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8659 00002000:00100000:2.0:1746127004.824820:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ec7aa00 x1830945991688704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.824826:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec7aa00 with x1830945991688704 ext(4194304->4829183) 00002000:00010000:2.0:1746127004.824830:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec7aa00 00000100:00100000:0.0:1746127004.827582:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.827669:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991688960 00000100:00100000:2.0:1746127004.827678:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991688960 00002000:00100000:2.0:1746127004.827722:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ec79500 x1830945991688960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.827732:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79500 with x1830945991688960 ext(4194304->4829183) 00002000:00010000:2.0:1746127004.827742:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec79500 00000100:00100000:2.0:1746127004.827761:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8660 00000100:00100000:2.0:1746127004.827768:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991688960:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.832846:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991688960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5060us (5259us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127004.832860:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8660 00002000:00100000:2.0:1746127004.832874:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ec79500 x1830945991688960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:10/0 lens 488/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.832884:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec79500 with x1830945991688960 ext(4194304->4829183) 00002000:00010000:2.0:1746127004.832890:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec79500 00000100:00100000:0.0:1746127004.836276:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.836343:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.836443:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991689216 00000100:00100000:1.0:1746127004.836453:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991689216 00000100:00100000:2.0:1746127004.836454:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991689344 00000100:00100000:2.0:1746127004.836459:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991689344 00000100:00100000:1.0:1746127004.836497:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6589 00000100:00100000:1.0:1746127004.836504:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4286:x1830945991689216:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:2.0:1746127004.836511:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21694 00000100:00100000:2.0:1746127004.836517:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991689344:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.836559:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.836578:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a65600/0x34dc807b6efa078 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533de expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.836631:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994270336:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127004.836721:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127004.836887:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4286:x1830945991689216:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 381us (620us total) trans 8589938232 rc 0/0 00000100:00100000:1.0:1746127004.836894:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6589 00000100:00100000:0.0:1746127004.837889:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.837998:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991689600 00000100:00100000:1.0:1746127004.838003:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991689600 00000100:00100000:1.0:1746127004.838024:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6590 00000100:00100000:1.0:1746127004.838029:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4286:x1830945991689600:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:1.0:1746127004.838167:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4286:x1830945991689600:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 136us (281us total) trans 8589938233 rc 0/0 00000100:00100000:1.0:1746127004.838173:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6590 00000100:00100000:2.0:1746127004.838313:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994270336:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127004.838341:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a65600/0x34dc807b6efa078 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533de expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.838352:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a65600/0x34dc807b6efa078 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533de expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.838386:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a65600, rc 0) 00000100:00100000:2.0:1746127004.838406:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991689344:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1890us (2062us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127004.838413:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21694 00000100:00100000:0.0:1746127004.841331:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.841398:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991689728 00000100:00100000:2.0:1746127004.841407:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991689728 00000100:00100000:2.0:1746127004.841496:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21695 00000100:00100000:2.0:1746127004.841505:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991689728:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127004.841522:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.841540:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a64000/0x34dc807b6efa07f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533e5 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127004.841595:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994270464:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127004.842429:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.844289:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994270464:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127004.844323:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a64000/0x34dc807b6efa07f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533e5 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.844336:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a64000/0x34dc807b6efa07f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533e5 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.844345:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a64000, rc 0) 00000100:00100000:2.0:1746127004.844400:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991689728:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2894us (3077us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127004.844412:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21695 00010000:00010000:2.0:1746127004.893461:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127004.948016:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.948187:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.948235:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991689984 00000100:00100000:1.0:1746127004.948243:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991690240 00000100:00100000:3.0:1746127004.948245:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991689984 00000100:00100000:1.0:1746127004.948247:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991690240 00000100:00100000:1.0:1746127004.948305:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17290 00000100:00100000:1.0:1746127004.948313:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4343:x1830945991690240:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127004.948340:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.948358:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efa086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533f3 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.948429:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948441:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127004.948449:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17291 00010000:00010000:1.0:1746127004.948451:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127004.948456:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4341:x1830945991689984:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127004.948465:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948466:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127004.948470:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948473:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa09b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533ec expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.948476:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948501:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948508:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948515:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948522:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948528:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948536:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127004.948568:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6efa0b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948573:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efa0b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127004.948576:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6efa0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948582:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6efa0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948590:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efa0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948597:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efa0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127004.948605:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127004.948675:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948681:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948686:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948692:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948697:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911df800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.948700:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948706:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948716:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127004.948719:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.948724:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746127004.948766:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127004.948799:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948805:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948813:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948817:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127004.948819:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948824:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948831:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127004.948833:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127004.948835:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948839:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa08d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948865:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948871:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948873:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df800/0x34dc807b6efa0a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127004.948875:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948880:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127004.948882:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948887:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127004.948896:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880122059d00) 00010000:00010000:1.0:1746127004.948898:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127004.948900:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948901:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127004.948904:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127004.948906:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948911:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948914:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911df600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127004.948917:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948922:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948928:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880122059d00) 00010000:00010000:3.0:1746127004.948930:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127004.948932:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127004.948936:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911df600/0x34dc807b6efa0a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127004.948937:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efa086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533f3 expref: 43 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.948948:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6efa0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533f3 expref: 42 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.948954:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127004.948956:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127004.948958:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44800, rc 0) 00010000:00010000:3.0:1746127004.948964:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa09b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533ec expref: 22 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.948972:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efa0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533ec expref: 21 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.948978:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127004.948980:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127004.948981:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911dee00, rc 0) 00000100:00100000:1.0:1746127004.949005:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4343:x1830945991690240:12345-192.168.203.42@tcp:101:cat.0 Request processed in 693us (818us total) trans 8589938235 rc 0/0 00000100:00100000:1.0:1746127004.949011:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17290 00000100:00100000:3.0:1746127004.949169:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4341:x1830945991689984:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 713us (1164us total) trans 8589938234 rc 0/0 00000100:00100000:3.0:1746127004.949175:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17291 00000100:00100000:0.0:1746127004.953491:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.953556:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127004.953612:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127004.953645:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991690624 00000100:00100000:1.0:1746127004.953652:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991690624 00000100:00100000:1.0:1746127004.953692:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991690752 00000100:00100000:1.0:1746127004.953693:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991690752 00000100:00100000:1.0:1746127004.953706:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1022 00000100:00100000:1.0:1746127004.953711:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2028:x1830945991690624:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127004.953722:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127004.953746:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efa0b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533ec expref: 21 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.953767:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127004.953771:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127004.953816:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991690624:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.953822:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1022 00000100:00100000:1.0:1746127004.953835:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1023 00000100:00100000:1.0:1746127004.953840:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991690752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127004.953846:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127004.953856:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44800/0x34dc807b6efa0b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533f3 expref: 42 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127004.953864:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127004.953867:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127004.953879:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991690752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127004.953884:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1023 00000100:00100000:2.0:1746127004.954009:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991690496 00000100:00100000:2.0:1746127004.954014:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991690496 00000100:00100000:2.0:1746127004.954058:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6591 00000100:00100000:2.0:1746127004.954064:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4343:x1830945991690496:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127004.954530:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4343:x1830945991690496:12345-192.168.203.42@tcp:35:cat.0 Request processed in 463us (1049us total) trans 8589938236 rc 0/0 00000100:00100000:2.0:1746127004.954536:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6591 00000100:00100000:0.0:1746127004.965478:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.967385:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991691008 00000100:00100000:2.0:1746127004.967398:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991691008 00002000:00100000:2.0:1746127004.967455:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009d1b4700 x1830945991691008/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 504/0 e 0 to 0 dl 1746127015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.967466:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4700 with x1830945991691008 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.967471:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b4700 00000100:00100000:2.0:1746127004.967498:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8661 00000100:00100000:2.0:1746127004.967506:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991691008:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127004.972774:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991691008:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5257us (7298us total) trans 0 rc 315392/315392 00000100:00100000:2.0:1746127004.972788:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8661 00002000:00100000:2.0:1746127004.972799:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009d1b4700 x1830945991691008/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:10/0 lens 504/440 e 0 to 0 dl 1746127015 ref 1 fl Complete:/200/0 rc 315392/315392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127004.972808:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4700 with x1830945991691008 ext(1048576->2097151) 00002000:00010000:2.0:1746127004.972814:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b4700 00000100:00100000:0.0:1746127004.985841:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.985977:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991691136 00000100:00100000:2.0:1746127004.985987:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991691136 00000100:00100000:2.0:1746127004.986064:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21696 00000100:00100000:2.0:1746127004.986073:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4341:x1830945991691136:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127004.986092:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127004.986111:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e533fa expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.986172:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 9 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.986181:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 29 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.986187:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.986189:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127004.986192:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1138688->1552383] (req 1138688->1552383) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.986223:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 29 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127004.986234:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 29 pid: 1507 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127004.986245:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994270592:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.986509:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 9 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.986518:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 9 pid: 9613 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127004.986526:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994270720:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.986546:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127004.991343:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994270592:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127004.991358:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994270720:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127004.991391:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1138688->1552383] (req 1138688->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127004.991408:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a65000, rc 0) 00000100:00100000:2.0:1746127004.991468:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4341:x1830945991691136:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5396us (5638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.991478:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21696 00000100:00100000:0.0:1746127004.993986:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127004.995179:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991691392 00000100:00100000:2.0:1746127004.995191:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991691392 00010000:00010000:2.0:1746127004.995235:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127004.995275:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10155 00000100:00100000:2.0:1746127004.995282:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991691392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127004.995297:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127004.995319:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127004.995331:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127004.995355:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efa001 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53383 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127004.995946:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127004.996003:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991691392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 720us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127004.996010:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10155 00000100:00100000:1.0:1746127004.996536:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127004.996586:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991691264 00000100:00100000:3.0:1746127004.996596:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991691264 00010000:00010000:3.0:1746127004.996630:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 9 pid: 9613 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127004.996660:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10156 00000100:00100000:3.0:1746127004.996667:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991691264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127004.996678:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127004.996694:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 9 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127004.996704:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 9 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127004.996721:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096629600/0x34dc807b6ef9f75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5334b expref: 9 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127004.996737:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.996738:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127004.996744:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 8 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.996750:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 8 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127004.996775:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 8 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127004.996784:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994270848:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127004.996862:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.000714:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.000907:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991691648 00000100:00100000:2.0:1746127005.000914:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991691648 00002000:00100000:2.0:1746127005.000969:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1138688->1142783) req@ffff88009d1b4e00 x1830945991691648/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.000979:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4e00 with x1830945991691648 ext(1138688->1142783) 00002000:00010000:2.0:1746127005.000984:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b4e00 00000100:00080000:1.0:1746127005.000999:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746127005.001217:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994270848:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127005.001234:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.001272:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991691264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4605us (4736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.001279:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10156 00000100:00100000:2.0:1746127005.001717:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8662 00000100:00100000:2.0:1746127005.001724:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991691648:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127005.002438:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991691648:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 713us (1730us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127005.002444:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8662 00002000:00100000:2.0:1746127005.002449:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1138688->1142783) req@ffff88009d1b4e00 x1830945991691648/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.002457:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4e00 with x1830945991691648 ext(1138688->1142783) 00002000:00010000:2.0:1746127005.002461:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b4e00 00000100:00100000:0.0:1746127005.007262:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.007415:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991691904 00000100:00100000:2.0:1746127005.007425:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991691904 00002000:00100000:2.0:1746127005.007474:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1548288->1552383) req@ffff88009d1b5f80 x1830945991691904/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.007485:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5f80 with x1830945991691904 ext(1548288->1552383) 00002000:00010000:2.0:1746127005.007490:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b5f80 00000100:00100000:2.0:1746127005.007523:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8663 00000100:00100000:2.0:1746127005.007531:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991691904:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127005.007680:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991691904:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 150us (428us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127005.007687:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8663 00002000:00100000:2.0:1746127005.007692:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1548288->1552383) req@ffff88009d1b5f80 x1830945991691904/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.007700:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5f80 with x1830945991691904 ext(1548288->1552383) 00002000:00010000:2.0:1746127005.007702:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b5f80 00000100:00100000:0.0:1746127005.010533:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.011349:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991692160 00000100:00100000:2.0:1746127005.011359:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991692160 00000100:00100000:2.0:1746127005.011446:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6592 00000100:00100000:2.0:1746127005.011453:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4341:x1830945991692160:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127005.011665:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4341:x1830945991692160:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 212us (1141us total) trans 8589938237 rc 0/0 00000100:00100000:2.0:1746127005.011672:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6592 00000100:00080000:1.0:1746127005.011755:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746127005.039025:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.040441:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991692416 00000100:00100000:3.0:1746127005.040451:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991692416 00000100:00080000:1.0:1746127005.040494:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746127005.040514:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17292 00000100:00100000:3.0:1746127005.040521:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4347:x1830945991692416:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.040548:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.040565:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efa0d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53401 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.040642:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.040654:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 43 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.040661:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.040667:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.040691:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.040702:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 20 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.040712:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994270976:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.040812:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 43 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.040819:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 43 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.040826:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994271104:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.040844:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.047641:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.047690:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.048157:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991692544 00000100:00100000:1.0:1746127005.048164:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991692544 00010000:00010000:1.0:1746127005.048192:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 21 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.048215:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991692672 00000100:00100000:1.0:1746127005.048217:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991692672 00010000:00010000:1.0:1746127005.048225:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 44 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.048242:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10157 00000100:00100000:1.0:1746127005.048247:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991692544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.048257:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.048262:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 21 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.048271:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 21 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.048290:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.048294:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127005.048301:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127005.048306:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.048339:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991692544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 91us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.048345:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10157 00000100:00100000:1.0:1746127005.048359:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10158 00000100:00100000:1.0:1746127005.048363:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991692672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.048368:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.048372:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 44 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.048380:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 44 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.048390:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.048392:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127005.048397:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127005.048402:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127005.048414:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.048429:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991692672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 65us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.048435:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10158 00010000:00010000:3.0:1746127005.048834:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f86200/0x34dc807b6ef9f60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53336 expref: 20 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.048852:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994270976:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.048863:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6ef9ed4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53305 expref: 43 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.048872:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994271104:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.048891:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.048898:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.048902:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127005.048917:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127005.049008:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efa0d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 44 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.049019:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 43 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.049024:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.049027:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127005.049028:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911de800, rc 0) 00000100:00100000:3.0:1746127005.049066:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4347:x1830945991692416:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8545us (10048us total) trans 8589938238 rc 0/0 00000100:00100000:3.0:1746127005.049072:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17292 00000100:00100000:0.0:1746127005.086780:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.086843:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991692928 00000100:00100000:3.0:1746127005.086853:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991692928 00000100:00100000:0.0:1746127005.087368:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17293 00000100:00100000:0.0:1746127005.087377:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4350:x1830945991692928:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127005.087397:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.087412:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bff600/0x34dc807b6efa0e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53408 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.087590:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087600:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087606:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087614:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087617:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087622:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087694:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087701:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087706:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127005.087713:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127005.087769:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087774:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087779:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087784:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbfce00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127005.087787:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087792:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087852:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127005.087856:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127005.087859:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087867:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa0ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087892:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087896:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087900:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087979:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbfcc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127005.087982:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087986:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.087992:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880122059e00) 00010000:00010000:1.0:1746127005.087994:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127005.087996:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.088000:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfcc00/0x34dc807b6efa0f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.088033:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bff600/0x34dc807b6efa0e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 23 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.088057:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 22 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.088065:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.088067:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127005.088069:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfc800, rc 0) 00000100:00100000:1.0:1746127005.088119:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4350:x1830945991692928:12345-192.168.203.42@tcp:101:cat.0 Request processed in 743us (1345us total) trans 8589938239 rc 0/0 00000100:00100000:1.0:1746127005.088125:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17293 00000100:00100000:0.0:1746127005.090320:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.090442:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991693184 00000100:00100000:2.0:1746127005.090451:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991693184 00000100:00100000:2.0:1746127005.090486:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6593 00000100:00100000:2.0:1746127005.090493:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4350:x1830945991693184:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127005.090666:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4350:x1830945991693184:12345-192.168.203.42@tcp:35:cat.0 Request processed in 173us (351us total) trans 8589938240 rc 0/0 00000100:00100000:2.0:1746127005.090673:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6593 00000100:00100000:0.0:1746127005.093643:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.093748:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991693312 00000100:00100000:2.0:1746127005.093755:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991693312 00000100:00080000:1.0:1746127005.093814:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746127005.094087:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21697 00000100:00100000:2.0:1746127005.094095:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991693312:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127005.094108:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.094120:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efa10b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5340f expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.094180:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994271232:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127005.094237:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.098087:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994271232:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.098119:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efa10b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5340f expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.098164:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efa10b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5340f expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.098173:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e3200, rc 0) 00000100:00100000:2.0:1746127005.098225:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991693312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4130us (4586us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.098237:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21697 00000100:00100000:0.0:1746127005.115839:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.115890:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.116078:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991693696 00000100:00100000:2.0:1746127005.116087:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991693696 00000100:00100000:1.0:1746127005.116231:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991693568 00000100:00100000:1.0:1746127005.116234:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991693568 00002000:00100000:1.0:1746127005.116266:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009d1b4380 x1830945991693568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 504/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.116274:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4380 with x1830945991693568 ext(1048576->2097151) 00002000:00010000:1.0:1746127005.116279:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b4380 00000100:00100000:2.0:1746127005.116293:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21698 00000100:00100000:1.0:1746127005.116293:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8664 00000100:00100000:2.0:1746127005.116299:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4347:x1830945991693696:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:1.0:1746127005.116299:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991693568:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127005.116309:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.116321:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53416 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.116340:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 8 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.116346:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.116347:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.116350:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1667072->2097151] (req 1667072->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 30 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.116372:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 8 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.116380:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.116389:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994271360:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.116438:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.123615:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.123901:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991693824 00000100:00100000:3.0:1746127005.123909:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991693824 00002000:00100000:3.0:1746127005.123945:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1138688->1552383) req@ffff88009d1b6300 x1830945991693824/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.123955:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6300 with x1830945991693824 ext(1138688->1552383) 00010000:00010000:3.0:1746127005.123961:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.123973:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746127005.123979:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b6300 00000100:00100000:3.0:1746127005.123998:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1912 00000100:00100000:3.0:1746127005.124004:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991693824:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127005.124387:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994271360:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.124407:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1667072->2097151] (req 1667072->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 30 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.124418:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e3e00, rc 0) 00000100:00100000:2.0:1746127005.124446:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4347:x1830945991693696:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8147us (8614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.124452:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21698 00000100:00100000:1.0:1746127005.126365:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991693568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10061us (10469us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127005.126375:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8664 00002000:00100000:1.0:1746127005.126384:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009d1b4380 x1830945991693568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 504/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.126392:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4380 with x1830945991693568 ext(1048576->2097151) 00010000:00010000:1.0:1746127005.126400:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.126417:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746127005.126423:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b4380 00000100:00100000:3.0:1746127005.131290:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991693824:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7279us (7674us total) trans 17179875610 rc 0/0 00000100:00100000:3.0:1746127005.131299:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1912 00002000:00100000:3.0:1746127005.131309:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1138688->1552383) req@ffff88009d1b6300 x1830945991693824/t17179875610(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.131315:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6300 with x1830945991693824 ext(1138688->1552383) 00010000:00010000:3.0:1746127005.131322:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.131332:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746127005.131337:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b6300 00000100:00100000:0.0:1746127005.136214:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.136599:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991693952 00000100:00100000:2.0:1746127005.136606:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991693952 00000100:00100000:2.0:1746127005.136650:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21699 00000100:00100000:2.0:1746127005.136656:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4350:x1830945991693952:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127005.136671:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.136693:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5341d expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.136718:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 40 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.136724:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.136726:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.136728:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.136812:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 40 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.136821:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 40 pid: 16295 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.136831:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994271488:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.137999:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.139253:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.139854:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991694080 00000100:00100000:1.0:1746127005.139861:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991694080 00010000:00010000:1.0:1746127005.139889:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.140115:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994271488:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.140163:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.140177:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644800, rc 0) 00000100:00100000:2.0:1746127005.140222:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:4350:x1830945991693952:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3565us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.140228:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21699 00000100:00100000:1.0:1746127005.140485:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10159 00000100:00100000:1.0:1746127005.140492:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991694080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.140502:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746127005.140514:0:7246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127002 -> 1746127003 00010000:00010000:1.0:1746127005.140520:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.140530:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.140548:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a65000/0x34dc807b6efa0cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1552383) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533fa expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.140570:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.140571:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.140578:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.140590:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.140613:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.140622:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994271616:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127005.140668:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77000 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.142228:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.143096:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994271616:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127005.143111:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.143293:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991694080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2799us (4046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.143302:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10159 00000100:00100000:0.0:1746127005.143754:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.143834:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991694208 00000100:00100000:1.0:1746127005.143840:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991694208 00002000:00100000:1.0:1746127005.143870:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (1253376->1986559) req@ffff880099196a00 x1830945991694208/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.143878:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099196a00 with x1830945991694208 ext(1253376->1986559) 00010000:00010000:1.0:1746127005.143885:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 41 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.143895:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 41 pid: 16295 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746127005.143906:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099196a00 00000100:00100000:3.0:1746127005.144324:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991694464 00000100:00100000:3.0:1746127005.144329:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991694464 00002000:00100000:3.0:1746127005.144347:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1667072->1671167) req@ffff88009d1b4a80 x1830945991694464/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.144354:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4a80 with x1830945991694464 ext(1667072->1671167) 00002000:00010000:3.0:1746127005.144357:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b4a80 00000100:00100000:0.0:1746127005.144387:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1913 00000100:00100000:0.0:1746127005.144395:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991694208:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127005.145219:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8665 00000100:00100000:3.0:1746127005.145226:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991694464:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127005.145905:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991694464:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 678us (2150us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127005.145911:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8665 00002000:00100000:3.0:1746127005.145917:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1667072->1671167) req@ffff88009d1b4a80 x1830945991694464/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.145924:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4a80 with x1830945991694464 ext(1667072->1671167) 00002000:00010000:3.0:1746127005.145928:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b4a80 00000100:00100000:0.0:1746127005.156859:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.157342:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991694592 00000100:00100000:3.0:1746127005.157350:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991694592 00000100:00100000:3.0:1746127005.157386:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21700 00000100:00100000:3.0:1746127005.157393:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4347:x1830945991694592:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.157407:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.157421:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53424 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.157444:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 7 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.157457:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 8 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.157463:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.157468:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.157470:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.157473:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.157494:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.157503:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 31 pid: 3542 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.157513:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994271744:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.157583:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 8 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.157590:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 8 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.157597:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994271872:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.157621:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 7 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.157627:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 7 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.157633:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994272000:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.157650:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.164287:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.164311:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.164335:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.164365:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991694720 00000100:00100000:0.0:1746127005.164371:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991694720 00010000:00010000:0.0:1746127005.164406:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 8 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746127005.164426:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991694848 00000100:00100000:0.0:1746127005.164428:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991694848 00010000:00010000:0.0:1746127005.164436:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 9 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746127005.164452:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991694976 00000100:00100000:0.0:1746127005.164454:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991694976 00010000:00010000:0.0:1746127005.164464:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 32 pid: 3542 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746127005.164477:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10160 00000100:00100000:0.0:1746127005.164482:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991694720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127005.164492:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127005.164506:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 8 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746127005.164515:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 8 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746127005.164535:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127005.164567:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991694720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.164572:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10160 00000100:00100000:0.0:1746127005.164584:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10161 00000100:00100000:0.0:1746127005.164588:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991694848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127005.164594:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127005.164600:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 9 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746127005.164606:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 9 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746127005.164616:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127005.164628:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991694848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.164633:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10161 00000100:00100000:0.0:1746127005.164641:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10162 00000100:00100000:0.0:1746127005.164645:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945991694976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127005.164652:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127005.164658:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 32 pid: 3542 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746127005.164665:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 32 pid: 3542 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746127005.164675:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.164676:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.164682:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.164689:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.164718:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127005.164727:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fc9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994272128:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127005.164776:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00080000:0.0:1746127005.164838:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746127005.165426:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991694208:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 21031us (23201us total) trans 21474842876 rc 0/0 00000100:00100000:2.0:1746127005.165434:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1913 00002000:00100000:2.0:1746127005.165442:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (1253376->1986559) req@ffff880099196a00 x1830945991694208/t21474842876(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.165450:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099196a00 with x1830945991694208 ext(1253376->1986559) 00010000:00010000:2.0:1746127005.165456:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 43 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.165467:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 43 pid: 16295 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746127005.165476:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099196a00 00010000:00010000:3.0:1746127005.165555:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085b23400/0x34dc807b6ef9dca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53241 expref: 32 pid: 3542 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.165569:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994271744:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.165579:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6d000/0x34dc807b6ef9df4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5326b expref: 8 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.165585:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994271872:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.165592:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6ef9d0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531f4 expref: 7 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.165600:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994272000:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.165625:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 31 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.165633:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620c00, rc 0) 00000100:00100000:3.0:1746127005.165650:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4347:x1830945991694592:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8258us (8799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.165656:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21700 00000100:00100000:2.0:1746127005.168972:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fc9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994272128:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.168990:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.169575:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991694976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4926us (5235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.169583:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10162 00000100:00100000:0.0:1746127005.170830:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.171743:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991695104 00000100:00100000:2.0:1746127005.171752:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991695104 00010000:00010000:2.0:1746127005.171842:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 43 pid: 16295 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.173451:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.173565:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991695360 00000100:00100000:3.0:1746127005.173571:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991695360 00002000:00100000:3.0:1746127005.173600:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1245184->1249279) req@ffff88009c74a300 x1830945991695360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.173609:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74a300 with x1830945991695360 ext(1245184->1249279) 00002000:00010000:3.0:1746127005.173613:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c74a300 00000100:00100000:3.0:1746127005.173626:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8666 00000100:00100000:3.0:1746127005.173631:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991695360:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127005.173768:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10163 00000100:00100000:2.0:1746127005.173824:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991695104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.173834:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.173849:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 43 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.173860:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 43 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.173879:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013084e200/0x34dc807b6efa063 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1986559) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533c9 expref: 43 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.173899:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.173900:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.173907:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.173913:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.173934:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.173943:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994272256:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127005.174053:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991695360:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 419us (605us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127005.174059:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8666 00002000:00100000:3.0:1746127005.174065:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1245184->1249279) req@ffff88009c74a300 x1830945991695360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.174071:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74a300 with x1830945991695360 ext(1245184->1249279) 00002000:00010000:3.0:1746127005.174073:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c74a300 00000100:00100000:2.0:1746127005.174293:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.178742:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994272256:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.178758:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.178792:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991695104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5017us (7964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.178800:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10163 00000100:00100000:0.0:1746127005.182553:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.182669:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991695616 00000100:00100000:3.0:1746127005.182679:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991695616 00002000:00100000:3.0:1746127005.182723:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fc8700 x1830945991695616/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.182730:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8700 with x1830945991695616 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.182734:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8700 00000100:00100000:3.0:1746127005.182760:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8667 00000100:00100000:3.0:1746127005.182767:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991695616:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127005.193760:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991695616:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10981us (11206us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127005.193773:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8667 00002000:00100000:3.0:1746127005.193786:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a2fc8700 x1830945991695616/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.193795:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8700 with x1830945991695616 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.193801:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8700 00000100:00100000:0.0:1746127005.201697:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.201744:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.201771:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991695744 00000100:00100000:3.0:1746127005.201779:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991695744 00000100:00100000:3.0:1746127005.201823:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991695872 00000100:00100000:3.0:1746127005.201826:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991695872 00000100:00100000:3.0:1746127005.201841:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21701 00000100:00100000:3.0:1746127005.201848:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991695744:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.201863:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127005.201870:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21702 00010000:00010000:3.0:1746127005.201876:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a45800/0x34dc807b6efa127 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5342b expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127005.201876:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991695872:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127005.201881:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.201887:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6efa12e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53432 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.201914:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994272384:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127005.201914:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994272512:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127005.202335:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.202441:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.203908:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994272384:192.168.203.42@tcp:106: 00002000:00010000:2.0:1746127005.203910:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime: 1746127002 -> 1746127003 00002000:00010000:2.0:1746127005.203914:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746127002 -> 1746127003 00002000:00010000:2.0:1746127005.203916:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime: 1746127002 -> 1746127003 00000100:00100000:2.0:1746127005.203924:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994272512:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.203930:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a45800/0x34dc807b6efa127 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5342b expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.203939:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6efa12e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53432 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.203942:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a45800/0x34dc807b6efa127 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5342b expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.203948:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6efa12e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53432 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.203963:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e2400, rc 0) 00010000:00010000:3.0:1746127005.203971:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a45800, rc 0) 00000100:00100000:2.0:1746127005.203994:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991695872:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2117us (2249us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.204001:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21702 00000100:00100000:3.0:1746127005.205003:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991695744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2146us (2303us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.205359:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21701 00000100:00100000:1.0:1746127005.208245:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.208313:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.208691:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991696000 00000100:00100000:3.0:1746127005.208698:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991696000 00000100:00100000:3.0:1746127005.208739:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991696128 00000100:00100000:3.0:1746127005.208742:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991696128 00000100:00100000:3.0:1746127005.208756:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21703 00000100:00100000:3.0:1746127005.208763:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991696000:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.208777:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.208791:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a44e00/0x34dc807b6efa135 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53439 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.208833:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994272640:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.208888:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.208891:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21704 00000100:00100000:0.0:1746127005.208899:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991696128:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127005.208907:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.208919:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6efa13c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53440 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127005.208947:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994272768:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127005.208970:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.211006:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994272640:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.211030:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a44e00/0x34dc807b6efa135 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53439 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.211051:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a44e00/0x34dc807b6efa135 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53439 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.211060:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44e00, rc 0) 00000100:00100000:3.0:1746127005.211797:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991696000:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3032us (3555us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.211806:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21703 00000100:00100000:0.0:1746127005.213473:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994272768:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127005.213499:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6efa13c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53440 expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.213511:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2400/0x34dc807b6efa13c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53440 expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.214079:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e2400, rc 0) 00000100:00100000:0.0:1746127005.214317:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991696128:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5416us (6022us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127005.214324:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21704 00000100:00100000:0.0:1746127005.216262:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.216912:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991696384 00000100:00100000:1.0:1746127005.216920:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991696384 00000100:00100000:1.0:1746127005.216961:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17294 00000100:00100000:1.0:1746127005.216967:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4354:x1830945991696384:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127005.216984:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.216998:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfda00/0x34dc807b6efa143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53447 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.217061:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217071:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217079:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217088:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217092:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217097:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217187:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217195:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217200:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127005.217206:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127005.217253:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217258:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217263:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217267:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbfce00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127005.217270:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217274:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217281:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127005.217283:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127005.217286:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217290:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfce00/0x34dc807b6efa14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217314:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217319:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217323:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217326:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbfdc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127005.217328:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217331:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217336:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880122059700) 00010000:00010000:1.0:1746127005.217337:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127005.217339:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217342:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfdc00/0x34dc807b6efa151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.217649:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfda00/0x34dc807b6efa143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 46 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.217660:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 45 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.217666:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.217668:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127005.217670:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45600, rc 0) 00000100:00100000:1.0:1746127005.217713:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4354:x1830945991696384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 746us (1454us total) trans 8589938241 rc 0/0 00000100:00100000:1.0:1746127005.217718:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17294 00000100:00100000:0.0:1746127005.217885:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.217928:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991696640 00000100:00100000:1.0:1746127005.217932:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991696640 00000100:00100000:1.0:1746127005.217968:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21705 00000100:00100000:1.0:1746127005.217973:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991696640:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127005.217982:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.217991:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efa166 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53455 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.218025:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994272896:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127005.218067:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.218098:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.218368:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991696512 00000100:00100000:3.0:1746127005.218372:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991696512 00000100:00100000:3.0:1746127005.218672:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21706 00000100:00100000:3.0:1746127005.218679:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991696512:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.218685:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.218692:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a44600/0x34dc807b6efa16d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5344e expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.218714:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273024:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.218768:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746127005.220566:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994272896:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127005.220587:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efa166 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53455 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.220598:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efa166 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53455 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.220606:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44e00, rc 0) 00000100:00100000:1.0:1746127005.220650:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991696640:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2676us (2765us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127005.220656:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21705 00000100:00100000:0.0:1746127005.222165:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.222260:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991696896 00000100:00100000:2.0:1746127005.222267:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991696896 00000100:00100000:2.0:1746127005.222295:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6594 00000100:00100000:2.0:1746127005.222300:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4354:x1830945991696896:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127005.222439:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4354:x1830945991696896:12345-192.168.203.42@tcp:35:cat.0 Request processed in 138us (277us total) trans 8589938242 rc 0/0 00000100:00100000:2.0:1746127005.222443:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6594 00000100:00100000:3.0:1746127005.222600:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273024:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.222619:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a44600/0x34dc807b6efa16d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5344e expref: 9 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.222628:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a44600/0x34dc807b6efa16d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5344e expref: 9 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.222637:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44600, rc 0) 00000100:00100000:3.0:1746127005.222654:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991696512:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3977us (4588us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.222659:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21706 00000100:00100000:0.0:1746127005.226452:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.226560:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991697024 00000100:00100000:3.0:1746127005.226567:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991697024 00000100:00100000:3.0:1746127005.226684:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21707 00000100:00100000:3.0:1746127005.226692:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991697024:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.226708:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.226722:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5345c expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.226743:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.226744:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.226751:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 43 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.226764:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 43 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.226772:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44000, rc 0) 00000100:00100000:3.0:1746127005.227020:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991697024:12345-192.168.203.42@tcp:101:cat.0 Request processed in 328us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.227026:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21707 00000100:00100000:0.0:1746127005.237293:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.238708:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991697280 00000100:00100000:1.0:1746127005.238718:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991697280 00000100:00100000:1.0:1746127005.238769:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17295 00000100:00100000:1.0:1746127005.238776:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4356:x1830945991697280:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127005.238796:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.238810:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa17b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53463 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.238868:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238877:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238885:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238895:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238899:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238904:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238978:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfda00/0x34dc807b6efa190 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238985:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfda00/0x34dc807b6efa190 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.238990:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfda00/0x34dc807b6efa190 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127005.239000:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127005.239065:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239071:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239076:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239080:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f45400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127005.239083:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239087:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239096:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127005.239098:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127005.239101:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239106:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45400/0x34dc807b6efa182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239143:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239148:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239153:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239160:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f44e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127005.239162:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239166:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239172:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880122059e00) 00010000:00010000:1.0:1746127005.239174:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127005.239176:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239180:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44e00/0x34dc807b6efa189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.239208:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f44a00/0x34dc807b6efa17b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53463 expref: 26 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.239215:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfda00/0x34dc807b6efa190 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53463 expref: 25 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.239220:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.239222:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127005.239224:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfda00, rc 0) 00000100:00100000:1.0:1746127005.239268:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4356:x1830945991697280:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 493us (1981us total) trans 8589938243 rc 0/0 00000100:00100000:1.0:1746127005.239274:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17295 00000100:00100000:0.0:1746127005.239441:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.239523:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.239548:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.239562:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991697664 00000100:00100000:0.0:1746127005.239566:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991697664 00002000:00100000:0.0:1746127005.239588:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1667071) req@ffff8800a2fca680 x1830945991697664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.239597:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fca680 with x1830945991697664 ext(1048576->1667071) 00002000:00010000:0.0:1746127005.239601:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fca680 00000100:00100000:0.0:1746127005.239610:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8668 00000100:00100000:0.0:1746127005.239615:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991697664:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127005.240113:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991697792 00000100:00100000:3.0:1746127005.240117:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991697792 00002000:00100000:3.0:1746127005.240153:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1249280->2097151) req@ffff8800a2fc9180 x1830945991697792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.240160:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9180 with x1830945991697792 ext(1249280->2097151) 00002000:00010000:3.0:1746127005.240163:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9180 00000100:00100000:3.0:1746127005.240178:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991698048 00000100:00100000:3.0:1746127005.240180:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991698048 00002000:00100000:3.0:1746127005.240192:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009da76680 x1830945991698048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.240198:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da76680 with x1830945991698048 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.240201:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da76680 00000100:00100000:3.0:1746127005.240211:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8669 00000100:00100000:3.0:1746127005.240222:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945991697792:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127005.240666:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8670 00000100:00100000:3.0:1746127005.240672:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991698048:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127005.246801:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.246848:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991698176 00000100:00100000:2.0:1746127005.246857:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991698176 00000100:00100000:2.0:1746127005.246899:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1024 00000100:00100000:2.0:1746127005.246905:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991698176:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.246916:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.246938:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfda00/0x34dc807b6efa190 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53463 expref: 25 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.246953:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127005.246958:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.247187:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991698176:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 280us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.247194:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1024 00000100:00100000:2.0:1746127005.251976:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945991697664:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12353us (12527us total) trans 0 rc 618496/618496 00000100:00100000:2.0:1746127005.251986:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8668 00002000:00100000:2.0:1746127005.251996:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1667071) req@ffff8800a2fca680 x1830945991697664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.252004:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fca680 with x1830945991697664 ext(1048576->1667071) 00002000:00010000:2.0:1746127005.252009:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fca680 00000100:00100000:3.0:1746127005.254009:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991697792:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13786us (14479us total) trans 0 rc 847872/847872 00000100:00100000:3.0:1746127005.254019:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8669 00002000:00100000:3.0:1746127005.254029:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1249280->2097151) req@ffff8800a2fc9180 x1830945991697792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.254182:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9180 with x1830945991697792 ext(1249280->2097151) 00002000:00010000:3.0:1746127005.254187:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9180 00000100:00100000:3.0:1746127005.256337:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991698048:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15659us (16782us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127005.256346:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8670 00002000:00100000:3.0:1746127005.256355:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009da76680 x1830945991698048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.256362:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da76680 with x1830945991698048 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.256366:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da76680 00000100:00100000:0.0:1746127005.312519:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.312625:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991698432 00000100:00100000:3.0:1746127005.312633:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991698432 00000100:00100000:3.0:1746127005.312682:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17296 00000100:00100000:3.0:1746127005.312689:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4361:x1830945991698432:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.312710:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.312725:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a44600/0x34dc807b6efa19e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5346a expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.312784:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312795:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312804:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312815:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312819:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312824:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312894:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45e00/0x34dc807b6efa1b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312902:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45e00/0x34dc807b6efa1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312907:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45e00/0x34dc807b6efa1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127005.312914:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127005.312965:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312974:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312979:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312984:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312989:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a45600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.312992:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.312997:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313005:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127005.313008:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.313011:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313016:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45600/0x34dc807b6efa1a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313163:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313169:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313173:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313177:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a45800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.313179:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313183:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313190:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58a900) 00010000:00010000:3.0:1746127005.313192:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.313194:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313199:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45800/0x34dc807b6efa1ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.313227:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a44600/0x34dc807b6efa19e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5346a expref: 49 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.313237:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45e00/0x34dc807b6efa1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5346a expref: 48 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.313243:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.313245:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127005.313246:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a45e00, rc 0) 00000100:00100000:3.0:1746127005.313295:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4361:x1830945991698432:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 606us (782us total) trans 8589938244 rc 0/0 00000100:00100000:3.0:1746127005.313301:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17296 00000100:00100000:0.0:1746127005.325080:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.325241:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.325339:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991698688 00000100:00100000:2.0:1746127005.325349:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991698688 00000100:00100000:2.0:1746127005.325410:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6595 00000100:00100000:2.0:1746127005.325417:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4361:x1830945991698688:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127005.325526:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991698816 00000100:00100000:1.0:1746127005.325537:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991698816 00000100:00100000:1.0:1746127005.325603:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1025 00000100:00100000:1.0:1746127005.325610:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991698816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127005.325626:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4361:x1830945991698688:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 208us (554us total) trans 8589938245 rc 0/0 00010000:00010000:1.0:1746127005.325626:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127005.325634:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6595 00010000:00010000:1.0:1746127005.325648:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a45e00/0x34dc807b6efa1b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5346a expref: 49 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.325670:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.325674:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.325714:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991698816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 104us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.325720:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1025 00000100:00100000:0.0:1746127005.449629:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.449697:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991698944 00000100:00100000:3.0:1746127005.449704:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991698944 00000100:00100000:3.0:1746127005.449744:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21708 00000100:00100000:3.0:1746127005.449752:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4361:x1830945991698944:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.449769:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.449784:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53471 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.449806:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 44 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.449814:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 33 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.449819:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.449820:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.449823:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 44 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.449847:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 33 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.449856:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 33 pid: 16295 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.449865:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994273152:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.449936:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 44 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.449944:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 44 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.449958:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994273280:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.449974:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.464783:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.464874:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991699072 00000100:00100000:1.0:1746127005.464880:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991699072 00000100:00100000:3.0:1746127005.464881:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994273152:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.464890:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994273280:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127005.464910:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 34 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.464917:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 44 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.464929:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096620400, rc 0) 00000100:00100000:1.0:1746127005.464937:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10164 00000100:00100000:1.0:1746127005.464944:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991699072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.464955:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127005.464962:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4361:x1830945991698944:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 15211us (15337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.464969:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21708 00010000:00010000:1.0:1746127005.464971:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 34 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.464981:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 34 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.464997:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efa06a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533d0 expref: 34 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.465273:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.465300:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991699072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 356us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.465306:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10164 00000100:00100000:0.0:1746127005.467704:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.467917:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991699200 00000100:00100000:1.0:1746127005.467925:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991699200 00010000:00010000:1.0:1746127005.467951:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 44 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.467974:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10165 00000100:00100000:1.0:1746127005.467980:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991699200:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.467992:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.468007:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 44 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.468017:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 44 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.468047:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007602ec00/0x34dc807b6efa02b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e533b4 expref: 44 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.468058:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.468060:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.468066:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.468078:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.468105:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.468116:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994273408:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127005.468631:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77000 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.469767:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.469863:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991699328 00000100:00100000:3.0:1746127005.469869:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991699328 00000100:00100000:3.0:1746127005.469964:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21709 00000100:00100000:3.0:1746127005.469971:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4356:x1830945991699328:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.469985:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.469998:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53478 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.470020:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 9 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.470028:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 29 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.470049:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.470050:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.470054:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3194880->4194303] (req 3194880->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.470075:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 29 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.470084:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 29 pid: 1507 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.470093:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273536:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.470188:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 9 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.470196:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 9 pid: 9613 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.470203:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273664:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.470221:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.475462:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.475499:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.475520:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991699456 00000100:00100000:0.0:1746127005.475526:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991699456 00000100:00100000:1.0:1746127005.475532:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991699584 00000100:00100000:1.0:1746127005.475536:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991699584 00010000:00010000:1.0:1746127005.475549:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 10 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.475550:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.475562:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273536:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.475572:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10166 00000100:00100000:1.0:1746127005.475576:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10167 00000100:00100000:0.0:1746127005.475577:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991699456:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127005.475579:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991699584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127005.475585:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273664:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127005.475587:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127005.475588:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.475599:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 10 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.475600:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.475606:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 8 type: EXT [3194880->4194303] (req 3194880->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 10 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.475606:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 10 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.475614:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.475629:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7800/0x34dc807b6ef9f8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53360 expref: 10 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.475635:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a46000/0x34dc807b6efa00f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53391 expref: 30 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.475639:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.475642:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.475647:0:1507:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.475658:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.475666:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127005.475666:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127005.475680:0:1507:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.475689:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273792:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127005.475692:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991699584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 112us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.475693:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991699456:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 116us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.475696:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10167 00000100:00100000:0.0:1746127005.475699:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10166 00000100:00100000:3.0:1746127005.475733:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.480013:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.480158:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994273408:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127005.480176:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.480213:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991699200:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 12233us (12795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.480223:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10165 00000100:00100000:2.0:1746127005.480313:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991699712 00000100:00100000:2.0:1746127005.480320:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991699712 00000100:00100000:2.0:1746127005.480364:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21710 00000100:00100000:2.0:1746127005.480371:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4361:x1830945991699712:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127005.480385:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.480398:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5347f expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.480422:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.480429:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.480432:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.480435:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->2711551] (req 2097152->2711551) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 30 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.480459:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.480470:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.480480:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994273920:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.480533:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.480936:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994273792:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.480947:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e982e00, rc 0) 00000100:00100000:2.0:1746127005.481006:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4356:x1830945991699328:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 11035us (11241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.481019:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21709 00000100:00100000:0.0:1746127005.481808:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.481936:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991699968 00000100:00100000:3.0:1746127005.481940:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991699968 00000100:00100000:3.0:1746127005.482113:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17297 00000100:00100000:3.0:1746127005.482120:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4364:x1830945991699968:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.482155:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.482169:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982000/0x34dc807b6efa1d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53486 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.482430:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482440:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482453:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482465:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482469:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482474:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482547:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa1eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482556:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa1eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482562:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa1eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127005.482570:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127005.482620:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482626:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482630:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482635:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482640:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.482643:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482649:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482657:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127005.482660:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.482663:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482668:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982800/0x34dc807b6efa1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482690:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482695:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482699:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482703:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.482705:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482709:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482714:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b48c7c00) 00010000:00010000:3.0:1746127005.482716:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.482718:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482725:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa1e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.482751:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982000/0x34dc807b6efa1d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53486 expref: 27 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.482759:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa1eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53486 expref: 26 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.482765:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.482767:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127005.482769:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983600, rc 0) 00000100:00100000:3.0:1746127005.482805:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4364:x1830945991699968:12345-192.168.203.42@tcp:101:cat.0 Request processed in 686us (999us total) trans 8589938246 rc 0/0 00000100:00100000:3.0:1746127005.482811:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17297 00000100:00100000:2.0:1746127005.483315:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.483428:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991700224 00000100:00100000:3.0:1746127005.483432:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991700224 00002000:00100000:3.0:1746127005.483455:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3194880->3198975) req@ffff88009d1b5880 x1830945991700224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.483463:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5880 with x1830945991700224 ext(3194880->3198975) 00010000:00010000:3.0:1746127005.483469:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.483479:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746127005.483485:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b5880 00000100:00100000:3.0:1746127005.483511:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1914 00000100:00100000:3.0:1746127005.483516:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991700224:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127005.483609:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991700224:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 93us (294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127005.483614:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1914 00002000:00100000:3.0:1746127005.483619:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3194880->3198975) req@ffff88009d1b5880 x1830945991700224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.483625:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5880 with x1830945991700224 ext(3194880->3198975) 00010000:00010000:3.0:1746127005.483629:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.483638:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746127005.483642:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b5880 00000100:00100000:2.0:1746127005.484170:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994273920:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.484190:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->2711551] (req 2097152->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 30 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.484210:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2200, rc 0) 00000100:00100000:2.0:1746127005.484232:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4361:x1830945991699712:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3862us (4228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.484238:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21710 00000100:00100000:0.0:1746127005.484810:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.484896:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991700352 00000100:00100000:1.0:1746127005.484901:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991700352 00000100:00100000:1.0:1746127005.484933:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1026 00000100:00100000:1.0:1746127005.484938:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991700352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.484947:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.484961:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa1eb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53486 expref: 26 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.484981:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.484984:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.485002:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991700352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.485008:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1026 00000100:00100000:2.0:1746127005.486854:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.486957:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991700608 00000100:00100000:0.0:1746127005.486963:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991700608 00000100:00100000:0.0:1746127005.486998:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6596 00000100:00100000:0.0:1746127005.487004:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4364:x1830945991700608:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746127005.487188:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4364:x1830945991700608:12345-192.168.203.42@tcp:35:cat.0 Request processed in 184us (338us total) trans 8589938247 rc 0/0 00000100:00100000:0.0:1746127005.487194:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6596 00000100:00100000:0.0:1746127005.495175:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.495282:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991700864 00000100:00100000:2.0:1746127005.495292:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991700864 00002000:00100000:2.0:1746127005.495327:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (4190208->4194303) req@ffff88009da76a00 x1830945991700864/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.495334:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da76a00 with x1830945991700864 ext(4190208->4194303) 00010000:00010000:2.0:1746127005.495341:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.495350:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746127005.495355:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009da76a00 00000100:00100000:2.0:1746127005.495520:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1915 00000100:00100000:2.0:1746127005.495528:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991700864:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127005.495668:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991700864:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 140us (503us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127005.495674:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1915 00002000:00100000:2.0:1746127005.495679:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (4190208->4194303) req@ffff88009da76a00 x1830945991700864/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.495686:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da76a00 with x1830945991700864 ext(4190208->4194303) 00010000:00010000:2.0:1746127005.495690:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.495699:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 8 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746127005.495704:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009da76a00 00000100:00100000:0.0:1746127005.499502:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.499825:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991700992 00000100:00100000:2.0:1746127005.499833:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991700992 00000100:00100000:2.0:1746127005.499877:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21711 00000100:00100000:2.0:1746127005.499884:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991700992:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127005.499899:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.499913:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6efa1f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5348d expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.499952:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994274048:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127005.500043:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.500580:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.500695:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.500738:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991701120 00000100:00100000:3.0:1746127005.500742:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991701120 00000100:00100000:0.0:1746127005.500749:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991701248 00000100:00100000:0.0:1746127005.500752:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991701248 00000100:00100000:3.0:1746127005.500774:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21712 00000100:00100000:0.0:1746127005.500778:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21713 00000100:00100000:3.0:1746127005.500779:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991701120:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127005.500782:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991701248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.500785:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.500788:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.500792:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa200 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53494 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.500795:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d9e2600/0x34dc807b6efa207 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5349b expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.500815:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994274176:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127005.500815:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994274304:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.500861:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.500897:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.503572:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.503628:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991701504 00000100:00100000:3.0:1746127005.503635:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991701504 00002000:00100000:3.0:1746127005.503670:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3194880->4194303) req@ffff8800997d9500 x1830945991701504/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.503679:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9500 with x1830945991701504 ext(3194880->4194303) 00010000:00010000:3.0:1746127005.503687:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 12 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.503700:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 12 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746127005.503707:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800997d9500 00000100:00100000:3.0:1746127005.503738:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1916 00000100:00100000:3.0:1746127005.503745:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991701504:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127005.508378:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:2.0:1746127005.508505:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127003 -> 1746127004 00002000:00010000:2.0:1746127005.508509:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127003 -> 1746127004 00000100:00100000:2.0:1746127005.508523:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994274048:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.508549:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6efa1f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5348d expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.508560:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2600/0x34dc807b6efa1f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5348d expref: 13 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.508573:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2600, rc 0) 00000100:00100000:2.0:1746127005.508606:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991700992:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8723us (9110us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.508613:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21711 00002000:00010000:2.0:1746127005.508658:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime: 1746127003 -> 1746127004 00002000:00010000:2.0:1746127005.508660:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime: 1746127003 -> 1746127004 00000100:00100000:2.0:1746127005.508667:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994274176:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.508682:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa200 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53494 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.508690:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa200 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53494 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.508697:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e982200, rc 0) 00000100:00100000:2.0:1746127005.508717:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991701120:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7938us (8138us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.508722:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21712 00002000:00010000:1.0:1746127005.508835:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127003 -> 1746127004 00002000:00010000:1.0:1746127005.508839:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127003 -> 1746127004 00000100:00100000:1.0:1746127005.508855:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994274304:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.508871:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991701760 00000100:00100000:3.0:1746127005.508876:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991701760 00010000:00010000:1.0:1746127005.508897:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011d9e2600/0x34dc807b6efa207 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5349b expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127005.508904:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6597 00010000:00010000:1.0:1746127005.508908:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e2600/0x34dc807b6efa207 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5349b expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127005.508910:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4356:x1830945991701760:12345-192.168.203.42@tcp:35:multiop.0 00010000:00010000:1.0:1746127005.508918:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e2600, rc 0) 00000100:00100000:1.0:1746127005.509048:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991701248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8263us (8351us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127005.509054:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21713 00000100:00100000:3.0:1746127005.509513:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4356:x1830945991701760:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 601us (1140us total) trans 8589938248 rc 0/0 00000100:00100000:3.0:1746127005.509519:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6597 00000100:00100000:0.0:1746127005.519507:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.520440:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991701888 00000100:00100000:1.0:1746127005.520449:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991701888 00000100:00100000:1.0:1746127005.520485:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21714 00000100:00100000:1.0:1746127005.520746:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4364:x1830945991701888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127005.520760:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.520772:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534a2 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.520797:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.520804:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127005.520805:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127005.520808:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 11 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.520830:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 29 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.520840:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 29 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.520850:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994274432:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127005.521466:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77000 going to sleep for 11 seconds 00000100:00100000:1.0:1746127005.524223:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994274432:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127005.524245:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 13 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.524260:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfc200, rc 0) 00000100:00100000:1.0:1746127005.524303:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4364:x1830945991701888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3559us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.524310:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21714 00000100:00100000:0.0:1746127005.524907:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.524965:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991702016 00000100:00100000:2.0:1746127005.524970:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991702016 00002000:00100000:2.0:1746127005.525028:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1667072->2097151) req@ffff88009cd67800 x1830945991702016/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.525045:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67800 with x1830945991702016 ext(1667072->2097151) 00010000:00010000:2.0:1746127005.525051:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 30 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.525060:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 30 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746127005.525071:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd67800 00000100:00100000:2.0:1746127005.525087:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1917 00000100:00100000:2.0:1746127005.525093:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991702016:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127005.525717:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991701504:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 21971us (22149us total) trans 17179875611 rc 0/0 00000100:00100000:3.0:1746127005.525723:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1916 00002000:00100000:3.0:1746127005.525729:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3194880->4194303) req@ffff8800997d9500 x1830945991701504/t17179875611(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.525742:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997d9500 with x1830945991701504 ext(3194880->4194303) 00010000:00010000:3.0:1746127005.525747:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 11 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.525754:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 11 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746127005.525760:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800997d9500 00000100:00100000:0.0:1746127005.529543:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.529595:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.529623:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991702144 00000100:00100000:0.0:1746127005.529631:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991702144 00010000:00010000:0.0:1746127005.529700:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 11 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.529730:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10168 00000100:00100000:0.0:1746127005.529738:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991702144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127005.529752:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746127005.529769:0:7245:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127003 -> 1746127004 00002000:00010000:0.0:1746127005.529772:0:7245:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127003 -> 1746127004 00010000:00010000:0.0:1746127005.529777:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 11 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.529787:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 11 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.529812:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e982e00/0x34dc807b6efa1c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53478 expref: 11 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.529830:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.529833:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.529839:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 31 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.529845:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 31 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.529872:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 31 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127005.529881:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994274560:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127005.529948:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.530690:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991702400 00000100:00100000:3.0:1746127005.530700:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991702400 00000100:00100000:3.0:1746127005.530749:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17298 00000100:00100000:3.0:1746127005.530756:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4368:x1830945991702400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.530779:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.530794:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983200/0x34dc807b6efa215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534a9 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.530847:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530857:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530870:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530880:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530885:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530891:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530947:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa22a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530954:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa22a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.530959:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa22a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127005.530965:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127005.530997:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531002:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531007:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531012:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531016:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e983600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.531019:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531024:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531031:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127005.531033:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.531047:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531052:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983600/0x34dc807b6efa21c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531063:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531067:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531071:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531074:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e983a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.531076:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531079:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531084:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b8e7100) 00010000:00010000:3.0:1746127005.531085:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.531087:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531091:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa223 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.531114:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983200/0x34dc807b6efa215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a9 expref: 51 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.531123:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa22a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a9 expref: 50 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.531146:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.531148:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127005.531150:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e982200, rc 0) 00000100:00100000:3.0:1746127005.531198:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4368:x1830945991702400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 443us (1665us total) trans 8589938249 rc 0/0 00000100:00100000:3.0:1746127005.531204:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17298 00000100:00100000:3.0:1746127005.533523:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991702016:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8425us (8611us total) trans 17179875612 rc 0/0 00000100:00100000:3.0:1746127005.533540:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1917 00002000:00100000:3.0:1746127005.533550:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1667072->2097151) req@ffff88009cd67800 x1830945991702016/t17179875612(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.533558:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd67800 with x1830945991702016 ext(1667072->2097151) 00010000:00010000:3.0:1746127005.533568:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 32 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.533583:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 32 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746127005.533589:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd67800 00000100:00100000:0.0:1746127005.533885:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.533909:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.533932:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991702528 00000100:00100000:0.0:1746127005.533937:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991702528 00000100:00100000:0.0:1746127005.533960:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1027 00000100:00100000:0.0:1746127005.533965:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991702528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127005.533974:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127005.533988:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa22a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a9 expref: 50 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.534004:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127005.534007:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127005.534020:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2027:x1830945991702528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.534025:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1027 00000100:00100000:3.0:1746127005.534111:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991702784 00000100:00100000:3.0:1746127005.534114:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991702784 00000100:00100000:3.0:1746127005.534147:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6598 00000100:00100000:3.0:1746127005.534151:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:4368:x1830945991702784:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127005.534250:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4368:x1830945991702784:12345-192.168.203.42@tcp:35:cat.0 Request processed in 99us (340us total) trans 8589938250 rc 0/0 00000100:00100000:3.0:1746127005.534256:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6598 00000100:00100000:2.0:1746127005.534601:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994274560:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.534614:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.534977:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991702144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5238us (5379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.534983:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10168 00000100:00100000:0.0:1746127005.538926:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.539578:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991703040 00000100:00100000:3.0:1746127005.539589:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991703040 00002000:00100000:3.0:1746127005.539637:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2707456->2711551) req@ffff88009cc3d880 x1830945991703040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.539647:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3d880 with x1830945991703040 ext(2707456->2711551) 00002000:00010000:3.0:1746127005.539653:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3d880 00000100:00100000:3.0:1746127005.539687:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8671 00000100:00100000:3.0:1746127005.539695:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991703040:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127005.539850:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991703040:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 155us (933us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127005.539857:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8671 00002000:00100000:3.0:1746127005.539862:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2707456->2711551) req@ffff88009cc3d880 x1830945991703040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.539870:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3d880 with x1830945991703040 ext(2707456->2711551) 00002000:00010000:3.0:1746127005.539873:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3d880 00000100:00100000:0.0:1746127005.539954:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.540178:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.540212:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991703296 00000100:00100000:1.0:1746127005.540219:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991703296 00000100:00100000:1.0:1746127005.540276:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21715 00000100:00100000:1.0:1746127005.540285:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991703296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127005.540299:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.540312:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6efa238 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534b0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.540357:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994274688:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127005.540371:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991703168 00000100:00100000:2.0:1746127005.540376:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991703168 00010000:00010000:2.0:1746127005.540395:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 34 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.540417:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77000 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.540423:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10169 00000100:00100000:2.0:1746127005.540428:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991703168:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.540437:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.540451:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 34 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.540462:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 34 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.540482:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.540484:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.540491:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.540500:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.540535:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.540546:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994274816:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127005.540589:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00010000:00010000:1.0:1746127005.541686:0:1507:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff88009c74ad80 x1830945994274688) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 34 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.541713:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e3e00/0x34dc807b6efa112 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1667072->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53416 expref: 34 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.541728:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994274688:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127005.541748:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6efa238 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b0 expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.541758:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc800/0x34dc807b6efa238 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b0 expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.541765:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfc800, rc 0) 00000100:00100000:1.0:1746127005.541801:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991703296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1517us (1630us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127005.541808:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21715 00000100:00100000:2.0:1746127005.545253:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994274816:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.545267:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.545320:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991703168:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4888us (5364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.545328:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10169 00000100:00100000:0.0:1746127005.546180:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.546270:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991703552 00000100:00100000:3.0:1746127005.546279:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991703552 00002000:00100000:3.0:1746127005.546321:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd7480 x1830945991703552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.546331:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7480 with x1830945991703552 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.546335:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd7480 00000100:00100000:3.0:1746127005.546361:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8672 00000100:00100000:3.0:1746127005.546367:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991703552:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127005.551602:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.553097:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991703680 00000100:00100000:2.0:1746127005.553106:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991703680 00000100:00100000:2.0:1746127005.553185:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21716 00000100:00100000:2.0:1746127005.553192:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4368:x1830945991703680:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127005.553206:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.553219:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534b7 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.553240:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.553242:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.553248:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.553261:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.553281:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb2400, rc 0) 00000100:00100000:2.0:1746127005.553333:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4368:x1830945991703680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 141us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.553339:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21716 00000100:00100000:0.0:1746127005.553836:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.553877:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991703808 00000100:00100000:1.0:1746127005.553881:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991703808 00000100:00100000:1.0:1746127005.553924:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17299 00000100:00100000:1.0:1746127005.553930:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4370:x1830945991703808:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127005.553941:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.553951:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfca00/0x34dc807b6efa246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534be expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.553997:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.554006:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.554013:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00080000:0.0:1746127005.554017:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746127005.554024:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.554029:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.554048:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.554103:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.554113:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 49 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.554118:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127005.554165:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 49 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.554175:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 49 pid: 7260 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.554692:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994274944:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127005.554761:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127005.557316:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994274944:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127005.557345:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127005.557395:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991703552:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11026us (11220us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127005.557403:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8672 00002000:00100000:3.0:1746127005.557418:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd7480 x1830945991703552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.557426:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7480 with x1830945991703552 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.557430:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd7480 00000100:00100000:0.0:1746127005.557801:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.557929:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991704064 00000100:00100000:1.0:1746127005.557934:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991704064 00000100:00100000:1.0:1746127005.557973:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6599 00000100:00100000:1.0:1746127005.557979:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:30904:x1830945991704064:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746127005.558398:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:30904:x1830945991704064:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 419us (596us total) trans 8589938251 rc 0/0 00000100:00100000:1.0:1746127005.558405:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6599 00000100:00100000:0.0:1746127005.559859:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.560528:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991704320 00000100:00100000:3.0:1746127005.560536:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991704320 00002000:00100000:3.0:1746127005.560569:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a76680 x1830945991704320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.560578:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76680 with x1830945991704320 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.560582:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a76680 00000100:00100000:3.0:1746127005.560614:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8673 00000100:00100000:3.0:1746127005.560620:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991704320:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127005.566106:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.566380:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.566507:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991704448 00000100:00100000:3.0:1746127005.566514:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991704448 00000100:00100000:3.0:1746127005.566553:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21717 00000100:00100000:3.0:1746127005.566561:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4364:x1830945991704448:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.566577:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127005.566684:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991704576 00000100:00100000:2.0:1746127005.566687:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991704576 00010000:00010000:2.0:1746127005.566707:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 51 pid: 7260 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.566726:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10170 00000100:00100000:2.0:1746127005.566730:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2027:x1830945991704576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.566740:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.566745:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 51 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.566754:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 51 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.566770:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efa0da lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53401 expref: 51 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.566796:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127005.566800:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.566808:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.566815:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.566830:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127005.566841:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566847:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:2.0:1746127005.566861:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991704576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 131us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.566866:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10170 00000004:00200000:0.0:1746127005.566886:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746127005.566889:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746127005.566901:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566909:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.566910:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534c5 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.566916:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566922:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.566926:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.566927:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.566932:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127005.566932:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dcfde00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.566934:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127005.566935:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.566937:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 11 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.566940:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566947:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127005.566949:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127005.566952:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566956:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfde00/0x34dc807b6efa24d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.566957:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.566966:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 33 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.566967:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566972:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127005.566976:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994275072:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127005.566976:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566980:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dcfd200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127005.566982:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566989:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.566994:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880122059d00) 00010000:00010000:0.0:1746127005.566996:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127005.566997:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.567001:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfd200/0x34dc807b6efa254 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127005.567017:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746127005.567025:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcfca00/0x34dc807b6efa246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.567048:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 9 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.567055:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127005.567057:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746127005.567059:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e981800, rc 0) 00000100:00100000:0.0:1746127005.567080:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4370:x1830945991703808:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 13151us (13246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.567085:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17299 00000100:00100000:3.0:1746127005.567578:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991704320:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6957us (7722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127005.567586:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8673 00002000:00100000:3.0:1746127005.567593:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a76680 x1830945991704320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.567601:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76680 with x1830945991704320 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.567604:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a76680 00000100:00100000:0.0:1746127005.569097:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.569174:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991704704 00000100:00100000:2.0:1746127005.569179:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991704704 00002000:00100000:2.0:1746127005.569205:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1249279) req@ffff880130a77100 x1830945991704704/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.569213:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77100 with x1830945991704704 ext(1048576->1249279) 00010000:00010000:2.0:1746127005.569218:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 32 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.569228:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 32 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746127005.569234:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a77100 00000100:00100000:2.0:1746127005.569246:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1918 00000100:00100000:2.0:1746127005.569251:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991704704:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127005.569570:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994275072:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.569589:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 11 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.569603:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de0ce00, rc 0) 00000100:00100000:3.0:1746127005.569874:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4364:x1830945991704448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3313us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.569880:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21717 00000100:00100000:0.0:1746127005.572325:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.572861:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.572950:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.572967:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991704832 00000100:00100000:2.0:1746127005.572974:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991704832 00000100:00100000:2.0:1746127005.573124:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991704960 00000100:00100000:2.0:1746127005.573140:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991704960 00000100:00100000:1.0:1746127005.573168:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991705088 00000100:00100000:1.0:1746127005.573171:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991705088 00000100:00100000:1.0:1746127005.573184:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21718 00000100:00100000:1.0:1746127005.573192:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991704832:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127005.573206:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.573218:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534cc expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.573234:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.573235:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.573242:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.573258:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127005.573329:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21719 00000100:00100000:2.0:1746127005.573334:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991704960:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127005.573341:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.573347:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efa270 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534d3 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.573354:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.573363:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991705216 00000100:00100000:3.0:1746127005.573365:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991705216 00000100:00100000:2.0:1746127005.573378:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994275200:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.573379:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21720 00000100:00100000:3.0:1746127005.573383:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991705216:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127005.573389:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.573396:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa277 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534e1 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.573416:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994275328:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127005.573425:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.573433:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746127005.573652:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e980600, rc 0) 00000100:00100000:1.0:1746127005.573676:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991704832:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 486us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.573682:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21718 00000100:00100000:1.0:1746127005.573715:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21721 00000100:00100000:1.0:1746127005.573719:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991705088:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127005.573725:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127005.573831:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.573853:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.573883:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991704704:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4630us (4789us total) trans 17179875613 rc 0/0 00000100:00100000:0.0:1746127005.573891:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1918 00002000:00100000:0.0:1746127005.573898:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1249279) req@ffff880130a77100 x1830945991704704/t17179875613(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.573906:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77100 with x1830945991704704 ext(1048576->1249279) 00010000:00010000:0.0:1746127005.573911:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 34 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.573922:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 34 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:0.0:1746127005.573927:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a77100 00000100:00100000:0.0:1746127005.573943:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991705344 00000100:00100000:0.0:1746127005.573945:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991705344 00000100:00100000:0.0:1746127005.573958:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991705472 00000100:00100000:0.0:1746127005.573960:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991705472 00010000:00010000:1.0:1746127005.574065:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534da expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.574077:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.574078:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.574083:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.574092:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.574098:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e981c00, rc 0) 00000100:00100000:1.0:1746127005.574114:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991705088:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 394us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.574118:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21721 00000100:00100000:1.0:1746127005.574148:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21722 00000100:00100000:1.0:1746127005.574153:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4368:x1830945991705344:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127005.574159:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.574164:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534e8 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.574175:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127005.574178:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.574185:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.574191:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e980800, rc 0) 00000100:00100000:1.0:1746127005.574204:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4368:x1830945991705344:12345-192.168.203.42@tcp:101:cat.0 Request processed in 51us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.574208:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21722 00000100:00100000:0.0:1746127005.574212:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21723 00000100:00100000:0.0:1746127005.574217:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991705472:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127005.574223:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.574229:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6efa28c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534ef expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127005.574291:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994275456:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127005.574315:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00002000:00010000:2.0:1746127005.575933:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746127003 -> 1746127004 00000100:00100000:2.0:1746127005.575950:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994275200:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.575971:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efa270 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534d3 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.575981:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efa270 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534d3 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.576003:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8800, rc 0) 00000100:00100000:2.0:1746127005.576053:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991704960:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2717us (3192us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.576059:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21719 00002000:00010000:3.0:1746127005.576190:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127003 -> 1746127004 00000100:00100000:3.0:1746127005.576202:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994275328:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.576355:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa277 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e1 expref: 15 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.576363:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa277 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e1 expref: 15 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.576383:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7200, rc 0) 00000100:00100000:3.0:1746127005.576404:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991705216:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3019us (3049us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.576408:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21720 00002000:00010000:2.0:1746127005.577783:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127002 -> 1746127004 00000100:00100000:2.0:1746127005.577797:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994275456:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.577817:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6efa28c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534ef expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.577825:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011d9e2200/0x34dc807b6efa28c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534ef expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.577832:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e2200, rc 0) 00000100:00100000:2.0:1746127005.578172:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991705472:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3953us (4316us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.578179:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21723 00000100:00100000:0.0:1746127005.580021:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.580091:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991705600 00000100:00100000:2.0:1746127005.580101:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991705600 00010000:00010000:2.0:1746127005.580155:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.580183:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10171 00000100:00100000:2.0:1746127005.580189:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991705600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.580200:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.580214:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.580225:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.580242:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096620c00/0x34dc807b6efa120 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53424 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.580262:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.580263:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.580269:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 10 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.580276:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 10 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.580283:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.580284:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.580288:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.580294:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.580317:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 34 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.580327:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994275584:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.581105:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 10 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.581114:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994275712:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127005.581480:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.581783:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.581838:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991705856 00000100:00100000:0.0:1746127005.581843:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991705856 00000100:00100000:0.0:1746127005.581878:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17300 00000100:00100000:0.0:1746127005.581883:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4370:x1830945991705856:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127005.581895:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.581907:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efa293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534f6 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.581970:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.581980:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.581986:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.582031:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.582049:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 10 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.582057:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994275840:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.582082:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.584531:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994275584:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127005.584542:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994275712:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.584559:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.584589:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991705600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4400us (4576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.584598:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10171 00000100:00100000:0.0:1746127005.586961:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994275840:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127005.587120:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127005.587222:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.587788:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.587840:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991705984 00000100:00100000:2.0:1746127005.587847:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991705984 00010000:00010000:2.0:1746127005.587872:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 11 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.587900:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10172 00000100:00100000:2.0:1746127005.587906:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991705984:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.587918:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.587923:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 11 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.587932:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 11 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.587948:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e981800/0x34dc807b6efa25b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534be expref: 11 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.588232:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991706240 00000100:00100000:1.0:1746127005.588236:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991706240 00002000:00100000:1.0:1746127005.588262:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a75f80 x1830945991706240/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.588270:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75f80 with x1830945991706240 ext(1048576->2097151) 00002000:00010000:1.0:1746127005.588274:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75f80 00000100:00100000:1.0:1746127005.588293:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8674 00000100:00100000:1.0:1746127005.588298:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991706240:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127005.589576:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.589598:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991706496 00000100:00100000:0.0:1746127005.589602:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991706496 00002000:00100000:0.0:1746127005.589621:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a75c00 x1830945991706496/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.589629:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75c00 with x1830945991706496 ext(1048576->2097151) 00002000:00010000:0.0:1746127005.589632:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75c00 00000100:00100000:0.0:1746127005.589663:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8675 00000100:00100000:0.0:1746127005.589668:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991706496:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127005.590680:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127005.590687:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.590711:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.590718:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.590738:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.590767:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991705984:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2859us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.590776:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10172 00010000:00010000:0.0:1746127005.591991:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.592000:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:0.0:1746127005.592017:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127005.592122:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efa293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.593753:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.593761:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127005.593764:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746127005.593766:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644000, rc 0) 00000100:00100000:0.0:1746127005.593809:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4370:x1830945991705856:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 11925us (12026us total) trans 8589938252 rc 0/0 00000100:00100000:0.0:1746127005.593815:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17300 00000100:00100000:1.0:1746127005.600206:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991706240:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11898us (12411us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127005.600216:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8674 00002000:00100000:1.0:1746127005.600227:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a75f80 x1830945991706240/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.600236:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75f80 with x1830945991706240 ext(1048576->2097151) 00002000:00010000:1.0:1746127005.600240:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75f80 00000100:00100000:0.0:1746127005.602746:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.603006:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991706496:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13335us (13430us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127005.603013:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991706624 00000100:00100000:2.0:1746127005.603015:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8675 00000100:00100000:0.0:1746127005.603019:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991706624 00002000:00100000:2.0:1746127005.603024:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a75c00 x1830945991706496/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.603032:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75c00 with x1830945991706496 ext(1048576->2097151) 00002000:00010000:2.0:1746127005.603053:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75c00 00000100:00100000:0.0:1746127005.603925:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17301 00000100:00100000:0.0:1746127005.603934:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4370:x1830945991706624:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127005.603951:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.603966:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac800/0x34dc807b6efa2a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e534fd expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.604047:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.604061:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.604069:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127005.604093:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.604102:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 11 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.604112:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994275968:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.604185:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.609046:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994275968:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.609070:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127005.609361:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.609476:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991706752 00000100:00100000:2.0:1746127005.609481:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991706752 00010000:00010000:2.0:1746127005.609508:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.609852:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10173 00000100:00100000:2.0:1746127005.609860:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991706752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.609870:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.609876:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.609884:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.609901:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644000/0x34dc807b6efa29a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534f6 expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.609925:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127005.609928:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.609935:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.609941:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127005.609966:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127005.609997:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:2.0:1746127005.610000:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991706752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 141us (640us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127005.610003:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:2.0:1746127005.610006:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10173 00000004:00200000:3.0:1746127005.610057:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127005.610060:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127005.610072:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.610094:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac800/0x34dc807b6efa2a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534fd expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.610215:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534fd expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.610221:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.610223:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127005.610226:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac200, rc 0) 00000100:00100000:3.0:1746127005.610249:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4370:x1830945991706624:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6317us (7510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.610254:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17301 00000100:00100000:1.0:1746127005.610340:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.610367:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.610423:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991707008 00000100:00100000:3.0:1746127005.610427:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991707008 00000100:00100000:0.0:1746127005.610500:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991706880 00000100:00100000:0.0:1746127005.610505:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991706880 00000100:00100000:0.0:1746127005.610524:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21724 00000100:00100000:0.0:1746127005.610529:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991707008:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:3.0:1746127005.611151:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21725 00000100:00100000:3.0:1746127005.611158:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991706880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.611170:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.611179:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa2b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53504 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.611212:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994276096:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.611257:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746127005.611828:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.611839:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6efa2bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5350b expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127005.611866:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994276224:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127005.611904:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.612403:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.612430:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.612456:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.612475:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991707136 00000100:00100000:2.0:1746127005.612481:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991707136 00000100:00100000:2.0:1746127005.612504:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991707264 00000100:00100000:2.0:1746127005.612506:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991707264 00000100:00100000:0.0:1746127005.612513:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991707392 00000100:00100000:0.0:1746127005.612515:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991707392 00000100:00100000:2.0:1746127005.612518:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21726 00000100:00100000:2.0:1746127005.612523:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991707136:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:0.0:1746127005.612530:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21727 00010000:00010000:2.0:1746127005.612532:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127005.612534:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991707264:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127005.612539:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53512 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.612539:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.612545:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efa2cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53519 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.612551:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.612552:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.612559:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127005.612563:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994276352:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.612570:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.612578:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c9200, rc 0) 00000100:00100000:2.0:1746127005.612595:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991707136:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.612599:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.612601:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21726 00000100:00100000:2.0:1746127005.612612:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21728 00000100:00100000:2.0:1746127005.612616:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991707392:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127005.612621:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.612626:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6efa2d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53520 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.612692:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994276480:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127005.612711:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.612714:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994276096:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.612733:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa2b6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53504 expref: 34 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.612741:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa2b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53504 expref: 34 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.612749:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6200, rc 0) 00000100:00100000:3.0:1746127005.612765:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991706880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1607us (2397us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.612770:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21725 00000100:00100000:2.0:1746127005.613795:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994276224:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.613814:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6efa2bd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5350b expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.613823:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdad200/0x34dc807b6efa2bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5350b expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.613830:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdad200, rc 0) 00000100:00100000:2.0:1746127005.613860:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991707008:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3330us (3520us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.613866:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21724 00000100:00100000:3.0:1746127005.614452:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994276480:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.614467:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6efa2d2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53520 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.614708:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8600/0x34dc807b6efa2d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53520 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.614717:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8600, rc 0) 00000100:00100000:3.0:1746127005.614746:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991707392:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2129us (2288us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.614752:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21728 00000100:00100000:2.0:1746127005.615787:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994276352:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127005.615806:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efa2cb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53519 expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.615815:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efa2cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53519 expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.615822:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e8e6c00, rc 0) 00000100:00100000:2.0:1746127005.615859:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991707264:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3323us (3427us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127005.615864:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21727 00000100:00100000:0.0:1746127005.616554:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.616598:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991707520 00000100:00100000:2.0:1746127005.616604:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991707520 00000100:00100000:2.0:1746127005.616642:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21729 00000100:00100000:2.0:1746127005.616648:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4364:x1830945991707520:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127005.616662:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.616673:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53527 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.616691:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.616697:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.616699:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.616701:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.616724:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.616733:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 42 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.616744:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994276608:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.617102:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.618514:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.619377:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991707776 00000100:00100000:3.0:1746127005.619385:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991707776 00000100:00100000:3.0:1746127005.619420:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17302 00000100:00100000:3.0:1746127005.619426:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4370:x1830945991707776:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127005.619440:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.619454:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa2e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5352e expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.619531:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.619542:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127005.619556:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127005.619566:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127005.619640:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa2e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.619654:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.619661:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.619663:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127005.619666:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6000, rc 0) 00000100:00100000:3.0:1746127005.619701:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4370:x1830945991707776:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 275us (1190us total) trans 8589938253 rc 0/0 00000100:00100000:3.0:1746127005.619707:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17302 00000100:00100000:0.0:1746127005.620399:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.621028:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994276608:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.621063:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 34 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.621076:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8a00, rc 0) 00000100:00100000:2.0:1746127005.621193:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:4364:x1830945991707520:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4544us (4639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.621200:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21729 00000100:00100000:0.0:1746127005.621393:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.621549:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.621860:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.621912:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991708160 00000100:00100000:3.0:1746127005.621913:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991708288 00000100:00100000:3.0:1746127005.621917:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991708288 00000100:00100000:1.0:1746127005.621917:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991708160 00000100:00100000:1.0:1746127005.621926:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991708416 00000100:00100000:1.0:1746127005.621928:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991708416 00002000:00100000:1.0:1746127005.621944:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2867200->3145727) req@ffff880130a75880 x1830945991708416/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.621945:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2711552->4194303) req@ffff880130a76a00 x1830945991708288/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.621953:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76a00 with x1830945991708288 ext(2711552->4194303) 00002000:00100000:1.0:1746127005.621953:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75880 with x1830945991708416 ext(2867200->3145727) 00002000:00010000:3.0:1746127005.621957:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a76a00 00010000:00010000:1.0:1746127005.621958:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 44 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.621969:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 44 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.621973:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8676 00002000:00010000:1.0:1746127005.621974:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a75880 00000100:00100000:3.0:1746127005.621978:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991708288:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127005.621987:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1919 00000100:00100000:1.0:1746127005.621992:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991708416:12345-192.168.203.42@tcp:4:cat.0 00002000:00100000:1.0:1746127005.622125:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880130a74700 x1830945991708160/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 504/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.622151:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a74700 with x1830945991708160 ext(2097152->4194303) 00010000:00010000:1.0:1746127005.622156:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 45 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.622164:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 45 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746127005.622169:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a74700 00000100:00100000:1.0:1746127005.622185:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1920 00000100:00100000:1.0:1746127005.622189:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991708160:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127005.622222:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991708544 00000100:00100000:2.0:1746127005.622225:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991708544 00000100:00100000:2.0:1746127005.622244:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21730 00000100:00100000:2.0:1746127005.622248:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991708544:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127005.622264:0:16295:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622275:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 14 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.622282:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 33 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.622289:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 45 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.622298:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.622299:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.622302:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622326:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 45 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.622335:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 45 pid: 3542 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.622350:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994276736:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.622401:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 33 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127005.622403:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127005.622408:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 33 pid: 16295 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.622416:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994276864:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.622439:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 14 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.622447:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 14 pid: 11152 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746127005.622447:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.622453:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994276992:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.622468:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.622479:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991708800 00000100:00100000:2.0:1746127005.622481:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991708800 00000100:00100000:0.0:1746127005.622484:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.622494:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709056 00000100:00100000:2.0:1746127005.622496:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709056 00000100:00100000:2.0:1746127005.622510:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991708672 00000100:00100000:2.0:1746127005.622512:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991708672 00000100:00100000:0.0:1746127005.622518:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21731 00000100:00100000:0.0:1746127005.622524:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991708800:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127005.622539:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622550:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 10 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622556:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.622610:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622616:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.622618:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.622620:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622636:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622643:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.622652:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994277120:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127005.622677:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.622684:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 10 pid: 16295 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746127005.622695:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d289180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994277248:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127005.622713:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 10 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622720:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 10 pid: 3148 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.622726:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994277376:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.622736:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.622755:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.622769:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991708928 00000100:00100000:0.0:1746127005.622772:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991708928 00000100:00100000:0.0:1746127005.622821:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21732 00000100:00100000:2.0:1746127005.622826:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21733 00000100:00100000:0.0:1746127005.622826:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991709056:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:2.0:1746127005.622830:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991708672:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127005.622840:0:11152:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622840:0:9613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622848:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127005.622849:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 10 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622851:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622856:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 10 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.622856:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746127005.622858:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622862:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 35 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622866:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.622867:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.622868:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622875:0:9613:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622879:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 35 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.622884:0:9613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622885:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.622892:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994277632:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.622913:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 10 pid: 9612 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127005.622918:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127005.622920:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 10 pid: 9612 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.622934:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994277760:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.622943:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709184 00000100:00100000:2.0:1746127005.622945:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709184 00000100:00100000:2.0:1746127005.622958:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21734 00000100:00100000:2.0:1746127005.622963:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991708928:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127005.622974:0:12340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622983:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.622989:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.622995:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 46 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127005.622996:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21735 00010000:00010000:2.0:1746127005.622999:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.623001:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127005.623002:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991709184:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127005.623002:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.623016:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 46 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.623018:0:9611:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.623022:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 46 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.623028:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.623030:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994277888:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.623045:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127005.623046:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127005.623048:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.623063:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.623076:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 35 pid: 11152 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.623084:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994278016:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.623107:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746127005.626269:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.626285:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 16 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.626296:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994278144:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.626315:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 10 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.626323:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.626326:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.626333:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 33 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.626335:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994278272:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.626341:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994278400:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.626350:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.626355:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.629599:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994276736:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.629610:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994276864:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.632201:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.632258:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709312 00000100:00100000:2.0:1746127005.632271:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709312 00010000:00010000:2.0:1746127005.632304:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 47 pid: 3542 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.632340:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10174 00000100:00100000:2.0:1746127005.632350:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991709312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.632361:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.632376:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 47 pid: 3542 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.632386:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 47 pid: 3542 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.632402:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d600/0x34dc807b6ef9dae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53233 expref: 47 pid: 3542 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.632416:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.632447:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991709312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.632452:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10174 00000100:00100000:2.0:1746127005.639501:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.639532:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.639550:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709440 00000100:00100000:2.0:1746127005.639556:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709440 00010000:00010000:2.0:1746127005.639585:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 17 pid: 11152 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.639605:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709568 00000100:00100000:2.0:1746127005.639607:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709568 00010000:00010000:2.0:1746127005.639615:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 34 pid: 16295 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.639635:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10175 00000100:00100000:2.0:1746127005.639641:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991709440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.639651:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.639667:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 17 pid: 11152 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.639676:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 17 pid: 11152 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746127005.639693:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10176 00010000:00010000:2.0:1746127005.639694:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.639699:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991709568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.639705:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.639712:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 34 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.639719:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 34 pid: 16295 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.639723:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991709440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.639728:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10175 00010000:00010000:1.0:1746127005.639729:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6ef9de6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5325d expref: 34 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.639741:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.639743:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.639746:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.639753:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.639766:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.639780:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991709568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.639785:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10176 00000100:00100000:2.0:1746127005.639888:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991708288:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17909us (18495us total) trans 0 rc 1482752/1482752 00000100:00100000:2.0:1746127005.639894:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8676 00002000:00100000:2.0:1746127005.639901:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2711552->4194303) req@ffff880130a76a00 x1830945991708288/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1482752/1482752 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.639908:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76a00 with x1830945991708288 ext(2711552->4194303) 00010000:00010000:2.0:1746127005.639914:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 34 pid: 11152 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.639922:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 34 pid: 11152 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746127005.639927:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a76a00 00000100:00100000:0.0:1746127005.640000:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994277120:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.640331:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e9600/0x34dc807b6ef9d14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e531e6 expref: 16 pid: 11152 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.640340:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994276992:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.640360:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640367:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640373:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640387:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640394:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640400:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640406:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c8e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127005.640410:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640416:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640425:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.640429:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8e00/0x34dc807b6efa2f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.641368:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991708544:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 19117us (19506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.641372:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991708416:12345-192.168.203.42@tcp:4:cat.0 Request processed in 19347us (19790us total) trans 21474842877 rc 0/0 00000100:00100000:3.0:1746127005.641376:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21730 00000100:00100000:1.0:1746127005.641378:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1919 00002000:00100000:1.0:1746127005.641385:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2867200->3145727) req@ffff880130a75880 x1830945991708416/t21474842877(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.641391:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75880 with x1830945991708416 ext(2867200->3145727) 00010000:00010000:1.0:1746127005.641397:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 46 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.641406:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 46 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746127005.641412:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a75880 00000001:00080000:0.0:1746127005.642598:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842877 is committed 00000001:00080000:0.0:1746127005.642619:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842875 is committed 00000001:00080000:0.0:1746127005.642648:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842870 is committed 00000001:00080000:0.0:1746127005.642753:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842826 is committed 00000100:00100000:0.0:1746127005.644801:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.644975:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994277632:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.645027:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d289180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994277248:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.645043:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994277376:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.645065:0:9612:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.646100:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709824 00000100:00100000:1.0:1746127005.646107:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709824 00010000:00010000:1.0:1746127005.646152:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 11 pid: 3148 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.646189:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10177 00000100:00100000:1.0:1746127005.646196:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991709824:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.646207:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.646221:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 11 pid: 3148 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.646229:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 11 pid: 3148 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.646246:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011de0ce00/0x34dc807b6efa262 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534c5 expref: 11 pid: 3148 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.646258:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.646298:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991709824:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 102us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.646304:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10177 00000100:00100000:0.0:1746127005.646817:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.646875:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709696 00000100:00100000:3.0:1746127005.646880:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709696 00010000:00010000:3.0:1746127005.646895:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 12 pid: 16295 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.646925:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10178 00000100:00100000:3.0:1746127005.646930:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991709696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.646937:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.646944:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 12 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.646952:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 12 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.646963:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efa2c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53512 expref: 12 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.646971:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.647000:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991709696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.647006:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10178 00000100:00100000:0.0:1746127005.648709:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.648740:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.648753:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.648812:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.648814:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994277888:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.648824:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994278144:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.648825:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.648837:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710208 00000100:00100000:2.0:1746127005.648840:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710208 00010000:00010000:2.0:1746127005.648860:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 34 pid: 9613 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.648877:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710080 00000100:00100000:2.0:1746127005.648879:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710080 00010000:00010000:2.0:1746127005.648888:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.648893:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710336 00000100:00100000:1.0:1746127005.648896:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710336 00000100:00100000:2.0:1746127005.648897:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710464 00000100:00100000:2.0:1746127005.648898:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710464 00010000:00010000:2.0:1746127005.648906:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 11 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.648907:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 11 pid: 9612 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.648916:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10179 00000100:00100000:1.0:1746127005.648919:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10180 00000100:00100000:2.0:1746127005.648921:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991710208:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127005.648923:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991710080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.648928:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.648928:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.648937:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.648938:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.648945:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.648945:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.648958:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e980800/0x34dc807b6efa285 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534e8 expref: 35 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.648958:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2400/0x34dc807b6efa23f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534b7 expref: 35 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.648968:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127005.648971:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.648973:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.648976:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.648983:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.648989:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991710080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 66us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.648993:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10180 00010000:00010000:2.0:1746127005.648998:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.649003:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10181 00000100:00100000:1.0:1746127005.649007:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991710464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127005.649009:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991710208:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.649013:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10179 00010000:00010000:1.0:1746127005.649013:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.649021:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 11 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.649022:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10182 00000100:00100000:2.0:1746127005.649026:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991710336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.649029:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 11 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.649030:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.649046:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 11 pid: 9612 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.649050:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e981c00/0x34dc807b6efa27e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534da expref: 11 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.649053:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 11 pid: 9612 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.649058:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127005.649061:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.649071:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991710336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 45us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.649071:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991710464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.649076:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10182 00000100:00100000:1.0:1746127005.649085:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10181 00010000:00010000:2.0:1746127005.649095:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.649101:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.649112:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.649116:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991709952 00000100:00100000:1.0:1746127005.649118:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991709952 00010000:00010000:2.0:1746127005.649119:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.649125:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746127005.649153:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2711551) req@ffff88012d28a300 x1830945991709952/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127005.649154:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd7400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127005.649157:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746127005.649161:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28a300 with x1830945991709952 ext(2097152->2711551) 00010000:00010000:2.0:1746127005.649163:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.649166:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 32 pid: 11152 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.649171:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.649175:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 32 pid: 11152 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.649176:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7400/0x34dc807b6efa2fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127005.649180:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d28a300 00000100:00100000:1.0:1746127005.649197:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1921 00000100:00100000:1.0:1746127005.649202:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945991709952:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127005.649206:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991708800:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 26684us (26804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.649212:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21731 00000100:00100000:2.0:1746127005.649233:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994278400:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.649246:0:12340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.649287:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e980600/0x34dc807b6efa269 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534cc expref: 9 pid: 9612 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.649294:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994277760:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127005.649302:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994278272:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.649315:0:11152:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.649580:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994278016:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.649594:0:9611:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.651791:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.651816:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.651826:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710720 00000100:00100000:0.0:1746127005.651833:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710720 00010000:00010000:0.0:1746127005.651856:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.651860:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.651887:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710592 00000100:00100000:0.0:1746127005.651889:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710592 00010000:00010000:0.0:1746127005.651900:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 22 pid: 1507 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.651926:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710848 00000100:00100000:3.0:1746127005.651929:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710848 00010000:00010000:3.0:1746127005.651940:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 7 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.651956:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10183 00000100:00100000:3.0:1746127005.651961:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991710720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.651970:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.651984:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.651992:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.652008:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc200/0x34dc807b6efa20e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534a2 expref: 10 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.652020:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.652021:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.652024:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.652031:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.652062:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.652096:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991710720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 134us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.652102:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10183 00000100:00100000:3.0:1746127005.652119:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10184 00000100:00100000:3.0:1746127005.652123:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2029:x1830945991710592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.652192:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.652203:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 22 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.652212:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 22 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.652224:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efa174 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5345c expref: 22 pid: 1507 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746127005.652233:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.652248:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2029:x1830945991710592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 124us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.652253:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10184 00000100:00100000:3.0:1746127005.652272:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10185 00000100:00100000:3.0:1746127005.652277:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991710848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.652283:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.652289:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 7 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.652296:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 7 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.652307:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c644800/0x34dc807b6efa119 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5341d expref: 7 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.652314:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.652315:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.652318:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.652324:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.654907:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.654948:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2029:x1830945991710848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2666us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.654958:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10185 00010000:00010000:3.0:1746127005.658232:0:11152:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658247:0:11152:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658273:0:11152:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658279:0:11152:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658290:0:11152:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658295:0:11152:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd03800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127005.658298:0:11152:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658305:0:11152:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658320:0:11152:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658325:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efa30a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.658388:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991708672:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 35553us (35899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.658396:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21733 00010000:00010000:3.0:1746127005.658431:0:12340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658438:0:12340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658452:0:12340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658457:0:12340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658463:0:12340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658467:0:12340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b22e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127005.658469:0:12340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658474:0:12340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658482:0:12340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.658487:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880085b22e00/0x34dc807b6efa311 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.658514:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991708928:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 35551us (35757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.658726:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21734 00000100:00100000:1.0:1746127005.661896:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+19:2026:x1830945991708160:12345-192.168.203.42@tcp:3:cat.0 Request processed in 39699us (41492us total) trans 0 rc 1818624/1818624 00000100:00100000:1.0:1746127005.661904:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1920 00002000:00100000:1.0:1746127005.661914:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880130a74700 x1830945991708160/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 504/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 1818624/1818624 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.661923:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a74700 with x1830945991708160 ext(2097152->4194303) 00010000:00010000:1.0:1746127005.661931:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 19 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.661947:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 19 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746127005.661953:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a74700 00000100:00100000:1.0:1746127005.666728:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991709952:12345-192.168.203.42@tcp:4:cat.0 Request processed in 17517us (18015us total) trans 17179875614 rc 0/0 00000100:00100000:1.0:1746127005.666740:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1921 00002000:00100000:1.0:1746127005.666749:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2711551) req@ffff88012d28a300 x1830945991709952/t17179875614(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.666758:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28a300 with x1830945991709952 ext(2097152->2711551) 00010000:00010000:1.0:1746127005.666766:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 34 pid: 11152 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.666777:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 34 pid: 11152 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746127005.666789:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d28a300 00000100:00100000:0.0:1746127005.671500:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.671554:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.671631:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991711104 00000100:00100000:3.0:1746127005.671638:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991711104 00000100:00100000:3.0:1746127005.671675:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21736 00000100:00100000:3.0:1746127005.671682:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4368:x1830945991711104:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.671697:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.671709:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53535 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.671731:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127005.671735:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.671740:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746127005.671743:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 35 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.671756:0:12340:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.671768:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 35 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.671777:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7400, rc 0) 00000100:00100000:3.0:1746127005.671825:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4368:x1830945991711104:12345-192.168.203.42@tcp:101:cat.0 Request processed in 144us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.671831:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21736 00000100:00100000:2.0:1746127005.671899:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991710976 00000100:00100000:2.0:1746127005.671903:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991710976 00010000:00010000:2.0:1746127005.671919:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 35 pid: 11152 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.671936:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10186 00000100:00100000:2.0:1746127005.671942:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991710976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.671949:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.671962:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 35 pid: 11152 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.671970:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 35 pid: 11152 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.671984:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb2200/0x34dc807b6efa1cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5347f expref: 35 pid: 11152 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.672362:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.672364:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.672367:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.672374:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.672634:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.672657:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991710976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 714us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.672663:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10186 00010000:00010000:3.0:1746127005.672796:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672804:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672822:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672828:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672835:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672841:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c6400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127005.672843:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672850:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672858:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.672859:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.672864:0:9611:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 33 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672870:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 33 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.672890:0:9611:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 33 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.672903:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994278528:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127005.673306:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.674722:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.674790:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.674810:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991711488 00000100:00100000:0.0:1746127005.674816:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991711488 00000100:00100000:0.0:1746127005.674856:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17303 00000100:00100000:0.0:1746127005.674862:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4372:x1830945991711488:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127005.674879:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.674891:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6efa326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5353c expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.674944:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.674954:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.674962:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.674971:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.674979:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.674984:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.675074:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.675085:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.675090:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.675110:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.675119:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 11 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.675156:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994278656:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.675205:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.675313:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991711232 00000100:00100000:0.0:1746127005.675316:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991711232 00010000:00010000:0.0:1746127005.675332:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 19 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.675348:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10187 00000100:00100000:0.0:1746127005.675353:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+19:2027:x1830945991711232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127005.675361:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127005.675372:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 19 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.675380:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 19 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.675394:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096620400/0x34dc807b6efa1c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53471 expref: 19 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.675409:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.675411:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.675416:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 5 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.675423:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 5 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.675438:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 5 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.675445:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 5 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746127005.675453:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994278784:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127005.675473:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.675632:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994278528:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.675649:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.675660:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa318 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.675695:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2026:x1830945991709184:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 52692us (52775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.675702:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21735 00000100:00100000:0.0:1746127005.678320:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.678342:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991711744 00000100:00100000:1.0:1746127005.678347:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991711744 00000100:00100000:0.0:1746127005.678356:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994278784:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127005.678369:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127005.678371:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.678389:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10188 00000100:00100000:1.0:1746127005.678395:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991711744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127005.678406:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+18:2027:x1830945991711232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3052us (3687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.678411:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10187 00010000:00010000:1.0:1746127005.678484:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.678491:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.678500:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.678515:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127005.678519:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127005.678528:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678530:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa2e7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5352e expref: 12 pid: 13448 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.678533:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00000100:00100000:2.0:1746127005.678540:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994278656:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127005.678543:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127005.678550:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678556:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:1.0:1746127005.678557:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991711744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 163us (242us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127005.678561:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:1.0:1746127005.678562:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10188 00000004:00200000:2.0:1746127005.678572:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127005.678639:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678645:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678650:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678655:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caea000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127005.678659:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678664:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678672:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127005.678674:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127005.678676:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678680:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea000/0x34dc807b6efa33b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678708:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678712:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678716:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678720:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678723:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127005.678725:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678728:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678733:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127005.678735:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127005.678737:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678741:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb600/0x34dc807b6efa32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678757:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678760:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678764:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678767:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeba00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127005.678769:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678772:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678777:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f000) 00010000:00010000:2.0:1746127005.678779:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127005.678780:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678784:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeba00/0x34dc807b6efa334 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.678816:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6efa326 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5353c expref: 52 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.678822:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caea800/0x34dc807b6efa326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5353c expref: 52 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.678831:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caea800, rc 0) 00000100:00100000:2.0:1746127005.678864:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4372:x1830945991711488:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4002us (4074us total) trans 8589938254 rc 301/301 00000100:00100000:2.0:1746127005.678869:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17303 00000100:00100000:3.0:1746127005.679309:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.679342:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991711872 00000100:00100000:1.0:1746127005.679346:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991711872 00002000:00100000:1.0:1746127005.679369:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012238f800 x1830945991711872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.679379:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238f800 with x1830945991711872 ext(2097152->3145727) 00002000:00010000:1.0:1746127005.679382:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238f800 00000100:00100000:1.0:1746127005.679395:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8677 00000100:00100000:1.0:1746127005.679401:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991711872:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127005.682801:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.682878:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991712128 00000100:00100000:2.0:1746127005.682885:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991712128 00002000:00100000:2.0:1746127005.682916:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012d28b100 x1830945991712128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.682924:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28b100 with x1830945991712128 ext(2097152->3145727) 00010000:00010000:2.0:1746127005.682933:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.682945:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746127005.682951:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d28b100 00000100:00100000:1.0:1746127005.683916:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1922 00000100:00100000:1.0:1746127005.683928:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2028:x1830945991712128:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127005.686973:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991711872:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7564us (7657us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127005.686983:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8677 00002000:00100000:1.0:1746127005.686994:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012238f800 x1830945991711872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.687003:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238f800 with x1830945991711872 ext(2097152->3145727) 00002000:00010000:1.0:1746127005.687008:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238f800 00000100:00100000:1.0:1746127005.691669:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2028:x1830945991712128:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7737us (8866us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127005.691680:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1922 00002000:00100000:1.0:1746127005.691691:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012d28b100 x1830945991712128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.691700:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28b100 with x1830945991712128 ext(2097152->3145727) 00010000:00010000:1.0:1746127005.691709:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.691721:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00002000:00010000:1.0:1746127005.691726:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d28b100 00000100:00100000:0.0:1746127005.692168:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.692217:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991712256 00000100:00100000:3.0:1746127005.692224:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991712256 00000100:00100000:3.0:1746127005.692250:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21737 00000100:00100000:3.0:1746127005.692256:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+18:4368:x1830945991712256:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.692268:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.692279:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53543 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.692297:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.692301:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.692306:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127005.692309:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 19 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.692321:0:9611:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.692333:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 19 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.692346:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6200, rc 0) 00000100:00100000:3.0:1746127005.692408:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+19:4368:x1830945991712256:12345-192.168.203.42@tcp:101:cat.0 Request processed in 151us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.692414:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21737 00000100:00100000:0.0:1746127005.700086:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.700218:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991712384 00000100:00100000:3.0:1746127005.700226:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991712384 00000100:00100000:3.0:1746127005.700262:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21738 00000100:00100000:3.0:1746127005.700269:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4364:x1830945991712384:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.700281:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.700295:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5354a expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.700314:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.700315:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.700321:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 10 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.700332:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 10 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.700339:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6000, rc 0) 00000100:00100000:3.0:1746127005.700774:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4364:x1830945991712384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 504us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.700780:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21738 00000100:00100000:0.0:1746127005.702600:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.702687:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991712512 00000100:00100000:1.0:1746127005.702692:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991712512 00010000:00010000:1.0:1746127005.702718:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746127005.702754:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10189 00000100:00100000:1.0:1746127005.702761:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2027:x1830945991712512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.702771:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127005.702785:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.702796:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.702813:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8a00/0x34dc807b6efa2d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53527 expref: 6 pid: 1507 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746127005.702870:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.702872:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.702876:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.702883:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127005.702900:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.702924:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2027:x1830945991712512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 164us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.702930:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10189 00010000:00010000:0.0:1746127005.702997:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703005:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703018:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703024:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703031:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703048:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e9000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127005.703051:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703063:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703072:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.703073:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.703077:0:9613:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 18 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703084:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 18 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.703105:0:9613:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 18 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127005.703115:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994278912:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127005.703168:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.704226:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994278912:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.704241:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.704247:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9000/0x34dc807b6efa303 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.704292:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991709056:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 81465us (81843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.704302:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21732 00000100:00100000:2.0:1746127005.707523:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.708187:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991712768 00000100:00100000:1.0:1746127005.708196:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991712768 00002000:00100000:1.0:1746127005.708235:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff880094f16300 x1830945991712768/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.708245:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f16300 with x1830945991712768 ext(2097152->3145727) 00002000:00010000:1.0:1746127005.708250:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f16300 00000100:00100000:1.0:1746127005.708285:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8678 00000100:00100000:1.0:1746127005.708292:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991712768:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127005.708662:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.709173:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991713024 00000100:00100000:3.0:1746127005.709179:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991713024 00000100:00100000:3.0:1746127005.709218:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17304 00000100:00100000:3.0:1746127005.709224:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4370:x1830945991713024:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:3.0:1746127005.709257:0:7260:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127005.709263:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127005.709277:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac200/0x34dc807b6efa2af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e534fd expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.709286:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991713408 00000100:00100000:2.0:1746127005.709290:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991713408 00000100:00100000:0.0:1746127005.709300:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127005.709307:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00002000:00100000:2.0:1746127005.709309:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012d288a80 x1830945991713408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746127005.709311:0:7260:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746127005.709318:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288a80 with x1830945991713408 ext(3145728->4194303) 00002000:00010000:2.0:1746127005.709321:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d288a80 00000100:00100000:2.0:1746127005.709335:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991713536 00000100:00100000:2.0:1746127005.709337:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991713536 00002000:00100000:2.0:1746127005.709347:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88012d289500 x1830945991713536/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.709354:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d289500 with x1830945991713536 ext(3145728->4194303) 00002000:00010000:2.0:1746127005.709357:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d289500 00000100:00100000:0.0:1746127005.709367:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8679 00000100:00100000:2.0:1746127005.709380:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8680 00000100:00100000:0.0:1746127005.709380:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+19:2026:x1830945991713408:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127005.709386:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991713536:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127005.709457:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4370:x1830945991713024:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 232us (802us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746127005.709463:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17304 00000100:00100000:0.0:1746127005.713768:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.713850:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991713792 00000100:00100000:1.0:1746127005.713860:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991713792 00000100:00100000:1.0:1746127005.714077:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6600 00000100:00100000:1.0:1746127005.714086:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4370:x1830945991713792:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1746127005.714466:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4370:x1830945991713792:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 382us (709us total) trans 8589938255 rc 0/0 00000100:00100000:1.0:1746127005.714472:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6600 00000100:00100000:1.0:1746127005.715201:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991712768:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6906us (7681us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127005.715209:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8678 00002000:00100000:1.0:1746127005.715217:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff880094f16300 x1830945991712768/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.715225:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f16300 with x1830945991712768 ext(2097152->3145727) 00002000:00010000:1.0:1746127005.715230:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f16300 00000100:00100000:0.0:1746127005.724490:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.724609:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991714048 00000100:00100000:1.0:1746127005.724616:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991714048 00000100:00100000:1.0:1746127005.724662:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6601 00000100:00100000:1.0:1746127005.724670:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4370:x1830945991714048:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1746127005.724773:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.724861:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991713536:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15474us (15561us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127005.724869:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8680 00002000:00100000:2.0:1746127005.724881:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88012d289500 x1830945991713536/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.724888:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d289500 with x1830945991713536 ext(3145728->4194303) 00002000:00010000:2.0:1746127005.724892:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d289500 00000100:00100000:1.0:1746127005.724908:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4370:x1830945991714048:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 238us (423us total) trans 8589938256 rc 0/0 00000100:00100000:1.0:1746127005.724914:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6601 00000100:00100000:3.0:1746127005.725115:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+19:2026:x1830945991713408:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15739us (15851us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127005.725122:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8679 00002000:00100000:3.0:1746127005.725149:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012d288a80 x1830945991713408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.725157:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288a80 with x1830945991713408 ext(3145728->4194303) 00002000:00010000:3.0:1746127005.725160:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d288a80 00000100:00100000:2.0:1746127005.725696:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991714176 00000100:00100000:2.0:1746127005.725700:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991714176 00000100:00100000:2.0:1746127005.725726:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21739 00000100:00100000:2.0:1746127005.725731:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+5:4364:x1830945991714176:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127005.725740:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.725752:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53551 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.725768:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.725770:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.725775:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 6 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.725787:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 6 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.725796:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7a00, rc 0) 00000100:00100000:2.0:1746127005.725809:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+6:4364:x1830945991714176:12345-192.168.203.42@tcp:101:cat.0 Request processed in 78us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.725814:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21739 00000100:00100000:0.0:1746127005.743903:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.743945:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.743973:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.744085:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991714304 00000100:00100000:2.0:1746127005.744093:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991714304 00000100:00100000:0.0:1746127005.744102:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.744148:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991714560 00000100:00100000:2.0:1746127005.744150:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991714560 00000100:00100000:2.0:1746127005.744163:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991714432 00000100:00100000:2.0:1746127005.744165:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991714432 00000100:00100000:2.0:1746127005.744174:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991714688 00000100:00100000:2.0:1746127005.744176:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991714688 00000100:00100000:0.0:1746127005.744179:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.744190:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21740 00000100:00100000:2.0:1746127005.744196:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991714304:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127005.744202:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127005.744212:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127005.744220:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991714944 00000100:00100000:0.0:1746127005.744223:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991714944 00010000:00010000:2.0:1746127005.744227:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53558 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127005.744245:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c89a, atime: 0x6813c899, ctime: 0x6813c89a, blocks: 0x7f8 00002000:00100000:0.0:1746127005.744248:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800a5b99500 x1830945991714944/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.744257:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99500 with x1830945991714944 ext(3145728->4194303) 00010000:00010000:2.0:1746127005.744259:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.744260:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746127005.744262:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b99500 00010000:00010000:2.0:1746127005.744267:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127005.744271:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991715200 00000100:00100000:0.0:1746127005.744273:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991715200 00010000:00010000:2.0:1746127005.744280:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746127005.744284:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800a5b9a300 x1830945991715200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127005.744290:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6000, rc 0) 00002000:00100000:0.0:1746127005.744291:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9a300 with x1830945991715200 ext(3145728->4194303) 00002000:00010000:0.0:1746127005.744293:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b9a300 00000100:00100000:0.0:1746127005.744308:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8681 00000100:00100000:0.0:1746127005.744313:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2029:x1830945991714944:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127005.744325:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991714304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 129us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.744331:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21740 00000100:00100000:1.0:1746127005.744339:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21741 00000100:00100000:1.0:1746127005.744348:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991714560:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127005.744355:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.744365:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53566 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127005.744378:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c89c, atime: 0x6813c89b, ctime: 0x6813c89b, blocks: 0x808 00010000:00010000:1.0:1746127005.744385:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.744387:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.744391:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 36 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.744400:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 36 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.744407:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914b000, rc 0) 00000100:00100000:1.0:1746127005.744425:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991714560:12345-192.168.203.42@tcp:101:cat.0 Request processed in 79us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.744431:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21741 00000100:00100000:1.0:1746127005.744447:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21742 00000100:00100000:1.0:1746127005.744452:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991714432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127005.744457:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127005.744465:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5355f expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127005.744473:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c89c, atime: 0x6813c89b, ctime: 0x6813c89b, blocks: 0x800 00010000:00010000:1.0:1746127005.744479:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.744481:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127005.744484:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 36 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.744492:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 36 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127005.744498:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914a200, rc 0) 00000100:00100000:1.0:1746127005.744513:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991714432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 62us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.744518:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21743 00000100:00100000:2.0:1746127005.744529:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991714688:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127005.744530:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21742 00010000:00010000:2.0:1746127005.744535:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.744543:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5356d expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127005.744547:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8682 00002000:00010000:2.0:1746127005.744552:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c89b, atime: 0x6813c89b, ctime: 0x6813c89b, blocks: 0x800 00000100:00100000:1.0:1746127005.744552:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991715200:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127005.744559:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.744561:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.744566:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.744574:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 21 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127005.744580:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6e00, rc 0) 00000100:00100000:2.0:1746127005.744595:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991714688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 71us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.744601:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21743 00000100:00100000:0.0:1746127005.753317:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.753362:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.753384:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991715456 00000100:00100000:3.0:1746127005.753392:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991715456 00000100:00100000:1.0:1746127005.753470:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991715712 00000100:00100000:1.0:1746127005.753474:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991715712 00002000:00100000:1.0:1746127005.753500:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a5b98380 x1830945991715712/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.753509:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98380 with x1830945991715712 ext(4194304->4829183) 00002000:00010000:1.0:1746127005.753515:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b98380 00000100:00100000:1.0:1746127005.755102:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8683 00000100:00100000:1.0:1746127005.755120:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991715712:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127005.755630:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17305 00000100:00100000:3.0:1746127005.755638:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4374:x1830945991715456:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.755654:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.755669:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6400/0x34dc807b6efa37a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53574 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.755721:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755736:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755745:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755756:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755761:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755766:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755836:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755843:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755849:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127005.755856:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127005.755909:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755915:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755920:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755925:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755930:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c6c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.755933:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755938:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755947:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127005.755949:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.755952:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755956:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa381 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755970:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755974:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755978:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755982:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c7000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.755984:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755989:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.755994:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090424800) 00010000:00010000:3.0:1746127005.755996:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.755998:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.756002:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa388 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746127005.756357:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2029:x1830945991714944:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12041us (12175us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127005.756365:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8681 00002000:00100000:0.0:1746127005.756372:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800a5b99500 x1830945991714944/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.756385:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99500 with x1830945991714944 ext(3145728->4194303) 00002000:00010000:0.0:1746127005.756389:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b99500 00010000:00010000:3.0:1746127005.758650:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6400/0x34dc807b6efa37a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 30 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.758677:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.758685:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.758688:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127005.758691:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7e00, rc 0) 00000100:00100000:3.0:1746127005.758744:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4374:x1830945991715456:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3106us (5434us total) trans 8589938257 rc 0/0 00000100:00100000:3.0:1746127005.758750:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17305 00000100:00100000:1.0:1746127005.764886:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991715200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20325us (20675us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127005.764896:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8682 00002000:00100000:1.0:1746127005.764905:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff8800a5b9a300 x1830945991715200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.764915:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9a300 with x1830945991715200 ext(3145728->4194303) 00002000:00010000:1.0:1746127005.764920:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b9a300 00000100:00100000:1.0:1746127005.765876:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991715712:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10759us (12511us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127005.765881:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8683 00002000:00100000:1.0:1746127005.765885:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a5b98380 x1830945991715712/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.765891:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98380 with x1830945991715712 ext(4194304->4829183) 00002000:00010000:1.0:1746127005.765893:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b98380 00000100:00100000:0.0:1746127005.769030:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.769076:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.769170:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991715840 00000100:00100000:3.0:1746127005.769178:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991715840 00000100:00100000:0.0:1746127005.769180:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.769322:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991716096 00000100:00100000:3.0:1746127005.769325:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991716096 00000100:00100000:0.0:1746127005.769334:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991715968 00000100:00100000:0.0:1746127005.769338:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991715968 00000100:00100000:3.0:1746127005.769346:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21744 00000100:00100000:3.0:1746127005.769353:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2028:x1830945991715840:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127005.769358:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21745 00000100:00100000:0.0:1746127005.769363:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991716096:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.769368:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.769371:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.769381:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5357b expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.769381:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53589 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.769398:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.769398:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.769400:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.769400:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.769406:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 7 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.769406:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.769417:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 7 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.769417:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.769426:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6c00, rc 0) 00010000:00010000:0.0:1746127005.769426:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4c00, rc 0) 00000100:00100000:3.0:1746127005.769458:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991715840:12345-192.168.203.42@tcp:101:cat.0 Request processed in 106us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.769464:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21744 00000100:00100000:3.0:1746127005.769475:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21746 00000100:00100000:3.0:1746127005.769480:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991715968:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.769486:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.769492:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53582 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.769500:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.769501:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.769504:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 13 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.769513:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 13 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.769519:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6400, rc 0) 00000100:00100000:0.0:1746127005.769712:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991716096:12345-192.168.203.42@tcp:101:cat.0 Request processed in 348us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.769718:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21745 00000100:00100000:1.0:1746127005.769774:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.769884:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991716224 00000100:00100000:0.0:1746127005.769887:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991716224 00000100:00100000:0.0:1746127005.769907:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21747 00000100:00100000:0.0:1746127005.769911:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2028:x1830945991716224:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127005.769917:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127005.769923:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53590 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.769933:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.769934:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127005.769938:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 8 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.769946:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 8 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127005.769953:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4800, rc 0) 00000100:00100000:0.0:1746127005.769968:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991716224:12345-192.168.203.42@tcp:101:cat.0 Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.769973:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21747 00000100:00100000:3.0:1746127005.770284:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991715968:12345-192.168.203.42@tcp:101:cat.0 Request processed in 802us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.770293:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21746 00000100:00100000:0.0:1746127005.773933:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.774019:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.774177:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991716608 00000100:00100000:1.0:1746127005.774184:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991716608 00002000:00100000:1.0:1746127005.774216:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a5b9ad80 x1830945991716608/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.774222:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9ad80 with x1830945991716608 ext(4194304->4829183) 00002000:00010000:1.0:1746127005.774226:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b9ad80 00000100:00100000:1.0:1746127005.774241:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8684 00000100:00100000:1.0:1746127005.774246:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991716608:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127005.775187:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991716480 00000100:00100000:3.0:1746127005.775193:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991716480 00000100:00100000:3.0:1746127005.775230:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21748 00000100:00100000:3.0:1746127005.775236:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4374:x1830945991716480:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.775245:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.775256:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53597 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.775275:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 20 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.775283:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.775288:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.775290:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.775293:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [159744->286719] (req 159744->286719) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.775314:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.775324:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 11 pid: 16295 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.775333:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279040:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.775396:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 20 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.775404:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 20 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746127005.775411:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279168:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.775429:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127005.778463:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991716608:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 4209us (4437us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127005.778473:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8684 00002000:00100000:1.0:1746127005.778481:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a5b9ad80 x1830945991716608/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 634880/634880 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.778490:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9ad80 with x1830945991716608 ext(4194304->4829183) 00002000:00010000:1.0:1746127005.778496:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b9ad80 00000100:00100000:0.0:1746127005.784022:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.784053:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279040:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.784064:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279168:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.784074:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127005.784092:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [159744->286719] (req 159744->286719) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 9 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.784107:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7200, rc 0) 00000100:00100000:2.0:1746127005.784155:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991716736 00000100:00100000:2.0:1746127005.784160:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991716736 00000100:00100000:3.0:1746127005.784164:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4374:x1830945991716480:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8927us (10236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.784171:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21748 00000100:00100000:1.0:1746127005.784172:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991716864 00000100:00100000:1.0:1746127005.784175:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991716864 00010000:00010000:2.0:1746127005.784184:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 9 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.784190:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 21 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746127005.784204:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10190 00000100:00100000:2.0:1746127005.784209:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991716736:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127005.784218:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10191 00010000:00010000:2.0:1746127005.784219:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127005.784224:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2029:x1830945991716864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127005.784230:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.784234:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 9 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.784238:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 21 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.784243:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 9 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.784447:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 21 pid: 9613 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746127005.784465:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6000/0x34dc807b6efa35e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53558 expref: 21 pid: 9613 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746127005.784471:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127005.784479:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127005.784497:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2029:x1830945991716864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 273us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.784502:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10191 00010000:00010000:2.0:1746127005.784624:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efa3a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5357b expref: 9 pid: 16295 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746127005.784641:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.784643:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.784648:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.784655:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.784677:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.784687:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994279296:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127005.784740:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.784860:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991716992 00000100:00100000:3.0:1746127005.784864:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991716992 00000100:00100000:3.0:1746127005.784940:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21749 00000100:00100000:3.0:1746127005.784946:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991716992:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.784956:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.784963:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd03600/0x34dc807b6efa3c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5359e expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.784988:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279424:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.785009:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.789261:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994279296:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.789277:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.789321:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991716736:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5111us (5306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.789331:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10190 00002000:00010000:3.0:1746127005.790362:0:16295:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746127002 -> 1746127004 00002000:00010000:3.0:1746127005.790366:0:16295:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127001 -> 1746127004 00002000:00010000:3.0:1746127005.790368:0:16295:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746127002 -> 1746127004 00000100:00100000:3.0:1746127005.790382:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279424:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.790407:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd03600/0x34dc807b6efa3c0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5359e expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127005.790414:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127005.790419:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03600/0x34dc807b6efa3c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5359e expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.790444:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03600, rc 0) 00000100:00100000:1.0:1746127005.790459:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991717248 00000100:00100000:1.0:1746127005.790464:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991717248 00000100:00100000:3.0:1746127005.790470:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991716992:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5524us (5998us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.790477:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21749 00002000:00100000:1.0:1746127005.790492:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (159744->163839) req@ffff8800a5b9bb80 x1830945991717248/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.790499:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9bb80 with x1830945991717248 ext(159744->163839) 00002000:00010000:1.0:1746127005.790502:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b9bb80 00000100:00100000:1.0:1746127005.790524:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8685 00000100:00100000:1.0:1746127005.790529:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991717248:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127005.790609:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991717248:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 79us (196us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127005.790619:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8685 00002000:00100000:1.0:1746127005.790624:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (159744->163839) req@ffff8800a5b9bb80 x1830945991717248/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.790630:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b9bb80 with x1830945991717248 ext(159744->163839) 00002000:00010000:1.0:1746127005.790632:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b9bb80 00000100:00100000:0.0:1746127005.796722:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.796771:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991717504 00000100:00100000:1.0:1746127005.796779:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991717504 00002000:00100000:1.0:1746127005.796814:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (282624->286719) req@ffff880096633b80 x1830945991717504/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.796822:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096633b80 with x1830945991717504 ext(282624->286719) 00002000:00010000:1.0:1746127005.796827:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096633b80 00000100:00100000:1.0:1746127005.796855:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8686 00000100:00100000:1.0:1746127005.796862:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991717504:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127005.796973:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991717504:12345-192.168.203.42@tcp:3:cat.0 Request processed in 111us (257us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127005.796979:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8686 00002000:00100000:1.0:1746127005.796984:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (282624->286719) req@ffff880096633b80 x1830945991717504/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.796991:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096633b80 with x1830945991717504 ext(282624->286719) 00002000:00010000:1.0:1746127005.796994:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096633b80 00000100:00100000:0.0:1746127005.803088:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.803155:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991717760 00000100:00100000:1.0:1746127005.803164:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991717760 00000100:00100000:1.0:1746127005.803222:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6602 00000100:00100000:1.0:1746127005.803230:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4374:x1830945991717760:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127005.804083:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4374:x1830945991717760:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 851us (998us total) trans 8589938258 rc 0/0 00000100:00100000:1.0:1746127005.804090:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6602 00000100:00100000:0.0:1746127005.805268:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.805331:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991717888 00000100:00100000:3.0:1746127005.805335:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991717888 00000100:00100000:3.0:1746127005.805369:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21750 00000100:00100000:3.0:1746127005.805374:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:4372:x1830945991717888:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.805386:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.805398:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535a5 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.805418:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 21 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.805426:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.805431:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.805433:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.805436:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3059712->3145727] (req 3059712->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.805457:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 7 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.805466:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 7 pid: 9613 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.805475:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279552:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.805539:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 21 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.805546:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 21 pid: 9611 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.805553:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279680:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.805568:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.809260:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279552:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.809304:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994279680:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127005.809305:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127005.809331:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3059712->3145727] (req 3059712->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.809345:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03000, rc 0) 00000100:00100000:2.0:1746127005.809359:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991718016 00000100:00100000:2.0:1746127005.809364:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991718016 00000100:00100000:3.0:1746127005.809378:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:4372:x1830945991717888:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4004us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.809385:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21750 00010000:00010000:2.0:1746127005.809386:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 8 pid: 9613 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.809404:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10192 00000100:00100000:2.0:1746127005.809409:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991718016:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.809422:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.809437:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 8 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.809446:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 8 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.809463:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7a00/0x34dc807b6efa357 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53551 expref: 8 pid: 9613 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.809484:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.809500:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991718016:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.809505:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10192 00000100:00100000:0.0:1746127005.810699:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.810742:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991718144 00000100:00100000:2.0:1746127005.810747:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991718144 00010000:00010000:2.0:1746127005.810764:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 21 pid: 9611 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.810791:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10193 00000100:00100000:2.0:1746127005.810797:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991718144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.810805:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.810815:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 21 pid: 9611 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.810824:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 21 pid: 9611 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.810839:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6200/0x34dc807b6efa349 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53543 expref: 21 pid: 9611 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.810848:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.810850:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127005.810855:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.810862:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.810885:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127005.810894:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994279808:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127005.810961:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746127005.813908:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.813991:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994279808:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127005.814007:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.814054:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991718144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3256us (3357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.814063:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10193 00000100:00100000:0.0:1746127005.814187:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991718400 00000100:00100000:0.0:1746127005.814192:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991718400 00002000:00100000:0.0:1746127005.814221:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3059712->3063807) req@ffff88009da74e00 x1830945991718400/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.814230:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74e00 with x1830945991718400 ext(3059712->3063807) 00002000:00010000:0.0:1746127005.814234:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da74e00 00000100:00100000:0.0:1746127005.814260:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8687 00000100:00100000:0.0:1746127005.814276:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2026:x1830945991718400:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127005.814368:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2026:x1830945991718400:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 103us (467us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127005.814374:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8687 00002000:00100000:0.0:1746127005.814378:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3059712->3063807) req@ffff88009da74e00 x1830945991718400/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.814384:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da74e00 with x1830945991718400 ext(3059712->3063807) 00002000:00010000:0.0:1746127005.814387:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da74e00 00000100:00100000:0.0:1746127005.817413:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.817527:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991718528 00000100:00100000:3.0:1746127005.817535:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991718528 00000100:00100000:3.0:1746127005.817580:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21751 00000100:00100000:3.0:1746127005.817586:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4372:x1830945991718528:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.817599:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.817612:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535ac expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.817635:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 37 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.817643:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 11 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.817648:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.817649:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.817652:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2920447] (req 2097152->2920447) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 37 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.817676:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 11 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.817687:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 11 pid: 9611 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.817698:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994279936:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.817779:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 37 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.817786:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 37 pid: 12340 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.817792:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994280064:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.817820:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.819232:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994279936:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.819243:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994280064:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.819264:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2920447] (req 2097152->2920447) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 37 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.819276:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02e00, rc 0) 00000100:00100000:3.0:1746127005.819313:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4372:x1830945991718528:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1727us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.819321:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21751 00000100:00100000:0.0:1746127005.823311:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.823403:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991718656 00000100:00100000:2.0:1746127005.823411:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991718656 00010000:00010000:2.0:1746127005.823440:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 37 pid: 12340 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746127005.823481:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10194 00000100:00100000:2.0:1746127005.823488:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991718656:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127005.823499:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127005.823515:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 37 pid: 12340 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.823524:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 37 pid: 12340 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.823544:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efa31f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53535 expref: 37 pid: 12340 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746127005.823573:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127005.823617:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991718656:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 129us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.823623:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10194 00000100:00100000:0.0:1746127005.827753:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.828337:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991718784 00000100:00100000:3.0:1746127005.828345:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991718784 00010000:00010000:3.0:1746127005.828376:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 12 pid: 9611 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.830026:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10195 00000100:00100000:3.0:1746127005.830044:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991718784:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.830058:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.830074:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 12 pid: 9611 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.830085:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 12 pid: 9611 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.830103:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6000/0x34dc807b6efa350 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5354a expref: 12 pid: 9611 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.830125:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.830126:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.830143:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 35 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.830150:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 35 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.830174:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 35 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.830183:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994280192:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127005.830252:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.838259:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994280192:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127005.838280:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.838320:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991718784:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8285us (10574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.838330:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10195 00000100:00100000:0.0:1746127005.846191:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.846371:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991719040 00000100:00100000:3.0:1746127005.846379:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991719040 00002000:00100000:3.0:1746127005.846418:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2916352->2920447) req@ffff880096630e00 x1830945991719040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.846426:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630e00 with x1830945991719040 ext(2916352->2920447) 00002000:00010000:3.0:1746127005.846431:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096630e00 00000100:00100000:3.0:1746127005.846451:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8688 00000100:00100000:3.0:1746127005.846457:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991719040:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127005.846599:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991719040:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 140us (414us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127005.846606:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8688 00002000:00100000:3.0:1746127005.846611:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2916352->2920447) req@ffff880096630e00 x1830945991719040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/4536 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.846622:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630e00 with x1830945991719040 ext(2916352->2920447) 00002000:00010000:3.0:1746127005.846624:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096630e00 00000100:00100000:0.0:1746127005.855661:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127005.856185:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991719296 00000100:00100000:1.0:1746127005.856193:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991719296 00000100:00100000:1.0:1746127005.856237:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6603 00000100:00100000:1.0:1746127005.856245:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4372:x1830945991719296:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127005.856416:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:4372:x1830945991719296:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 171us (760us total) trans 8589938259 rc 0/0 00000100:00100000:1.0:1746127005.856422:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6603 00010000:00010000:2.0:1746127005.895654:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127005.895858:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.895946:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991719552 00000100:00100000:3.0:1746127005.895958:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991719552 00000100:00100000:3.0:1746127005.896021:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17306 00000100:00100000:3.0:1746127005.896028:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:4382:x1830945991719552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.896057:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.896073:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03200/0x34dc807b6efa3d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535b3 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.897466:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897479:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897489:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897500:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897504:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897509:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897587:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897596:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897601:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:3.0:1746127005.897608:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127005.897662:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897671:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897675:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897681:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897685:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd03e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.897688:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897694:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897703:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127005.897706:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.897709:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.897713:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03e00/0x34dc807b6efa3dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898180:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898186:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898190:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898194:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd02200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127005.898196:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898200:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898206:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cde9400) 00010000:00010000:3.0:1746127005.898208:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127005.898210:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898214:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.898251:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd03200/0x34dc807b6efa3d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 55 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.898260:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 54 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.898266:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.898268:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127005.898269:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02c00, rc 0) 00000100:00100000:3.0:1746127005.898326:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:4382:x1830945991719552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2298us (2476us total) trans 8589938260 rc 0/0 00000100:00100000:3.0:1746127005.898332:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17306 00000100:00100000:0.0:1746127005.902000:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.902615:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991719808 00000100:00100000:3.0:1746127005.902622:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991719808 00000100:00100000:3.0:1746127005.902672:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6604 00000100:00100000:3.0:1746127005.902679:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:4382:x1830945991719808:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127005.902838:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:4382:x1830945991719808:12345-192.168.203.42@tcp:35:cat.0 Request processed in 159us (844us total) trans 8589938261 rc 0/0 00000100:00100000:3.0:1746127005.902844:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6604 00000100:00100000:0.0:1746127005.906380:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.906469:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991719936 00000100:00100000:3.0:1746127005.906475:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991719936 00000100:00100000:3.0:1746127005.906559:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21752 00000100:00100000:3.0:1746127005.906566:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991719936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.906579:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.906592:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535ba expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.906629:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994280320:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127005.907366:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.909559:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994280320:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127005.909588:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3f8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ba expref: 21 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.909601:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd02200/0x34dc807b6efa3f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ba expref: 21 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127005.909612:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02200, rc 0) 00000100:00100000:3.0:1746127005.909645:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991719936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3078us (3269us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127005.909652:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21752 00000100:00100000:0.0:1746127005.913521:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.913619:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991720064 00000100:00100000:3.0:1746127005.913628:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991720064 00000100:00100000:3.0:1746127005.913670:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21753 00000100:00100000:3.0:1746127005.913677:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:4382:x1830945991720064:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127005.913692:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.913707:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535c1 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.913731:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 6 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.913738:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127005.913739:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127005.913742:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.913765:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 6 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.913775:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 6 pid: 16295 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.913785:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994280448:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.913866:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127005.917271:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746127005.917289:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994280576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746127005.917340:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127005.917425:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994280576 00000100:00100000:0.0:1746127005.917431:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994280576 00000100:00100000:0.0:1746127005.917463:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1746127005.917469:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994280576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746127005.917486:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1128234304 pending 0 free 3907129344 avail 3666178048 00000100:00100000:0.0:1746127005.917519:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994280576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127005.917524:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1746127005.917597:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994280576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746127005.918332:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.918352:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991720192 00000100:00100000:0.0:1746127005.918355:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991720192 00002000:00100000:0.0:1746127005.918377:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (159744->286719) req@ffff8800a1788e00 x1830945991720192/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.918386:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788e00 with x1830945991720192 ext(159744->286719) 00010000:00010000:0.0:1746127005.918393:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 7 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.918404:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 7 pid: 16295 timeout: 1000 lvb_type: 0 00002000:00010000:0.0:1746127005.918410:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a1788e00 00000100:00100000:0.0:1746127005.918423:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1923 00000100:00100000:0.0:1746127005.918428:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991720192:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127005.918616:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994280448:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127005.918632:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 21 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.918649:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7400, rc 0) 00000100:00100000:2.0:1746127005.918670:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:4382:x1830945991720064:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4994us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127005.918676:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21753 00000100:00100000:0.0:1746127005.921769:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991720192:12345-192.168.203.42@tcp:4:cat.0 Request processed in 3332us (3431us total) trans 21474842878 rc 0/0 00000100:00100000:0.0:1746127005.921782:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1923 00002000:00100000:0.0:1746127005.921791:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (159744->286719) req@ffff8800a1788e00 x1830945991720192/t21474842878(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:11/0 lens 488/448 e 0 to 0 dl 1746127016 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127005.921800:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788e00 with x1830945991720192 ext(159744->286719) 00010000:00010000:0.0:1746127005.921807:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 9 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.921820:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 9 pid: 16295 timeout: 1000 lvb_type: 0 00002000:00010000:0.0:1746127005.921826:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a1788e00 00000100:00100000:0.0:1746127005.923898:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.924094:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991720320 00000100:00100000:3.0:1746127005.924102:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991720320 00010000:00010000:3.0:1746127005.924196:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 9 pid: 16295 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.924925:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10196 00000100:00100000:3.0:1746127005.924933:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991720320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.924947:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.924975:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 9 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.924987:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 9 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.925005:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7200/0x34dc807b6efa3b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 159744->286719) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53597 expref: 9 pid: 16295 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.925051:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.925053:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127005.925059:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.925068:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.925095:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127005.925105:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994280704:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127005.925194:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073780 going to sleep for 11 seconds 00000100:00100000:3.0:1746127005.929000:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994280704:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127005.929019:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.929082:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991720320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4146us (5184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.929092:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10196 00000100:00100000:2.0:1746127005.934841:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994280832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746127005.934900:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127005.935628:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994280832 00000100:00100000:1.0:1746127005.935637:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994280832 00000100:00100000:1.0:1746127005.935686:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1746127005.935694:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994280832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746127005.935713:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1106779456 pending 3489792 free 3910705152 avail 3679182848 00000100:00100000:1.0:1746127005.935765:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994280832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127005.935770:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1746127005.936017:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994280832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746127005.936315:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.936909:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991720576 00000100:00100000:3.0:1746127005.936914:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991720576 00000100:00100000:3.0:1746127005.936954:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17307 00000100:00100000:3.0:1746127005.936960:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4384:x1830945991720576:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127005.937016:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127005.937043:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535c8 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.937120:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.937150:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 31 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.937158:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 54 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.937164:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.937185:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 54 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.937201:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 54 pid: 7260 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.937210:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994280960:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127005.937293:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 31 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127005.937299:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 31 pid: 7260 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.937306:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994281088:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.937322:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127005.942920:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.942953:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.943023:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991720960 00000100:00100000:2.0:1746127005.943045:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991720960 00002000:00100000:2.0:1746127005.943083:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a1788700 x1830945991720960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.943092:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788700 with x1830945991720960 ext(0->1048575) 00002000:00010000:2.0:1746127005.943097:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1788700 00000100:00100000:0.0:1746127005.943115:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.943125:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991721088 00000100:00100000:2.0:1746127005.943141:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991721088 00000100:00100000:0.0:1746127005.943143:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991721472 00000100:00100000:0.0:1746127005.943146:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991721472 00002000:00100000:2.0:1746127005.943152:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a178b800 x1830945991721088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.943158:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178b800 with x1830945991721088 ext(1048576->2097151) 00002000:00100000:0.0:1746127005.943159:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a1788380 x1830945991721472/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746127005.943161:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178b800 00002000:00100000:0.0:1746127005.943165:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788380 with x1830945991721472 ext(1048576->2097151) 00002000:00010000:0.0:1746127005.943167:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a1788380 00000100:00100000:2.0:1746127005.943187:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8689 00000100:00100000:2.0:1746127005.943193:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2026:x1830945991720960:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127005.943341:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8690 00000100:00100000:0.0:1746127005.943347:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2026:x1830945991721088:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127005.944210:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8691 00000100:00100000:1.0:1746127005.944219:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991721472:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127005.944346:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.944360:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991721344 00000100:00100000:3.0:1746127005.944364:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991721344 00002000:00100000:3.0:1746127005.944380:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012238d180 x1830945991721344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.944386:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238d180 with x1830945991721344 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.944390:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238d180 00000100:00100000:3.0:1746127005.944400:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8692 00000100:00100000:3.0:1746127005.944404:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991721344:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127005.944835:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994280960:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.944981:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127005.944992:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994281088:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127005.944993:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991721856 00000100:00100000:3.0:1746127005.944995:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991721856 00010000:00010000:3.0:1746127005.945011:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 32 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746127005.945013:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:3.0:1746127005.945043:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10197 00000100:00100000:3.0:1746127005.945048:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2028:x1830945991721856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.945057:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.945062:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 32 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.945071:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 32 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.945086:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efa38f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53574 expref: 32 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.945098:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.945101:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.945108:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.945113:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127005.945157:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2028:x1830945991721856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 108us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.945163:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10197 00000100:00100000:3.0:1746127005.945199:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.945208:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991721728 00000100:00100000:3.0:1746127005.945211:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991721728 00010000:00010000:3.0:1746127005.945221:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 55 pid: 7260 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746127005.945238:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10198 00000100:00100000:3.0:1746127005.945243:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:2028:x1830945991721728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127005.945249:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127005.945252:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 55 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.945259:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 55 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.945269:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02c00/0x34dc807b6efa3ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535b3 expref: 55 pid: 7260 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746127005.945276:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127005.945279:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.945284:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.945289:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:3.0:1746127005.945300:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127005.945307:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127005.945312:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:3.0:1746127005.945325:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2028:x1830945991721728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127005.945330:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10198 00000004:00200000:0.0:1746127005.945389:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127005.945477:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efa406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 32 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.945492:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 31 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127005.945497:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127005.945499:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746127005.945501:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6000, rc 0) 00000100:00100000:0.0:1746127005.945519:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4384:x1830945991720576:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8560us (9206us total) trans 8589938262 rc 0/0 00000100:00100000:0.0:1746127005.945524:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17307 00000100:00100000:1.0:1746127005.955992:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991721472:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11770us (12871us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127005.956000:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8691 00002000:00100000:1.0:1746127005.956008:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a1788380 x1830945991721472/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127005.956014:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788380 with x1830945991721472 ext(1048576->2097151) 00002000:00010000:1.0:1746127005.956018:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a1788380 00000100:00100000:2.0:1746127005.960907:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991720960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17703us (17983us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127005.960918:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8689 00002000:00100000:2.0:1746127005.960929:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a1788700 x1830945991720960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.960937:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788700 with x1830945991720960 ext(0->1048575) 00002000:00010000:2.0:1746127005.960942:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1788700 00000100:00100000:2.0:1746127005.966503:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991721088:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23146us (23539us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127005.966514:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8690 00002000:00100000:2.0:1746127005.966525:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a178b800 x1830945991721088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.966533:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178b800 with x1830945991721088 ext(1048576->2097151) 00002000:00010000:2.0:1746127005.966538:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178b800 00000100:00100000:3.0:1746127005.972079:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991721344:12345-192.168.203.42@tcp:3:cat.0 Request processed in 27666us (27726us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127005.972093:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8692 00002000:00100000:3.0:1746127005.972113:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012238d180 x1830945991721344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.972122:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238d180 with x1830945991721344 ext(1048576->2097151) 00002000:00010000:3.0:1746127005.972126:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238d180 00000100:00100000:0.0:1746127005.984564:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.984618:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991722112 00000100:00100000:2.0:1746127005.984624:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991722112 00000100:00100000:2.0:1746127005.984662:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17308 00000100:00100000:2.0:1746127005.984667:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:4386:x1830945991722112:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127005.984684:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127005.984702:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa41b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535cf expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.984778:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.984790:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127005.984803:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:2.0:1746127005.984811:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127005.984882:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa41b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 57 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.984913:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 56 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127005.984920:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127005.984922:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127005.984925:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5a00, rc 0) 00000100:00100000:2.0:1746127005.984968:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:4386:x1830945991722112:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 300us (410us total) trans 8589938263 rc 0/0 00000100:00100000:2.0:1746127005.984972:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17308 00000100:00100000:0.0:1746127005.987354:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127005.987398:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991722368 00000100:00100000:3.0:1746127005.987404:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991722368 00002000:00100000:3.0:1746127005.987435:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a178aa00 x1830945991722368/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 504/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127005.987443:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178aa00 with x1830945991722368 ext(2097152->4194303) 00002000:00010000:3.0:1746127005.987448:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178aa00 00000100:00100000:3.0:1746127005.987471:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8693 00000100:00100000:3.0:1746127005.987478:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991722368:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127005.987979:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127005.988014:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991722624 00000100:00100000:2.0:1746127005.988019:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991722624 00002000:00100000:2.0:1746127005.988050:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2920448->4194303) req@ffff8800a178b100 x1830945991722624/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/0 e 0 to 0 dl 1746127016 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127005.988057:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178b100 with x1830945991722624 ext(2920448->4194303) 00002000:00010000:2.0:1746127005.988060:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a178b100 00000100:00100000:2.0:1746127005.988083:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8694 00000100:00100000:2.0:1746127005.988089:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991722624:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127006.001825:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991722368:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14338us (14466us total) trans 0 rc 2011136/2011136 00000100:00100000:3.0:1746127006.001835:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8693 00002000:00100000:3.0:1746127006.001845:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a178aa00 x1830945991722368/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 504/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 2011136/2011136 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.001854:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178aa00 with x1830945991722368 ext(2097152->4194303) 00002000:00010000:3.0:1746127006.001859:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a178aa00 00000100:00100000:2.0:1746127006.003442:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991722624:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15349us (15459us total) trans 0 rc 1273856/1273856 00000100:00100000:2.0:1746127006.003454:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8694 00002000:00100000:2.0:1746127006.003461:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2920448->4194303) req@ffff8800a178b100 x1830945991722624/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:11/0 lens 488/440 e 0 to 0 dl 1746127016 ref 1 fl Complete:/200/0 rc 1273856/1273856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.003469:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a178b100 with x1830945991722624 ext(2920448->4194303) 00002000:00010000:2.0:1746127006.003473:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a178b100 00000100:00100000:0.0:1746127006.009749:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.009844:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991722880 00000100:00100000:2.0:1746127006.009852:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991722880 00000100:00080000:0.0:1746127006.009932:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746127006.009957:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a1789880 x1830945991722880/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.009966:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789880 with x1830945991722880 ext(4194304->4829183) 00002000:00010000:2.0:1746127006.009971:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1789880 00000100:00100000:2.0:1746127006.009997:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8695 00000100:00100000:2.0:1746127006.010004:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991722880:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127006.014861:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991722880:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4851us (5112us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127006.014869:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8695 00002000:00100000:2.0:1746127006.014879:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a1789880 x1830945991722880/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.014888:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789880 with x1830945991722880 ext(4194304->4829183) 00002000:00010000:2.0:1746127006.014893:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1789880 00000100:00100000:0.0:1746127006.024047:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.024282:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991723008 00000100:00100000:2.0:1746127006.024291:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991723008 00000100:00100000:2.0:1746127006.024343:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21754 00000100:00100000:2.0:1746127006.024351:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991723008:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.024366:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.024381:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535d6 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.024398:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.024400:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.024407:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.024419:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.024429:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a4400, rc 0) 00000100:00100000:2.0:1746127006.024676:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991723008:12345-192.168.203.42@tcp:101:cat.0 Request processed in 325us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.024682:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21754 00000100:00100000:0.0:1746127006.029518:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.029903:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991723136 00000100:00100000:2.0:1746127006.029910:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991723136 00000100:00100000:2.0:1746127006.029960:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21755 00000100:00100000:2.0:1746127006.029967:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991723136:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.029982:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.029995:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944a5600/0x34dc807b6efa437 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535dd expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.030048:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994281216:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127006.030153:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.030465:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.030504:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991723264 00000100:00100000:3.0:1746127006.030509:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991723264 00000100:00100000:3.0:1746127006.030550:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21756 00000100:00100000:3.0:1746127006.030555:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991723264:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127006.030563:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.030571:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6000/0x34dc807b6efa43e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535e4 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.030595:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994281344:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127006.030628:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.033648:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994281344:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127006.033903:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994281216:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127006.033923:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5600/0x34dc807b6efa437 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535dd expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.033934:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5600/0x34dc807b6efa437 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535dd expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.033961:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5600, rc 0) 00000100:00100000:2.0:1746127006.033993:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991723136:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4026us (4481us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127006.034000:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21755 00010000:00010000:3.0:1746127006.034478:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6000/0x34dc807b6efa43e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535e4 expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.034489:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6000/0x34dc807b6efa43e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535e4 expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.034501:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e8e6000, rc 0) 00000100:00100000:3.0:1746127006.034519:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991723264:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3964us (4054us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127006.034525:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21756 00000100:00100000:1.0:1746127006.045089:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.045368:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.046681:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.046935:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991723520 00000100:00100000:2.0:1746127006.046943:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991723520 00002000:00100000:2.0:1746127006.046983:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009da77800 x1830945991723520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.046992:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77800 with x1830945991723520 ext(0->1048575) 00002000:00010000:2.0:1746127006.046997:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da77800 00000100:00100000:2.0:1746127006.047020:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991723776 00000100:00100000:2.0:1746127006.047023:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991723776 00002000:00100000:2.0:1746127006.047044:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009da75f80 x1830945991723776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.047050:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da75f80 with x1830945991723776 ext(1048576->2097151) 00002000:00010000:2.0:1746127006.047053:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da75f80 00000100:00100000:2.0:1746127006.047071:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8696 00000100:00100000:2.0:1746127006.047078:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991723520:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127006.048400:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8697 00000100:00100000:2.0:1746127006.048410:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991723776:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127006.050383:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.050432:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.050462:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991724160 00000100:00100000:1.0:1746127006.050468:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991724160 00002000:00100000:1.0:1746127006.050497:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009da77b80 x1830945991724160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.050509:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77b80 with x1830945991724160 ext(1048576->2097151) 00002000:00010000:1.0:1746127006.050513:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da77b80 00000100:00100000:1.0:1746127006.050526:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991724416 00000100:00100000:1.0:1746127006.050528:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991724416 00002000:00100000:1.0:1746127006.050538:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009da77100 x1830945991724416/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.050544:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77100 with x1830945991724416 ext(1048576->2097151) 00002000:00010000:1.0:1746127006.050546:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da77100 00000100:00100000:1.0:1746127006.050557:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8698 00000100:00100000:1.0:1746127006.050563:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991724160:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127006.051316:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8699 00000100:00100000:0.0:1746127006.051323:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991724416:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.052423:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991724032 00000100:00100000:3.0:1746127006.052430:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991724032 00000100:00100000:3.0:1746127006.052460:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21757 00000100:00100000:3.0:1746127006.052465:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4384:x1830945991724032:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127006.052473:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.052486:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535eb expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.052507:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 20 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.052516:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 14 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.052521:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.052523:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.052526:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 14 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.052549:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 14 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.052558:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 14 pid: 3542 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.052567:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994281472:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.052619:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 20 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.052626:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 20 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.052633:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994281600:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.052648:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.058190:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.058242:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991724544 00000100:00100000:3.0:1746127006.058249:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991724544 00000100:00100000:3.0:1746127006.058283:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21758 00000100:00100000:3.0:1746127006.058290:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:4386:x1830945991724544:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127006.058305:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.058319:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535f2 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.058341:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.058343:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.058347:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1904639] (req 1204224->1904639) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 22 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.058356:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1904639] (req 1204224->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 22 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.058366:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdad600, rc 0) 00000100:00100000:3.0:1746127006.058398:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:4386:x1830945991724544:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 108us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.058404:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21758 00000100:00100000:3.0:1746127006.059953:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994281472:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.059970:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994281600:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.059992:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 14 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.060006:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdaca00, rc 0) 00000100:00100000:3.0:1746127006.060045:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4384:x1830945991724032:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7579us (13365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.060053:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21757 00000100:00100000:2.0:1746127006.060196:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991723520:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13118us (15112us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127006.060203:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8696 00002000:00100000:2.0:1746127006.060210:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009da77800 x1830945991723520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.060218:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77800 with x1830945991723520 ext(0->1048575) 00002000:00010000:2.0:1746127006.060222:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da77800 00000100:00100000:0.0:1746127006.063222:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.065335:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991724672 00000100:00100000:3.0:1746127006.065345:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991724672 00010000:00010000:3.0:1746127006.065377:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 22 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.065414:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10199 00000100:00100000:3.0:1746127006.065420:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2029:x1830945991724672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.065431:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127006.065434:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991724160:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 14871us (15055us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127006.065441:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8698 00010000:00010000:3.0:1746127006.065445:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 22 pid: 9613 timeout: 1001 lvb_type: 1 00002000:00100000:0.0:1746127006.065448:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009da77b80 x1830945991724160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746127006.065453:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 22 pid: 9613 timeout: 1001 lvb_type: 1 00002000:00100000:0.0:1746127006.065456:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77b80 with x1830945991724160 ext(1048576->2097151) 00002000:00010000:0.0:1746127006.065459:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da77b80 00010000:00010000:3.0:1746127006.065470:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efa373 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5356d expref: 22 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.065497:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.065520:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2029:x1830945991724672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 100us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.065525:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10199 00000100:00100000:2.0:1746127006.070104:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991724416:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 18773us (19662us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127006.070114:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8699 00002000:00100000:2.0:1746127006.070124:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009da77100 x1830945991724416/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.070151:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77100 with x1830945991724416 ext(1048576->2097151) 00010000:00010000:2.0:1746127006.070160:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 10 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.070172:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 10 pid: 3542 timeout: 1001 lvb_type: 1 00002000:00010000:2.0:1746127006.070179:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009da77100 00000100:00100000:3.0:1746127006.071396:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991723776:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22985us (26025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.071404:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8697 00002000:00100000:3.0:1746127006.071410:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009da75f80 x1830945991723776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.071417:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da75f80 with x1830945991723776 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.071421:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009da75f80 00000100:00100000:0.0:1746127006.074205:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.074293:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991724800 00000100:00100000:1.0:1746127006.074301:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991724800 00010000:00010000:1.0:1746127006.074335:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 10 pid: 3542 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.074430:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10200 00000100:00100000:1.0:1746127006.074439:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991724800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.074450:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.074467:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 10 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.074478:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 10 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.074500:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4800/0x34dc807b6efa3b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53590 expref: 10 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.074528:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.074530:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.074536:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 9 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.074544:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 9 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.074551:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.074552:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.074555:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 20 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.074561:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 20 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.074585:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 20 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.074594:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994281728:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127006.076115:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 9 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.076148:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994281856:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127006.076305:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.076501:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b77f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.076539:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991724928 00000100:00100000:0.0:1746127006.076543:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991724928 00000100:00100000:1.0:1746127006.076643:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21759 00000100:00100000:1.0:1746127006.076649:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4389:x1830945991724928:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127006.076660:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.076671:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e535f9 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.076689:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 20 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.076696:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.076702:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746127006.076704:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746127006.076707:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 5/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.076725:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.076734:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 11 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.076746:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994281984:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.077050:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 20 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.077066:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 20 pid: 9611 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.077073:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994282112:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.077091:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.077545:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994281728:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127006.078157:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.078203:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991725184 00000100:00100000:3.0:1746127006.078207:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991725184 00002000:00100000:3.0:1746127006.078231:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1204224->1208319) req@ffff88009942c700 x1830945991725184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.078238:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c700 with x1830945991725184 ext(1204224->1208319) 00010000:00010000:3.0:1746127006.078243:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 21 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.078249:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 21 pid: 9611 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.078253:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942c700 00000100:00100000:3.0:1746127006.078274:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1924 00000100:00100000:3.0:1746127006.078278:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2029:x1830945991725184:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.078357:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2029:x1830945991725184:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 79us (201us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127006.078361:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1924 00002000:00100000:3.0:1746127006.078364:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1204224->1208319) req@ffff88009942c700 x1830945991725184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.078369:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c700 with x1830945991725184 ext(1204224->1208319) 00010000:00010000:3.0:1746127006.078371:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 21 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.078379:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 21 pid: 9611 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.078382:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942c700 00000100:00100000:0.0:1746127006.078389:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994281984:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.078397:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994282112:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.078412:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.078429:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994281856:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127006.078441:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.078449:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127006.078451:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc6800, rc 0) 00000100:00100000:3.0:1746127006.078452:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991725440 00000100:00100000:3.0:1746127006.078454:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991725440 00002000:00100000:3.0:1746127006.078463:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (2072576->2076671) req@ffff88012238c700 x1830945991725440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746127006.078471:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991724800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4034us (4273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.078474:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4389:x1830945991724928:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1826us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.078478:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10200 00000100:00100000:0.0:1746127006.078479:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21759 00002000:00100000:3.0:1746127006.078763:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238c700 with x1830945991725440 ext(2072576->2076671) 00010000:00010000:3.0:1746127006.078769:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 10 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.079090:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 10 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.079097:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238c700 00000100:00100000:3.0:1746127006.079114:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1925 00000100:00100000:3.0:1746127006.079119:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991725440:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.079189:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991725440:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 69us (775us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127006.079195:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1925 00002000:00100000:3.0:1746127006.079199:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (2072576->2076671) req@ffff88012238c700 x1830945991725440/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.079210:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238c700 with x1830945991725440 ext(2072576->2076671) 00010000:00010000:3.0:1746127006.079214:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 10 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.079221:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 10 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.079226:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238c700 00000100:00100000:0.0:1746127006.080657:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.080719:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991725696 00000100:00100000:2.0:1746127006.080726:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991725696 00002000:00100000:2.0:1746127006.080752:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (2072576->2097151) req@ffff88009942fb80 x1830945991725696/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.080766:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942fb80 with x1830945991725696 ext(2072576->2097151) 00010000:00010000:2.0:1746127006.080772:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 10 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.080781:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 10 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746127006.080788:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942fb80 00000100:00100000:2.0:1746127006.080822:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1926 00000100:00100000:2.0:1746127006.080829:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991725696:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127006.081310:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.081354:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991725824 00000100:00100000:2.0:1746127006.081358:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991725824 00000100:00100000:2.0:1746127006.081384:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21760 00000100:00100000:2.0:1746127006.081389:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4384:x1830945991725824:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127006.081396:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.081462:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53600 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.081483:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.081489:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.081490:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.081493:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2826239] (req 2097152->2826239) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.081522:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 20 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.081531:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 20 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.081540:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994282240:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.081596:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.084797:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.084941:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991725952 00000100:00100000:2.0:1746127006.084942:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994282240:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.084946:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991725952 00010000:00010000:2.0:1746127006.084963:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2826239] (req 2097152->2826239) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 15 pid: 16295 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746127006.084970:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3059712->3145727) req@ffff88009942f480 x1830945991725952/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746127006.084976:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ea800, rc 0) 00002000:00100000:3.0:1746127006.084977:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f480 with x1830945991725952 ext(3059712->3145727) 00010000:00010000:3.0:1746127006.084982:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 21 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.084990:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 21 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.084995:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942f480 00000100:00100000:2.0:1746127006.085017:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4384:x1830945991725824:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3628us (3707us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.085021:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1927 00000100:00100000:2.0:1746127006.085024:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21760 00000100:00100000:3.0:1746127006.085026:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991725952:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746127006.085462:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.085473:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991725696:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 4644us (4819us total) trans 21474842879 rc 0/0 00000100:00100000:0.0:1746127006.085480:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1926 00002000:00100000:0.0:1746127006.085485:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (2072576->2097151) req@ffff88009942fb80 x1830945991725696/t21474842879(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.085492:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942fb80 with x1830945991725696 ext(2072576->2097151) 00010000:00010000:0.0:1746127006.085498:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.085507:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746127006.085512:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942fb80 00000100:00100000:0.0:1746127006.085522:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991726208 00000100:00100000:0.0:1746127006.085525:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991726208 00002000:00100000:0.0:1746127006.085538:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1900544->1904639) req@ffff88009da77480 x1830945991726208/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.085545:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77480 with x1830945991726208 ext(1900544->1904639) 00010000:00010000:0.0:1746127006.085549:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 23 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.085556:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 23 pid: 9611 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746127006.085571:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009da77480 00000100:00100000:0.0:1746127006.085581:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1928 00000100:00100000:0.0:1746127006.085586:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945991726208:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127006.085657:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945991726208:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 70us (195us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127006.085663:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1928 00002000:00100000:0.0:1746127006.085667:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1900544->1904639) req@ffff88009da77480 x1830945991726208/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.085674:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da77480 with x1830945991726208 ext(1900544->1904639) 00010000:00010000:0.0:1746127006.085677:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 23 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.085684:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 23 pid: 9611 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746127006.085689:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009da77480 00000100:00100000:2.0:1746127006.087541:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.087656:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991726336 00000100:00100000:1.0:1746127006.087662:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991726336 00010000:00010000:1.0:1746127006.087686:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.087716:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10201 00000100:00100000:1.0:1746127006.087723:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991726336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.087736:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746127006.087746:0:26073:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127003 -> 1746127004 00002000:00010000:1.0:1746127006.087748:0:26073:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127003 -> 1746127004 00010000:00010000:1.0:1746127006.087753:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.087762:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.087780:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdaca00/0x34dc807b6efa445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1908736->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535eb expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.087805:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.087830:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991726336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 107us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.087836:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10201 00000100:00100000:3.0:1746127006.089086:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991725952:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 4055us (4291us total) trans 21474842880 rc 0/0 00000100:00100000:3.0:1746127006.089097:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1927 00002000:00100000:3.0:1746127006.089105:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3059712->3145727) req@ffff88009942f480 x1830945991725952/t21474842880(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.089113:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f480 with x1830945991725952 ext(3059712->3145727) 00010000:00010000:3.0:1746127006.089120:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 23 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.089145:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 23 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.089151:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942f480 00000100:00100000:0.0:1746127006.090843:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.090927:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991726592 00000100:00100000:3.0:1746127006.090933:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991726592 00002000:00100000:3.0:1746127006.090961:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1204224->1904639) req@ffff88009942dc00 x1830945991726592/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.090968:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942dc00 with x1830945991726592 ext(1204224->1904639) 00010000:00010000:3.0:1746127006.090974:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 23 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.090984:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 23 pid: 9611 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.090989:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942dc00 00000100:00100000:3.0:1746127006.091083:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1929 00000100:00100000:3.0:1746127006.091089:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991726592:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127006.095967:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.096336:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991726720 00000100:00100000:3.0:1746127006.096344:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991726720 00010000:00010000:3.0:1746127006.096382:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 25 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.096419:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10202 00000100:00100000:3.0:1746127006.096426:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991726720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.096435:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.096451:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 25 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.096461:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 25 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.096691:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd03000/0x34dc807b6efa3c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535a5 expref: 25 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.096715:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.096717:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.096723:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.096729:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.096845:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.096860:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994282368:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127006.097018:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.099908:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991726592:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8812us (9062us total) trans 21474842881 rc 0/0 00000100:00100000:3.0:1746127006.099919:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1929 00002000:00100000:3.0:1746127006.099930:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1204224->1904639) req@ffff88009942dc00 x1830945991726592/t21474842881(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.099939:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942dc00 with x1830945991726592 ext(1204224->1904639) 00010000:00010000:3.0:1746127006.099946:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 25 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.099960:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 25 pid: 9611 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.099967:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942dc00 00000100:00100000:2.0:1746127006.100564:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994282368:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127006.100580:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.100599:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2026:x1830945991726720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4174us (4640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.100607:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10202 00000100:00100000:0.0:1746127006.107332:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.107407:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.107583:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991727104 00000100:00100000:3.0:1746127006.107598:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991727104 00000100:00100000:2.0:1746127006.107625:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991726976 00000100:00100000:2.0:1746127006.107635:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991726976 00002000:00100000:3.0:1746127006.107647:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2822144->2826239) req@ffff88009942f100 x1830945991727104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.107658:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f100 with x1830945991727104 ext(2822144->2826239) 00002000:00010000:3.0:1746127006.107664:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942f100 00010000:00010000:2.0:1746127006.107677:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 24 pid: 9611 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.107727:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10203 00000100:00100000:2.0:1746127006.107736:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991726976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.107755:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.107779:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 24 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.107793:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 24 pid: 9611 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.107820:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efa44c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1204224->1908735] (req 1204224->1904639) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f2 expref: 24 pid: 9611 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.107892:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8700 00000100:00100000:0.0:1746127006.107902:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991727104:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127006.108054:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991727104:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 153us (736us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127006.108063:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8700 00002000:00100000:0.0:1746127006.108069:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2822144->2826239) req@ffff88009942f100 x1830945991727104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.108075:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f100 with x1830945991727104 ext(2822144->2826239) 00002000:00010000:0.0:1746127006.108078:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942f100 00010000:00010000:2.0:1746127006.108347:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.108349:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.108357:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.108367:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.108404:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.108417:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994282496:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127006.109008:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.113193:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994282496:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127006.113216:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.113273:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991726976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5536us (5863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.113284:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10203 00000100:00100000:0.0:1746127006.116028:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.116226:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991727360 00000100:00100000:3.0:1746127006.116237:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991727360 00002000:00100000:3.0:1746127006.116279:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009942e300 x1830945991727360/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.116290:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942e300 with x1830945991727360 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.116295:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942e300 00000100:00100000:3.0:1746127006.116646:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8701 00000100:00100000:3.0:1746127006.116654:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991727360:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.123894:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991727360:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 7232us (7867us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.123905:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8701 00002000:00100000:3.0:1746127006.123915:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009942e300 x1830945991727360/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.123924:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942e300 with x1830945991727360 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.123929:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942e300 00000100:00100000:0.0:1746127006.139160:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.140044:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991727616 00000100:00100000:3.0:1746127006.140052:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991727616 00002000:00100000:3.0:1746127006.140089:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2826240->3145727) req@ffff88009942c000 x1830945991727616/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.140098:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c000 with x1830945991727616 ext(2826240->3145727) 00002000:00010000:3.0:1746127006.140103:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942c000 00000100:00100000:3.0:1746127006.140150:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8702 00000100:00100000:3.0:1746127006.140158:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991727616:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127006.146877:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991727616:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6711us (7746us total) trans 0 rc 319488/319488 00000100:00100000:3.0:1746127006.146889:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8702 00002000:00100000:3.0:1746127006.146902:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2826240->3145727) req@ffff88009942c000 x1830945991727616/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 319488/319488 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.146911:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c000 with x1830945991727616 ext(2826240->3145727) 00002000:00010000:3.0:1746127006.146915:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942c000 00000100:00100000:0.0:1746127006.151359:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.151558:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991727744 00000100:00100000:2.0:1746127006.151567:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991727744 00000100:00100000:2.0:1746127006.151624:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21761 00000100:00100000:2.0:1746127006.151634:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4389:x1830945991727744:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.151655:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.151674:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53607 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.151707:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 35 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.151715:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.151716:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.151720:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 12 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.151751:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 35 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.151763:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 35 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.151780:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994282624:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.151898:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace696c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.155124:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994282624:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.155288:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 12 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.155306:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ebc00, rc 0) 00000100:00100000:2.0:1746127006.155659:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4389:x1830945991727744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4025us (4308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.155668:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21761 00000100:00100000:0.0:1746127006.156403:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.156460:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991727872 00000100:00100000:3.0:1746127006.156467:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991727872 00000100:00080000:0.0:1746127006.156496:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1746127006.156511:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2920447) req@ffff88009942ce00 x1830945991727872/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.156520:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ce00 with x1830945991727872 ext(2097152->2920447) 00010000:00010000:3.0:1746127006.156527:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 36 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.156539:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 36 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.156546:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009942ce00 00000100:00100000:3.0:1746127006.156559:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1930 00000100:00100000:3.0:1746127006.156566:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991727872:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127006.165498:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991727872:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8922us (9085us total) trans 17179875615 rc 0/0 00000100:00100000:3.0:1746127006.165511:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1930 00002000:00100000:3.0:1746127006.165522:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2920447) req@ffff88009942ce00 x1830945991727872/t17179875615(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.165531:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ce00 with x1830945991727872 ext(2097152->2920447) 00010000:00010000:3.0:1746127006.165541:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 38 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.165557:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 38 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.165564:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009942ce00 00000100:00100000:0.0:1746127006.170861:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.171066:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991728000 00000100:00100000:2.0:1746127006.171076:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991728000 00010000:00010000:2.0:1746127006.171114:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 38 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.171184:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10204 00000100:00100000:2.0:1746127006.171191:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991728000:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.171206:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.171226:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 38 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.171237:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 38 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.171268:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efa3ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2920447) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535ac expref: 38 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.171291:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.171293:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.171300:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.171308:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.171339:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.171350:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994282752:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127006.171436:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace696c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.179521:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994282752:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127006.179540:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.179579:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991728000:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8388us (8728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.179587:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10204 00000100:00100000:0.0:1746127006.188714:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.188762:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.188827:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991728256 00000100:00100000:3.0:1746127006.188835:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991728512 00000100:00100000:1.0:1746127006.188837:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991728256 00000100:00100000:3.0:1746127006.188840:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991728512 00002000:00100000:3.0:1746127006.188879:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009942d180 x1830945991728512/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.188880:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009942e680 x1830945991728256/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.188888:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d180 with x1830945991728512 ext(3145728->4194303) 00002000:00100000:1.0:1746127006.188888:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942e680 with x1830945991728256 ext(2097152->4194303) 00002000:00010000:3.0:1746127006.188893:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942d180 00002000:00010000:1.0:1746127006.188893:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942e680 00000100:00100000:3.0:1746127006.188925:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8703 00000100:00100000:1.0:1746127006.188931:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8704 00000100:00100000:3.0:1746127006.188934:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991728512:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127006.188936:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991728256:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127006.195406:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991728512:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6465us (6633us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.195417:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8703 00002000:00100000:3.0:1746127006.195428:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009942d180 x1830945991728512/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.195437:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d180 with x1830945991728512 ext(3145728->4194303) 00002000:00010000:3.0:1746127006.195442:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942d180 00000100:00100000:1.0:1746127006.201105:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991728256:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12157us (12390us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127006.201118:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8704 00002000:00100000:1.0:1746127006.201154:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009942e680 x1830945991728256/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.201164:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942e680 with x1830945991728256 ext(2097152->4194303) 00002000:00010000:1.0:1746127006.201170:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942e680 00000100:00100000:0.0:1746127006.208646:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.208767:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991728768 00000100:00100000:1.0:1746127006.208778:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991728768 00002000:00100000:1.0:1746127006.209492:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009942ea00 x1830945991728768/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.209502:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ea00 with x1830945991728768 ext(4194304->4829183) 00002000:00010000:1.0:1746127006.209507:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942ea00 00000100:00100000:1.0:1746127006.209543:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8705 00000100:00100000:1.0:1746127006.209551:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991728768:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127006.216319:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991728768:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6756us (7670us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127006.216331:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8705 00002000:00100000:1.0:1746127006.216341:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009942ea00 x1830945991728768/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.216351:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ea00 with x1830945991728768 ext(4194304->4829183) 00002000:00010000:1.0:1746127006.216357:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942ea00 00000100:00100000:0.0:1746127006.246816:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.246850:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.246885:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991728896 00000100:00100000:0.0:1746127006.246894:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.246895:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991728896 00000100:00100000:2.0:1746127006.246946:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991729024 00000100:00100000:2.0:1746127006.246948:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991729024 00000100:00100000:2.0:1746127006.246961:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991729152 00000100:00100000:2.0:1746127006.246963:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991729152 00000100:00100000:1.0:1746127006.247157:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21762 00000100:00100000:1.0:1746127006.247169:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991728896:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127006.247189:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.247207:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5360e expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.247229:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.247231:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.247240:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 25 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.247255:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 25 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.247266:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b83a00, rc 0) 00000100:00100000:1.0:1746127006.247308:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991728896:12345-192.168.203.42@tcp:101:cat.0 Request processed in 144us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.247314:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21762 00000100:00100000:1.0:1746127006.247329:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21763 00000100:00100000:1.0:1746127006.247333:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991729024:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127006.247338:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.247344:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83400/0x34dc807b6efa46f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53615 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.247380:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994282880:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127006.247435:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.247536:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21764 00000100:00100000:2.0:1746127006.247543:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991729152:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.247552:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.247565:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5361c expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.247579:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.247580:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.247587:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 38 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.247598:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 38 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.247606:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eae00, rc 0) 00000100:00100000:2.0:1746127006.247633:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991729152:12345-192.168.203.42@tcp:101:cat.0 Request processed in 89us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.247639:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21764 00000100:00100000:1.0:1746127006.251203:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994282880:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127006.251266:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83400/0x34dc807b6efa46f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53615 expref: 25 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.251281:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83400/0x34dc807b6efa46f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53615 expref: 25 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.251312:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b83400, rc 0) 00000100:00100000:1.0:1746127006.251372:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991729024:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4037us (4519us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127006.251380:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21763 00000100:00100000:0.0:1746127006.268976:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.269421:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991729408 00000100:00100000:1.0:1746127006.269431:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991729408 00002000:00100000:1.0:1746127006.269478:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009c428380 x1830945991729408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.269489:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428380 with x1830945991729408 ext(1048576->2097151) 00002000:00010000:1.0:1746127006.269494:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428380 00000100:00100000:1.0:1746127006.269532:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8706 00000100:00100000:1.0:1746127006.269540:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991729408:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127006.276985:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991729408:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7434us (8008us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127006.276997:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8706 00002000:00100000:1.0:1746127006.277009:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009c428380 x1830945991729408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.277018:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428380 with x1830945991729408 ext(1048576->2097151) 00002000:00010000:1.0:1746127006.277023:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428380 00000100:00100000:0.0:1746127006.287470:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.287524:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991729536 00000100:00100000:1.0:1746127006.287535:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991729536 00000100:00100000:1.0:1746127006.288304:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21765 00000100:00100000:1.0:1746127006.288316:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4398:x1830945991729536:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127006.288339:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.288361:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53623 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.288395:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.288402:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127006.288404:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127006.288407:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.288443:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 11 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.288456:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 11 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.288469:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994283008:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.289429:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.294489:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994283008:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.294607:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.294699:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991729664 00000100:00100000:2.0:1746127006.294705:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991729664 00002000:00100000:2.0:1746127006.294750:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2826239) req@ffff88009c42a680 x1830945991729664/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.294760:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42a680 with x1830945991729664 ext(2097152->2826239) 00010000:00010000:2.0:1746127006.294768:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 12 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.294782:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 12 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746127006.294789:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c42a680 00000100:00100000:2.0:1746127006.294824:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1931 00000100:00100000:2.0:1746127006.294831:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991729664:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:1.0:1746127006.295160:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.295179:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82e00, rc 0) 00000100:00100000:1.0:1746127006.295207:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:4398:x1830945991729536:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6895us (7749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.295215:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21765 00000100:00100000:2.0:1746127006.308189:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991729664:12345-192.168.203.42@tcp:4:cat.0 Request processed in 13347us (13571us total) trans 21474842882 rc 0/0 00000100:00100000:2.0:1746127006.308203:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1931 00002000:00100000:2.0:1746127006.308215:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2826239) req@ffff88009c42a680 x1830945991729664/t21474842882(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.308224:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42a680 with x1830945991729664 ext(2097152->2826239) 00010000:00010000:2.0:1746127006.308235:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 14 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.308251:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 14 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746127006.308259:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c42a680 00000100:00100000:0.0:1746127006.320556:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.320715:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991729792 00000100:00100000:2.0:1746127006.320724:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991729792 00010000:00010000:2.0:1746127006.320761:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 14 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.320797:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10205 00000100:00100000:2.0:1746127006.320803:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991729792:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.320819:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.320838:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 14 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.320849:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 14 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.320874:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea800/0x34dc807b6efa45a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2826239) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53600 expref: 14 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.320892:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.320894:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.320901:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 24 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.320909:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 24 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.320940:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 24 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.320951:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994283136:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127006.321052:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.325768:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994283136:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127006.325791:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127006.325833:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991729792:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5029us (5286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.325845:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10205 00000100:00100000:0.0:1746127006.358239:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.358301:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.358374:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.358542:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991730048 00000100:00100000:2.0:1746127006.358554:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991730048 00002000:00100000:2.0:1746127006.358613:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009c428e00 x1830945991730048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.358630:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428e00 with x1830945991730048 ext(2097152->4194303) 00002000:00010000:2.0:1746127006.358636:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428e00 00000100:00100000:2.0:1746127006.358659:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991730304 00000100:00100000:2.0:1746127006.358663:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991730304 00002000:00100000:2.0:1746127006.358681:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c42b100 x1830945991730304/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.358688:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b100 with x1830945991730304 ext(2097152->4194303) 00002000:00010000:2.0:1746127006.358690:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c42b100 00000100:00100000:2.0:1746127006.358718:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8707 00000100:00100000:2.0:1746127006.358728:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991730048:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127006.359514:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991730432 00000100:00100000:1.0:1746127006.359523:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991730432 00000100:00100000:1.0:1746127006.359572:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21766 00000100:00100000:1.0:1746127006.359579:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4394:x1830945991730432:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:0.0:1746127006.359589:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8708 00010000:00010000:1.0:1746127006.359594:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127006.359603:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991730304:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:1.0:1746127006.359608:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5362a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.359668:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 12 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.359678:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 28 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.359683:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.359685:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.359688:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1757184->2097151] (req 1757184->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.359730:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 28 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.359745:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 28 pid: 3542 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.359755:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994283264:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.359886:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 12 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.359894:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 12 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.359902:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994283392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.359919:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.373331:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.373385:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.373534:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994283264:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.373545:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994283392:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.373902:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991730688 00000100:00100000:0.0:1746127006.373904:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991730560 00000100:00100000:2.0:1746127006.373910:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991730688 00000100:00100000:0.0:1746127006.373916:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991730560 00010000:00010000:2.0:1746127006.373947:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.373948:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 29 pid: 3542 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.373980:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10206 00000100:00100000:0.0:1746127006.373987:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10207 00000100:00100000:2.0:1746127006.373988:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991730688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127006.373994:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991730560:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.374002:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127006.374008:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.374021:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.374026:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 29 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.374042:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.374057:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 29 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.374083:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bc6800/0x34dc807b6efa453 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535f9 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.374093:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83a00/0x34dc807b6efa468 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5360e expref: 29 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746127006.374122:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.374124:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.374161:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.374169:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.374179:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127006.374196:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.374206:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994283520:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127006.374306:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 28 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.374317:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b83c00, rc 0) 00000100:00100000:2.0:1746127006.374329:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991730688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 341us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.374337:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10206 00000100:00100000:0.0:1746127006.374342:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.374349:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4394:x1830945991730432:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 14769us (15975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.374356:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21766 00000100:00100000:2.0:1746127006.381893:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991730304:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22284us (23579us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127006.381907:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8708 00002000:00100000:2.0:1746127006.381918:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c42b100 x1830945991730304/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.381927:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b100 with x1830945991730304 ext(2097152->4194303) 00002000:00010000:2.0:1746127006.381932:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c42b100 00000100:00100000:0.0:1746127006.384361:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.384431:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c429180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994283520:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127006.384457:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.384501:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991730560:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10505us (11113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.384511:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10207 00000100:00100000:3.0:1746127006.385463:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991730944 00000100:00100000:3.0:1746127006.385471:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991730944 00002000:00100000:3.0:1746127006.385509:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1757184->1761279) req@ffff88009c42bb80 x1830945991730944/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.385524:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42bb80 with x1830945991730944 ext(1757184->1761279) 00002000:00010000:3.0:1746127006.385529:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42bb80 00000100:00100000:3.0:1746127006.385551:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8709 00000100:00100000:3.0:1746127006.385557:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991730944:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.385695:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991730944:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 137us (1342us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127006.385701:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8709 00002000:00100000:3.0:1746127006.385706:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1757184->1761279) req@ffff88009c42bb80 x1830945991730944/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.385712:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42bb80 with x1830945991730944 ext(1757184->1761279) 00002000:00010000:3.0:1746127006.385715:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42bb80 00000100:00100000:0.0:1746127006.389936:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.390089:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991730048:12345-192.168.203.42@tcp:3:cat.0 Request processed in 31362us (31861us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127006.390101:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8707 00002000:00100000:2.0:1746127006.390112:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009c428e00 x1830945991730048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.390154:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428e00 with x1830945991730048 ext(2097152->4194303) 00002000:00010000:2.0:1746127006.390161:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428e00 00000100:00100000:1.0:1746127006.390285:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991731072 00000100:00100000:1.0:1746127006.390293:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991731072 00000100:00100000:1.0:1746127006.390335:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21767 00000100:00100000:1.0:1746127006.390341:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4400:x1830945991731072:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127006.390358:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.390377:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53631 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.390403:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.390410:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 37 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.390416:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.390417:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.390421:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->4194303] (req 3969024->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 13 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.390449:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 37 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.390459:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 37 pid: 1507 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.390471:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994283648:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.390546:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.390557:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.390564:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994283776:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.390595:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.392548:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994283648:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.392561:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994283776:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.392630:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->4194303] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 13 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.392648:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094aff400, rc 0) 00000100:00100000:1.0:1746127006.392702:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4400:x1830945991731072:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2359us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.392710:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21767 00000100:00100000:0.0:1746127006.394263:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.394327:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.394501:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991731200 00000100:00100000:1.0:1746127006.394508:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991731200 00000100:00100000:2.0:1746127006.394529:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991731328 00000100:00100000:2.0:1746127006.394533:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991731328 00000100:00100000:1.0:1746127006.394576:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21768 00000100:00100000:2.0:1746127006.394581:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21769 00000100:00100000:1.0:1746127006.394582:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4398:x1830945991731200:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127006.394588:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:4394:x1830945991731328:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127006.394598:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.394598:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.394613:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5363f expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.394613:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53638 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.394633:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.394635:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.394637:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.394642:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 39 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.394643:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.394645:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.394648:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2609151] (req 2097152->2609151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 26 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.394655:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 39 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.394663:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baff800, rc 0) 00010000:00010000:2.0:1746127006.394673:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.394683:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 26 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.394695:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994283904:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.394704:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4398:x1830945991731200:12345-192.168.203.42@tcp:101:cat.0 Request processed in 121us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.394709:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21768 00000100:00100000:2.0:1746127006.394747:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.397052:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.397176:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991731456 00000100:00100000:2.0:1746127006.397183:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991731456 00010000:00010000:2.0:1746127006.397216:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.397850:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10208 00000100:00100000:2.0:1746127006.397859:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991731456:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.397873:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.397898:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.397909:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.397932:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995ebc00/0x34dc807b6efa461 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53607 expref: 13 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.397964:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.398432:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991731456:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 573us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.398440:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10208 00000100:00100000:0.0:1746127006.400066:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.400104:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.400173:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.400211:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991731840 00000100:00100000:0.0:1746127006.400217:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991731840 00000100:00100000:3.0:1746127006.400221:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991731584 00000100:00100000:3.0:1746127006.400225:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991731584 00010000:00010000:3.0:1746127006.400248:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 40 pid: 1507 timeout: 1001 lvb_type: 1 00002000:00100000:0.0:1746127006.400257:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88009c429180 x1830945991731840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.400266:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429180 with x1830945991731840 ext(2097152->3145727) 00002000:00010000:0.0:1746127006.400270:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c429180 00000100:00100000:3.0:1746127006.400275:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991731968 00000100:00100000:3.0:1746127006.400278:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991731968 00000100:00100000:0.0:1746127006.400286:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8710 00010000:00010000:3.0:1746127006.400289:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 27 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.400292:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991731840:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.400304:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10209 00000100:00100000:2.0:1746127006.400541:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994283904:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.400566:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2609151] (req 2097152->2609151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 27 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.400581:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ea000, rc 0) 00000100:00100000:2.0:1746127006.400623:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4394:x1830945991731328:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6034us (6293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.400631:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21769 00000100:00100000:3.0:1746127006.400941:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991731584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.400951:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.400968:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 41 pid: 1507 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.400980:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 41 pid: 1507 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.401000:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995eae00/0x34dc807b6efa476 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5361c expref: 41 pid: 1507 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.401001:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10210 00010000:00010000:3.0:1746127006.401022:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.401024:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.401040:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 11 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.401048:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 11 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.401077:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 11 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.401088:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994284032:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127006.401145:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.401200:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2028:x1830945991731968:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.401209:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.401224:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 26 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.401234:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 26 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.401248:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa47d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53623 expref: 26 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.401261:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.401263:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.401266:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.401272:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.401295:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.401301:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994284160:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127006.401324:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.404989:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994284032:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127006.405918:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.405948:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991732224 00000100:00100000:0.0:1746127006.405954:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991732224 00002000:00100000:0.0:1746127006.405995:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3969024->3973119) req@ffff88009c4cfb80 x1830945991732224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.406005:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cfb80 with x1830945991732224 ext(3969024->3973119) 00002000:00010000:0.0:1746127006.406010:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cfb80 00000100:00100000:0.0:1746127006.406049:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8711 00000100:00100000:0.0:1746127006.406057:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991732224:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:3.0:1746127006.406150:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.406194:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991731584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5884us (6134us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.406204:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10209 00000100:00100000:1.0:1746127006.406664:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994284160:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127006.406701:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.406721:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945991731968:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5524us (6547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.406728:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10210 00000100:00100000:2.0:1746127006.407374:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991731840:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 7081us (7268us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127006.407382:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8710 00002000:00100000:2.0:1746127006.407388:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88009c429180 x1830945991731840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.407396:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429180 with x1830945991731840 ext(2097152->3145727) 00002000:00010000:2.0:1746127006.407400:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c429180 00000100:00100000:0.0:1746127006.407920:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991732224:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 1862us (2003us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127006.407927:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8711 00002000:00100000:0.0:1746127006.407932:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3969024->3973119) req@ffff88009c4cfb80 x1830945991732224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.407939:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cfb80 with x1830945991732224 ext(3969024->3973119) 00002000:00010000:0.0:1746127006.407943:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cfb80 00000100:00100000:0.0:1746127006.408454:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.408490:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991732480 00000100:00100000:2.0:1746127006.408495:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991732480 00002000:00100000:2.0:1746127006.408522:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2605056->2609151) req@ffff88009c4ced80 x1830945991732480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.408529:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ced80 with x1830945991732480 ext(2605056->2609151) 00002000:00010000:2.0:1746127006.408532:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4ced80 00000100:00100000:2.0:1746127006.408916:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8712 00000100:00100000:2.0:1746127006.408924:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2027:x1830945991732480:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127006.409014:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2027:x1830945991732480:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 91us (560us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127006.409020:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8712 00002000:00100000:2.0:1746127006.409025:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2605056->2609151) req@ffff88009c4ced80 x1830945991732480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.409042:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ced80 with x1830945991732480 ext(2605056->2609151) 00002000:00010000:2.0:1746127006.409045:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4ced80 00000100:00100000:2.0:1746127006.414613:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.414664:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991732608 00000100:00100000:0.0:1746127006.414674:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991732608 00000100:00100000:0.0:1746127006.414734:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21770 00000100:00100000:0.0:1746127006.414746:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4400:x1830945991732608:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127006.414778:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.414799:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53646 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.414828:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 24 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.414835:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.414837:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.414840:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4505599] (req 4194304->4505599) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.414870:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 24 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.414882:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 24 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.414894:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994284288:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.415336:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.416194:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.416242:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991732864 00000100:00100000:3.0:1746127006.416247:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991732864 00002000:00100000:3.0:1746127006.416285:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cca80 x1830945991732864/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.416294:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cca80 with x1830945991732864 ext(3145728->4194303) 00010000:00010000:3.0:1746127006.416301:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 25 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.416313:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 25 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.416320:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4cca80 00000100:00100000:3.0:1746127006.416834:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1932 00000100:00100000:3.0:1746127006.416842:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991732864:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127006.424091:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.424237:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991732992 00000100:00100000:3.0:1746127006.424246:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991732992 00002000:00100000:3.0:1746127006.424291:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2609151) req@ffff88009c4ce300 x1830945991732992/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.424301:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ce300 with x1830945991732992 ext(2097152->2609151) 00010000:00010000:3.0:1746127006.424311:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.424325:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.424333:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4ce300 00000100:00100000:3.0:1746127006.424351:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1933 00000100:00100000:3.0:1746127006.424358:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991732992:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127006.424967:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994284288:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.425325:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4505599] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 13 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.425341:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009914b200, rc 0) 00000100:00100000:2.0:1746127006.425376:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006f003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4400:x1830945991732608:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10631us (10773us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.425384:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21770 00000100:00100000:3.0:1746127006.425385:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991732864:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 8543us (9195us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.425393:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1932 00002000:00100000:3.0:1746127006.425400:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cca80 x1830945991732864/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.425408:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cca80 with x1830945991732864 ext(3145728->4194303) 00010000:00010000:3.0:1746127006.425414:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.425425:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.425431:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4cca80 00000100:00100000:0.0:1746127006.425552:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.425572:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991733120 00000100:00100000:2.0:1746127006.425576:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991733120 00000100:00100000:2.0:1746127006.425598:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21771 00000100:00100000:2.0:1746127006.425603:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4398:x1830945991733120:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.425613:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.425625:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5364d expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.425640:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.425642:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.425646:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 28 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.425654:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 28 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.425662:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d200, rc 0) 00000100:00100000:2.0:1746127006.425694:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4398:x1830945991733120:12345-192.168.203.42@tcp:101:cat.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.425699:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21771 00000100:00100000:3.0:1746127006.430458:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991732992:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 6087us (6365us total) trans 21474842883 rc 0/0 00000100:00100000:3.0:1746127006.430472:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1933 00002000:00100000:3.0:1746127006.430484:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2609151) req@ffff88009c4ce300 x1830945991732992/t21474842883(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.430494:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ce300 with x1830945991732992 ext(2097152->2609151) 00010000:00010000:3.0:1746127006.430504:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.430519:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.430527:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4ce300 00000100:00100000:0.0:1746127006.434650:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.434751:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991733248 00000100:00100000:1.0:1746127006.434760:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991733248 00010000:00010000:1.0:1746127006.434798:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.434937:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10211 00000100:00100000:1.0:1746127006.435074:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991733248:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.435087:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746127006.435105:0:7247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127004 -> 1746127005 00002000:00010000:1.0:1746127006.435108:0:7247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127004 -> 1746127005 00010000:00010000:1.0:1746127006.435113:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.435126:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.435305:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995ea000/0x34dc807b6efa492 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2609151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5363f expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.435331:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.435333:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.435340:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 12 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.435348:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 12 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.435356:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.435357:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.435360:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 27 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.435365:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 27 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.435414:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 27 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.435425:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994284416:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127006.435751:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 12 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.435766:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994284544:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127006.435786:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.446920:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.446968:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.447054:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991733632 00000100:00100000:2.0:1746127006.447063:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991733632 00000100:00100000:1.0:1746127006.447089:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994284416:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127006.447099:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994284544:192.168.203.42@tcp:105: 00002000:00100000:2.0:1746127006.447113:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cc700 x1830945991733632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.447123:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc700 with x1830945991733632 ext(3145728->4194303) 00000100:00100000:3.0:1746127006.447162:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991733760 00002000:00010000:2.0:1746127006.447162:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cc700 00000100:00100000:3.0:1746127006.447166:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991733760 00000100:00100000:2.0:1746127006.447185:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8713 00002000:00100000:3.0:1746127006.447186:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4501504->4505599) req@ffff88009c4cf100 x1830945991733760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746127006.447193:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991733632:12345-192.168.203.42@tcp:3:multiop.0 00002000:00100000:3.0:1746127006.447195:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cf100 with x1830945991733760 ext(4501504->4505599) 00002000:00010000:3.0:1746127006.447198:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cf100 00000100:00100000:3.0:1746127006.447212:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8714 00000100:00100000:3.0:1746127006.447218:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991733760:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:1.0:1746127006.447268:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.447308:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991733248:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 12237us (12667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.447316:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991733760:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 97us (347us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127006.447316:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10211 00000100:00100000:3.0:1746127006.447322:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8714 00002000:00100000:3.0:1746127006.447327:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4501504->4505599) req@ffff88009c4cf100 x1830945991733760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.447335:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cf100 with x1830945991733760 ext(4501504->4505599) 00002000:00010000:3.0:1746127006.447337:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cf100 00000100:00100000:2.0:1746127006.470716:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991733632:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 23512us (23794us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127006.470731:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8713 00002000:00100000:2.0:1746127006.470743:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c4cc700 x1830945991733632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.470753:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc700 with x1830945991733632 ext(3145728->4194303) 00002000:00010000:2.0:1746127006.470758:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4cc700 00000100:00100000:0.0:1746127006.484338:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.484528:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991733888 00000100:00100000:2.0:1746127006.484536:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991733888 00000100:00100000:2.0:1746127006.484588:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21772 00000100:00100000:2.0:1746127006.484596:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4398:x1830945991733888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.484616:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.484633:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53654 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.484661:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 11 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.484667:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.484669:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.484672:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 39 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.484695:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 11 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.484707:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 11 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.484717:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994284672:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.485236:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.488271:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.488308:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.488763:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.489205:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991734016 00000100:00100000:3.0:1746127006.489213:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991734016 00000100:00100000:3.0:1746127006.489245:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991734272 00000100:00100000:3.0:1746127006.489247:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991734272 00000100:00100000:0.0:1746127006.489339:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.489405:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994284672:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.489427:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 39 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.489442:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664dc00, rc 0) 00000100:00100000:2.0:1746127006.489476:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4398:x1830945991733888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4880us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.489482:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21772 00000100:00100000:2.0:1746127006.489496:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991734144 00000100:00100000:2.0:1746127006.489499:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991734144 00000100:00100000:3.0:1746127006.489545:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21773 00000100:00100000:3.0:1746127006.489552:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991734016:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127006.489564:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.489577:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa4b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5365b expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.489611:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994284800:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127006.489650:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.489769:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21774 00000100:00100000:1.0:1746127006.489777:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991734272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127006.489785:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.489793:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c34800/0x34dc807b6efa4bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53669 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.489911:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21775 00000100:00100000:2.0:1746127006.489918:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991734144:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.489925:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.489931:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6efa4c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53662 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.489948:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994284928:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127006.489954:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285056:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127006.489973:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.489974:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.489989:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991734400 00000100:00100000:2.0:1746127006.489992:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991734400 00002000:00100000:2.0:1746127006.490011:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3969024->4194303) req@ffff88009c4ce680 x1830945991734400/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.490019:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ce680 with x1830945991734400 ext(3969024->4194303) 00010000:00010000:2.0:1746127006.490024:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.490044:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746127006.490048:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4ce680 00000100:00100000:2.0:1746127006.490076:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1934 00000100:00100000:2.0:1746127006.490081:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991734400:12345-192.168.203.42@tcp:4:multiop.0 00002000:00010000:3.0:1746127006.491204:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746127004 -> 1746127005 00002000:00010000:3.0:1746127006.491208:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127003 -> 1746127005 00002000:00010000:3.0:1746127006.491210:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746127004 -> 1746127005 00000100:00100000:3.0:1746127006.491222:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994284800:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127006.491239:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa4b5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5365b expref: 16 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.491247:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa4b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5365b expref: 16 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.491258:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d29c00, rc 0) 00000100:00100000:3.0:1746127006.491468:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991734016:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1915us (3202us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127006.491474:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21773 00002000:00010000:1.0:1746127006.492596:0:9611:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746127004 -> 1746127005 00002000:00010000:1.0:1746127006.492600:0:9611:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746127004 -> 1746127005 00000100:00100000:1.0:1746127006.492610:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994284928:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127006.492687:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285056:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127006.492700:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6efa4c3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53662 expref: 14 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.492710:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664cc00/0x34dc807b6efa4c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53662 expref: 14 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.492722:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664cc00, rc 0) 00000100:00100000:3.0:1746127006.492761:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991734144:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2844us (3998us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127006.492767:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21775 00010000:00010000:1.0:1746127006.492805:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c34800/0x34dc807b6efa4bc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53669 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.492814:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c34800/0x34dc807b6efa4bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53669 expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.492825:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c34800, rc 0) 00000100:00100000:1.0:1746127006.492842:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991734272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3068us (4534us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127006.492846:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21774 00000100:00100000:2.0:1746127006.493956:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991734400:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3872us (4615us total) trans 17179875616 rc 0/0 00000100:00100000:2.0:1746127006.493964:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1934 00002000:00100000:2.0:1746127006.493972:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3969024->4194303) req@ffff88009c4ce680 x1830945991734400/t17179875616(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.493980:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4ce680 with x1830945991734400 ext(3969024->4194303) 00010000:00010000:2.0:1746127006.493986:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.493996:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746127006.494002:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4ce680 00000100:00100000:0.0:1746127006.500488:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.500758:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991734528 00000100:00100000:1.0:1746127006.500766:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991734528 00010000:00010000:1.0:1746127006.500797:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.500834:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10212 00000100:00100000:1.0:1746127006.500842:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991734528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.500852:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.500877:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.500888:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.500907:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094aff400/0x34dc807b6efa48b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3969024->18446744073709551615] (req 3969024->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53631 expref: 14 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.500928:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.500930:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.501008:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.501022:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.501057:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.501067:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994285184:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127006.502777:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.503098:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.504084:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991734656 00000100:00100000:1.0:1746127006.504092:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991734656 00000100:00100000:3.0:1746127006.504192:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21776 00000100:00100000:3.0:1746127006.504201:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4404:x1830945991734656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127006.504215:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.504228:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53670 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.504252:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.504258:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127006.504260:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127006.504263:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 14 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.504285:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.504293:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 26 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.504301:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285312:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.504627:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.507156:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994285184:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127006.507185:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.507211:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991734528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6371us (6733us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.507218:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10212 00000100:00100000:3.0:1746127006.507443:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285312:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.507459:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 14 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.507471:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d28c00, rc 0) 00000100:00100000:3.0:1746127006.507492:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4404:x1830945991734656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3293us (4397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.507497:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21776 00000100:00100000:0.0:1746127006.507880:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.507919:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991734912 00000100:00100000:2.0:1746127006.507925:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991734912 00002000:00100000:2.0:1746127006.507950:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009c4cd180 x1830945991734912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.507957:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd180 with x1830945991734912 ext(3145728->4194303) 00002000:00010000:2.0:1746127006.507960:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cd180 00000100:00100000:2.0:1746127006.508081:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8715 00000100:00100000:2.0:1746127006.508088:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991734912:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127006.513126:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.513218:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991735040 00000100:00100000:2.0:1746127006.513227:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991735040 00002000:00100000:2.0:1746127006.513262:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1757184->2097151) req@ffff88009da75c00 x1830945991735040/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.513271:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da75c00 with x1830945991735040 ext(1757184->2097151) 00010000:00010000:2.0:1746127006.513279:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 27 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.513295:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 27 pid: 3542 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746127006.513301:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009da75c00 00000100:00100000:2.0:1746127006.513331:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1935 00000100:00100000:2.0:1746127006.513338:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991735040:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127006.514256:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991734912:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 6167us (6376us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127006.514263:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8715 00002000:00100000:2.0:1746127006.514269:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009c4cd180 x1830945991734912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.514275:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd180 with x1830945991734912 ext(3145728->4194303) 00002000:00010000:2.0:1746127006.514279:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cd180 00000100:00100000:0.0:1746127006.520158:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.520347:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991735168 00000100:00100000:3.0:1746127006.520354:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991735168 00000100:00100000:3.0:1746127006.520398:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21777 00000100:00100000:3.0:1746127006.520405:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991735168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127006.520420:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.520435:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efa4d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53677 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.520481:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285440:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127006.521767:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.521890:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.521922:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991735296 00000100:00100000:0.0:1746127006.521927:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991735296 00000100:00100000:0.0:1746127006.521951:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21778 00000100:00100000:0.0:1746127006.521958:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991735296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127006.521968:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.521978:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa4d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5367e expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.522007:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994285568:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127006.522043:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.522231:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991735040:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8893us (9111us total) trans 21474842884 rc 0/0 00000100:00100000:2.0:1746127006.522244:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1935 00002000:00100000:2.0:1746127006.522251:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1757184->2097151) req@ffff88009da75c00 x1830945991735040/t21474842884(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.522259:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da75c00 with x1830945991735040 ext(1757184->2097151) 00010000:00010000:2.0:1746127006.522265:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 33 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.522276:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 33 pid: 3542 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746127006.522282:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009da75c00 00000100:00100000:0.0:1746127006.527869:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.527907:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991735424 00000100:00100000:0.0:1746127006.527912:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991735424 00010000:00010000:0.0:1746127006.527939:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 33 pid: 3542 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746127006.527998:0:9611:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127004 -> 1746127005 00000100:00100000:0.0:1746127006.528005:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10213 00000100:00100000:0.0:1746127006.528012:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991735424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127006.528015:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994285568:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127006.528024:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.528049:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa4d8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5367e expref: 33 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.528060:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa4d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5367e expref: 33 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.528061:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 33 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.528071:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 32 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.528099:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de200, rc 0) 00000100:00100000:1.0:1746127006.528193:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991735296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6233us (6302us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127006.528199:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21778 00010000:00010000:2.0:1746127006.528624:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83c00/0x34dc807b6efa484 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5362a expref: 31 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.528646:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285440:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127006.528665:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efa4d1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53677 expref: 30 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.528673:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efa4d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53677 expref: 30 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.528679:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d28a00, rc 0) 00000100:00100000:2.0:1746127006.528701:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991735168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8296us (8580us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127006.528707:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21777 00010000:00010000:0.0:1746127006.528839:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.528841:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.528847:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 13 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.528854:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 13 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.528877:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 13 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.528887:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994285696:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127006.529660:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.538575:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994285696:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127006.538602:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.538661:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991735424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10649us (10796us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.538672:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10213 00000100:00100000:0.0:1746127006.542734:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.542795:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.542888:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991735552 00000100:00100000:3.0:1746127006.542890:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991735808 00000100:00100000:2.0:1746127006.542898:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991735552 00000100:00100000:3.0:1746127006.542901:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991735808 00000100:00100000:2.0:1746127006.542955:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21779 00000100:00100000:2.0:1746127006.542963:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4398:x1830945991735552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.542981:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.543002:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53685 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746127006.543024:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a7c53100 x1830945991735808/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127006.543043:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 14 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.543050:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.543052:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.543056:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746127006.543059:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53100 with x1830945991735808 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.543064:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53100 00010000:00010000:2.0:1746127006.543089:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 14 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.543090:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8716 00000100:00100000:3.0:1746127006.543098:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991735808:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127006.543101:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 14 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.543113:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285824:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.543867:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.551683:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.552444:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994285824:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.552475:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.552495:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643200, rc 0) 00000100:00100000:2.0:1746127006.552548:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4398:x1830945991735552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 9584us (9824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.552556:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21779 00000100:00100000:1.0:1746127006.552649:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991735936 00000100:00100000:1.0:1746127006.552657:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991735936 00002000:00100000:1.0:1746127006.552696:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4505599) req@ffff8800a7c51180 x1830945991735936/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.552704:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51180 with x1830945991735936 ext(4194304->4505599) 00010000:00010000:1.0:1746127006.552710:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 16 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.552721:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 16 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746127006.552727:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c51180 00000100:00100000:1.0:1746127006.552887:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1936 00000100:00100000:1.0:1746127006.552894:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991735936:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127006.556308:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991735808:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13201us (13503us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.556321:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8716 00002000:00100000:3.0:1746127006.556333:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a7c53100 x1830945991735808/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.556341:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53100 with x1830945991735808 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.556347:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53100 00000100:00100000:1.0:1746127006.560398:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991735936:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7493us (8713us total) trans 21474842885 rc 0/0 00000100:00100000:1.0:1746127006.560412:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1936 00002000:00100000:1.0:1746127006.560424:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4505599) req@ffff8800a7c51180 x1830945991735936/t21474842885(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.560441:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51180 with x1830945991735936 ext(4194304->4505599) 00010000:00010000:1.0:1746127006.560452:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 16 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.560469:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 16 pid: 16295 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746127006.560475:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a7c51180 00000100:00100000:0.0:1746127006.560745:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.560808:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991736064 00000100:00100000:2.0:1746127006.560816:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991736064 00000100:00100000:2.0:1746127006.560853:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17309 00000100:00100000:2.0:1746127006.560859:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4409:x1830945991736064:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127006.560881:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.560897:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6efa4e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5368c expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.560953:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.560964:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.560973:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.560985:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.560991:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.560996:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.561074:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.561084:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 30 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.561096:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 55 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.561102:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.561165:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 55 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.561174:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 55 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.561184:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994285952:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.561690:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 30 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.561699:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 30 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.561707:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994286080:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.561742:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.586491:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.589007:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991736192 00000100:00100000:2.0:1746127006.589020:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991736192 00000100:00100000:2.0:1746127006.590605:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21780 00000100:00100000:2.0:1746127006.590615:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4404:x1830945991736192:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.590633:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.590653:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53693 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.590680:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.590682:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.590690:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.590704:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.590715:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36400, rc 0) 00000100:00100000:1.0:1746127006.590716:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.590735:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.590751:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.590760:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4404:x1830945991736192:12345-192.168.203.42@tcp:101:cat.0 Request processed in 147us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.590766:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21780 00000100:00100000:1.0:1746127006.590768:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991736320 00000100:00100000:1.0:1746127006.590772:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991736320 00000100:00100000:2.0:1746127006.590787:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991736704 00000100:00100000:2.0:1746127006.590790:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991736704 00010000:00010000:1.0:1746127006.590793:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 56 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.590799:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 17 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.590810:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10214 00000100:00100000:1.0:1746127006.590815:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:2026:x1830945991736320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127006.590820:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10215 00010000:00010000:1.0:1746127006.590823:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127006.590824:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991736704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.590828:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 56 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.590831:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.590836:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 56 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.590849:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 17 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.590852:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127006.590856:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.590857:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 17 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.590864:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.590869:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.590872:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009914b200/0x34dc807b6efa4a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53646 expref: 17 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.590872:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127006.590885:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746127006.590885:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:2026:x1830945991736320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (150us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127006.590886:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.590890:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 28 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.590890:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10214 00010000:00010000:2.0:1746127006.590897:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 28 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.590926:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 28 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.590937:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994286208:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127006.590947:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.590978:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.590987:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991736832 00000100:00100000:2.0:1746127006.590989:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991736832 00000100:00100000:2.0:1746127006.591003:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21781 00000100:00100000:2.0:1746127006.591007:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4408:x1830945991736832:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127006.591014:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.591023:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5369a expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.591050:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 40 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.591062:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.591066:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.591067:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.591070:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1220608->1679359] (req 1220608->1679359) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.591083:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 12 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.591092:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 12 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.591098:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994286336:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.591099:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991736576 00000100:00100000:0.0:1746127006.591103:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991736576 00010000:00010000:2.0:1746127006.591123:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 40 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127006.591142:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6605 00010000:00010000:2.0:1746127006.591144:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 40 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.591148:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+31:32472:x1830945991736576:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746127006.591152:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994286464:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.591168:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746127006.591246:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa422 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535cf expref: 55 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.591261:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994285952:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.591268:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994286080:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.591284:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000100:00100000:0.0:1746127006.591678:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:32472:x1830945991736576:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 530us (962us total) trans 8589938264 rc 0/0 00000100:00100000:0.0:1746127006.591685:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6605 00000100:00100000:2.0:1746127006.594149:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994286208:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127006.594336:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.595209:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991736704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4378us (4450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.595219:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10215 00000100:00100000:0.0:1746127006.595368:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.595494:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991737216 00000100:00100000:2.0:1746127006.595501:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991737216 00002000:00100000:2.0:1746127006.595939:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fda680 x1830945991737216/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.595950:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fda680 with x1830945991737216 ext(4194304->4829183) 00002000:00010000:2.0:1746127006.595955:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fda680 00000100:00100000:3.0:1746127006.596408:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994286336:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.596418:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994286464:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.596443:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1220608->1679359] (req 1220608->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.596458:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450ce00, rc 0) 00000100:00100000:3.0:1746127006.596507:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4408:x1830945991736832:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5498us (5559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.596520:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21781 00000100:00100000:2.0:1746127006.596672:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8717 00000100:00100000:2.0:1746127006.596680:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991737216:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127006.596800:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.596869:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991737472 00000100:00100000:0.0:1746127006.596873:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991737472 00002000:00100000:0.0:1746127006.596893:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880095c07480 x1830945991737472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.596900:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07480 with x1830945991737472 ext(2097152->3145727) 00002000:00010000:0.0:1746127006.596903:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c07480 00000100:00100000:0.0:1746127006.596915:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8718 00000100:00100000:0.0:1746127006.596919:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991737472:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127006.599697:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.599756:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991737600 00000100:00100000:3.0:1746127006.599764:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991737600 00000100:00100000:2.0:1746127006.599775:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.599795:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991737344 00000100:00100000:2.0:1746127006.599798:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991737344 00010000:00010000:3.0:1746127006.599799:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 32 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.599817:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 13 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.603469:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10216 00000100:00100000:2.0:1746127006.603487:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991737600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.603507:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.603519:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 32 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.603533:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 32 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.603556:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6000/0x34dc807b6efa40d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c8 expref: 32 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.603575:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127006.603580:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.603590:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.603597:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.603621:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.603768:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10217 00000100:00100000:3.0:1746127006.603778:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991737344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.603788:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.603811:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 13 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.603821:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 13 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.603834:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efa3ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53582 expref: 13 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.603848:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.604790:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.604810:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991737728 00000100:00100000:1.0:1746127006.604818:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991737728 00010000:00010000:1.0:1746127006.604842:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 40 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.604865:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10218 00000100:00100000:1.0:1746127006.604870:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991737728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.604878:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.604888:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 40 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.604898:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 40 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.604918:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009914a200/0x34dc807b6efa36c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5355f expref: 40 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.604934:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.604936:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.604942:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.604950:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.604977:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.604989:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994286592:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127006.605059:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.605117:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991737600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1636us (5428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.605124:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10216 00010000:00010000:1.0:1746127006.605180:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605187:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:1.0:1746127006.605237:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127006.605241:0:7260:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127006.605259:0:7260:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605270:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605282:0:7260:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605289:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605294:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605300:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605305:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096642800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127006.605309:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605314:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605324:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127006.605326:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127006.605329:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605333:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642800/0x34dc807b6efa4ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605342:0:7260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605346:0:7260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605350:0:7260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605354:0:7260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096642a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127006.605356:0:7260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605361:0:7260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605366:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cec5300) 00010000:00010000:1.0:1746127006.605368:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127006.605370:0:7260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605374:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096642a00/0x34dc807b6efa4f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.605402:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643c00/0x34dc807b6efa4e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.605413:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 13 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.605418:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127006.605420:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127006.605423:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c400, rc 0) 00000100:00100000:1.0:1746127006.605449:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4409:x1830945991736064:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 44589us (44705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.605455:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17309 00000100:00100000:3.0:1746127006.606273:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991737344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2494us (6494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.606281:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10217 00000100:00100000:0.0:1746127006.608999:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991737216:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 12309us (13620us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746127006.609012:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8717 00002000:00100000:0.0:1746127006.609022:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a2fda680 x1830945991737216/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 634880/634880 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.609044:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fda680 with x1830945991737216 ext(4194304->4829183) 00002000:00010000:0.0:1746127006.609050:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fda680 00000100:00100000:0.0:1746127006.609753:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.609950:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994286592:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127006.609971:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.610074:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991737984 00000100:00100000:2.0:1746127006.610082:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991737984 00002000:00100000:2.0:1746127006.610117:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1220608->1224703) req@ffff880095c04380 x1830945991737984/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.610124:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04380 with x1830945991737984 ext(1220608->1224703) 00002000:00010000:2.0:1746127006.610154:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c04380 00000100:00100000:2.0:1746127006.610193:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8719 00000100:00100000:2.0:1746127006.610201:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991737984:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127006.610340:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991737728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5468us (5552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.610348:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10218 00000100:00100000:2.0:1746127006.611364:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991737984:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 1158us (1608us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127006.611375:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8719 00002000:00100000:2.0:1746127006.611382:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1220608->1224703) req@ffff880095c04380 x1830945991737984/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.611389:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04380 with x1830945991737984 ext(1220608->1224703) 00002000:00010000:2.0:1746127006.611393:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c04380 00000100:00100000:1.0:1746127006.612156:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991737472:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15233us (15354us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127006.612163:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8718 00002000:00100000:1.0:1746127006.612169:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880095c07480 x1830945991737472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.612176:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07480 with x1830945991737472 ext(2097152->3145727) 00002000:00010000:1.0:1746127006.612179:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c07480 00000100:00100000:0.0:1746127006.616654:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.617520:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.617544:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991738112 00000100:00100000:3.0:1746127006.617553:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991738112 00000100:00100000:3.0:1746127006.617607:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21782 00000100:00100000:3.0:1746127006.617615:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991738112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127006.617637:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.617657:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536a1 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.617681:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.617683:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.617691:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 30 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.617721:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 30 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.617731:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d29c00, rc 0) 00000100:00100000:3.0:1746127006.617789:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991738112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 175us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.617796:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21782 00000100:00100000:0.0:1746127006.619305:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.619320:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.619334:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.619349:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.619363:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.619386:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.619418:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991738240 00000100:00100000:0.0:1746127006.619423:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991738240 00000100:00100000:0.0:1746127006.619450:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991738368 00000100:00100000:0.0:1746127006.619452:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991738368 00000100:00100000:0.0:1746127006.619471:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991738624 00000100:00100000:0.0:1746127006.619473:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991738624 00000100:00100000:0.0:1746127006.619483:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991738880 00000100:00100000:0.0:1746127006.619485:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991738880 00000100:00100000:0.0:1746127006.619493:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991738496 00000100:00100000:0.0:1746127006.619495:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991738496 00000100:00100000:0.0:1746127006.619500:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991738752 00000100:00100000:0.0:1746127006.619502:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991738752 00000100:00100000:0.0:1746127006.619507:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991739008 00000100:00100000:0.0:1746127006.619508:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991739008 00000100:00100000:0.0:1746127006.619518:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21783 00000100:00100000:0.0:1746127006.619523:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4404:x1830945991738240:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127006.619536:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.619550:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536a8 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.619569:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619571:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619577:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 13 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.619593:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 13 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.619601:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dfa00, rc 0) 00000100:00100000:0.0:1746127006.619629:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4404:x1830945991738240:12345-192.168.203.42@tcp:101:cat.0 Request processed in 106us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.619634:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21783 00000100:00100000:0.0:1746127006.619646:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21784 00000100:00100000:0.0:1746127006.619651:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991738368:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127006.619658:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.619666:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536af expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.619677:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619678:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619682:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.619690:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.619696:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dec00, rc 0) 00000100:00100000:0.0:1746127006.619710:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991738368:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 59us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.619714:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21784 00000100:00100000:0.0:1746127006.619724:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21785 00000100:00100000:0.0:1746127006.619728:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991738624:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127006.619733:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.619738:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536bd expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.619748:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619749:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619753:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.619761:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.619768:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8df600, rc 0) 00000100:00100000:0.0:1746127006.619779:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991738624:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 51us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.619784:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21785 00000100:00100000:0.0:1746127006.619792:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21786 00000100:00100000:0.0:1746127006.619796:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991738880:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127006.619801:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.619807:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536cb expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.619815:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619817:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.619820:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.619829:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.619836:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de200, rc 0) 00000100:00100000:0.0:1746127006.619848:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991738880:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 52us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.619853:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21786 00000100:00100000:0.0:1746127006.619861:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21787 00000100:00100000:0.0:1746127006.619865:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991738496:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127006.619870:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.619875:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efa533 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536b6 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.619911:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994286720:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127006.619964:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00080000:0.0:1746127006.619979:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746127006.619992:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21788 00000100:00100000:0.0:1746127006.619997:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991738752:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127006.620003:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.620008:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536c4 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.620018:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.620019:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.620023:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.620044:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.620051:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad000, rc 0) 00000100:00100000:0.0:1746127006.620065:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991738752:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 68us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.620070:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21788 00000100:00100000:0.0:1746127006.620081:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21789 00000100:00100000:0.0:1746127006.620085:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991739008:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127006.620090:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.620095:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536d2 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.620102:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.620103:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.620107:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.620115:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.620121:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad800, rc 0) 00000100:00100000:0.0:1746127006.620163:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991739008:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 77us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.620172:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21789 00000100:00100000:0.0:1746127006.624728:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.625087:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991739264 00000100:00100000:1.0:1746127006.625099:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991739264 00002000:00100000:1.0:1746127006.625173:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1675264->1679359) req@ffff880094e6e680 x1830945991739264/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.625423:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6e680 with x1830945991739264 ext(1675264->1679359) 00002000:00010000:1.0:1746127006.625428:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6e680 00000100:00100000:1.0:1746127006.625525:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8720 00000100:00100000:1.0:1746127006.625533:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991739264:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:2.0:1746127006.625606:0:9613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127004 -> 1746127005 00002000:00010000:2.0:1746127006.625611:0:9613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127003 -> 1746127005 00002000:00010000:2.0:1746127006.625613:0:9613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127003 -> 1746127005 00000100:00100000:2.0:1746127006.625623:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994286720:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127006.625643:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991739264:12345-192.168.203.42@tcp:3:cat.0 Request processed in 111us (923us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746127006.625648:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efa533 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536b6 expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127006.625648:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8720 00002000:00100000:1.0:1746127006.625654:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1675264->1679359) req@ffff880094e6e680 x1830945991739264/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127006.625659:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efa533 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536b6 expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746127006.625660:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6e680 with x1830945991739264 ext(1675264->1679359) 00002000:00010000:1.0:1746127006.625663:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e6e680 00010000:00010000:2.0:1746127006.625683:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de600, rc 0) 00000100:00100000:2.0:1746127006.625715:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991738496:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 5848us (6363us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127006.625722:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21787 00000100:00100000:1.0:1746127006.643194:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.643221:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.643222:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.643255:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.643255:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991740288 00000100:00100000:0.0:1746127006.643262:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991740288 00000100:00100000:0.0:1746127006.643296:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17310 00000100:00100000:0.0:1746127006.643303:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:4409:x1830945991740288:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127006.643319:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.643334:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dada00/0x34dc807b6efa548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536d9 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.643409:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127006.643421:0:7260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.643427:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:0.0:1746127006.643452:0:7260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.643462:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 14 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.643472:0:7260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994286848:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.643495:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991739520 00000100:00100000:3.0:1746127006.643498:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991739776 00000100:00100000:2.0:1746127006.643499:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991739520 00000100:00100000:3.0:1746127006.643502:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991739776 00000100:00100000:0.0:1746127006.643523:0:7260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00002000:00100000:3.0:1746127006.643524:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009942f800 x1830945991739776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.643524:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009942ca80 x1830945991739520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.643532:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f800 with x1830945991739776 ext(3145728->4194303) 00002000:00100000:2.0:1746127006.643533:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ca80 with x1830945991739520 ext(2097152->4194303) 00002000:00010000:3.0:1746127006.643536:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942f800 00002000:00010000:2.0:1746127006.643536:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942ca80 00000100:00100000:0.0:1746127006.643537:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991740032 00000100:00100000:0.0:1746127006.643539:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991740032 00000100:00100000:0.0:1746127006.643557:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6606 00000100:00100000:0.0:1746127006.643561:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+55:4408:x1830945991740032:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127006.643596:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8721 00000100:00100000:2.0:1746127006.643603:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991739776:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127006.643670:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:4408:x1830945991740032:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 107us (413us total) trans 8589938265 rc 0/0 00000100:00100000:0.0:1746127006.643676:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6606 00000100:00100000:0.0:1746127006.643794:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8722 00000100:00100000:0.0:1746127006.643800:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991739520:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127006.650623:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.650654:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991740416 00000100:00100000:1.0:1746127006.650661:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991740416 00010000:00010000:1.0:1746127006.650698:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 15 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.650738:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10219 00000100:00100000:1.0:1746127006.650744:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991740416:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.650758:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.650762:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 15 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.650773:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 15 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.650793:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127006.650797:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.650806:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.650812:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7260 initiator: MDT0 00010000:00010000:1.0:1746127006.650825:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.650867:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991740416:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.650873:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10219 00010000:00010000:2.0:1746127006.650966:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa4fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5368c expref: 14 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.650983:0:7260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7260:1830945994286848:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.651001:0:7260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.651008:0:7260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.651012:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:2.0:1746127006.651039:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127006.651176:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dada00/0x34dc807b6efa548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d9 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.651189:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d9 expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.651195:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127006.651197:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127006.651199:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de600, rc 0) 00000100:00100000:2.0:1746127006.651221:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4409:x1830945991740288:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 7919us (7998us total) trans 8589938266 rc 0/0 00000100:00100000:2.0:1746127006.651226:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17310 00000100:00100000:2.0:1746127006.661779:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991739776:12345-192.168.203.42@tcp:3:cat.0 Request processed in 18164us (18545us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127006.661793:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8721 00002000:00100000:2.0:1746127006.661804:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009942f800 x1830945991739776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.661814:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f800 with x1830945991739776 ext(3145728->4194303) 00002000:00010000:2.0:1746127006.661821:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942f800 00000100:00100000:1.0:1746127006.680386:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991739520:12345-192.168.203.42@tcp:3:cat.0 Request processed in 36579us (37191us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127006.680394:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8722 00002000:00100000:1.0:1746127006.680402:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009942ca80 x1830945991739520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.680409:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ca80 with x1830945991739520 ext(2097152->4194303) 00002000:00010000:1.0:1746127006.680414:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942ca80 00000100:00100000:0.0:1746127006.682795:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.683774:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991740672 00000100:00100000:2.0:1746127006.683782:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991740672 00000100:00100000:2.0:1746127006.684640:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17311 00000100:00100000:2.0:1746127006.684649:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4409:x1830945991740672:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127006.684670:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.684672:0:7260:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746127006.684694:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de600/0x34dc807b6efa54f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d9 expref: 14 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.684949:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127006.684952:0:7260:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127006.684964:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dadc00/0x34dc807b6efa55d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536e0 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.685171:0:7260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.685183:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7260 initiator: MDT0 00010000:00010000:2.0:1746127006.685190:0:7260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7260 initiator: MDT0 00000004:00200000:2.0:1746127006.685200:0:7260:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127006.685275:0:7260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dadc00/0x34dc807b6efa55d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.685286:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.685292:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127006.685294:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127006.685296:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c400, rc 0) 00000100:00100000:2.0:1746127006.685681:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4409:x1830945991740672:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 1032us (2890us total) trans 8589938267 rc 0/0 00000100:00100000:2.0:1746127006.685688:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17311 00000100:00100000:2.0:1746127006.690180:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.690268:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.690379:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991740800 00000100:00100000:3.0:1746127006.690386:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991740800 00000100:00100000:1.0:1746127006.690407:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741056 00000100:00100000:1.0:1746127006.690411:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741056 00000100:00100000:3.0:1746127006.690428:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17312 00000100:00100000:3.0:1746127006.690435:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4409:x1830945991740800:12345-192.168.203.42@tcp:101:mirror_io.0 00000100:00100000:1.0:1746127006.690436:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17313 00000100:00100000:1.0:1746127006.690441:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4413:x1830945991741056:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127006.690453:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.690453:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.690466:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efa572 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536e7 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.690466:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc200/0x34dc807b6efa579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536ee expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.690503:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efa572 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e7 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.690513:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efa572 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e7 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.690525:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.690527:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127006.690530:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d29a00, rc 0) 00010000:00010000:1.0:1746127006.690531:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127006.690541:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.690548:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127006.690562:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:4409:x1830945991740800:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 128us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.690567:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17312 00010000:00010000:1.0:1746127006.690569:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.690579:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 15 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.690588:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994286976:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.690632:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.692416:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.692497:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994286976:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.692513:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:2.0:1746127006.692665:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741184 00000100:00100000:2.0:1746127006.692670:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741184 00010000:00010000:2.0:1746127006.692703:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 16 pid: 7260 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.692723:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10220 00000100:00100000:2.0:1746127006.692729:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991741184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.692739:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.692743:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 16 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.692751:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 16 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.692768:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efa564 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e0 expref: 16 pid: 7260 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.692910:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127006.692915:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.692922:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.692927:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.693182:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.693221:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991741184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 492us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.693236:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10220 00010000:00010000:1.0:1746127006.693587:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127006.693594:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127006.693609:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127006.693701:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dc200/0x34dc807b6efa579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.693716:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 33 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.693723:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127006.693725:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746127006.693727:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dd600, rc 0) 00000100:00100000:1.0:1746127006.693751:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4413:x1830945991741056:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3310us (3484us total) trans 8589938268 rc 0/0 00000100:00100000:1.0:1746127006.693760:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17313 00000100:00100000:3.0:1746127006.693881:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.693897:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.693910:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.693922:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.693949:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.693965:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.693977:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.693999:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.694014:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741312 00000100:00100000:3.0:1746127006.694018:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741312 00000100:00100000:3.0:1746127006.694050:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741568 00000100:00100000:3.0:1746127006.694052:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741568 00000100:00100000:3.0:1746127006.694062:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741824 00000100:00100000:3.0:1746127006.694064:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741824 00000100:00100000:3.0:1746127006.694075:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742080 00000100:00100000:3.0:1746127006.694077:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742080 00000100:00100000:3.0:1746127006.694082:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741440 00000100:00100000:3.0:1746127006.694083:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741440 00000100:00100000:3.0:1746127006.694088:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741696 00000100:00100000:3.0:1746127006.694090:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741696 00000100:00100000:3.0:1746127006.694095:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991741952 00000100:00100000:3.0:1746127006.694096:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991741952 00000100:00100000:3.0:1746127006.694101:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742208 00000100:00100000:3.0:1746127006.694103:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742208 00000100:00100000:3.0:1746127006.694112:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21790 00000100:00100000:3.0:1746127006.694117:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991741312:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127006.694146:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.694157:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c37e00/0x34dc807b6efa58e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536f5 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.694195:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994287104:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127006.694210:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21791 00000100:00100000:0.0:1746127006.694218:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991741568:12345-192.168.203.42@tcp:1:mirror_io.0 00000100:00100000:3.0:1746127006.694232:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073300 going to sleep for 11 seconds 00010000:00010000:0.0:1746127006.694237:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.694247:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21792 00010000:00010000:0.0:1746127006.694249:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.694253:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991741824:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127006.694255:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.694256:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.694259:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.694271:0:11152:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694274:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.694281:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 16 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.694288:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694288:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.694296:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994287232:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.694299:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 29 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.694305:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.694306:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.694308:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.694318:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746127006.694325:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 29 pid: 12340 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127006.694331:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21793 00010000:00010000:3.0:1746127006.694333:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 29 pid: 12340 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.694336:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991742080:12345-192.168.203.42@tcp:1:mirror_io.0 00000100:00100000:3.0:1746127006.694341:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994287360:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694351:0:1964:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694360:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 38 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.694367:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694367:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694373:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.694374:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 13 pid: 3148 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746127006.694380:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 14 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.694382:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994287488:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694385:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.694386:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.694388:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.694402:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 16 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694403:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 14 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694410:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 14 pid: 9613 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.694415:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 16 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.694418:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994287744:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694443:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694450:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 11 pid: 3148 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.694457:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994287872:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694475:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 38 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694482:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 38 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.694489:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994288000:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694504:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 38 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694514:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 38 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.694521:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994288128:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.694530:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.694547:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21794 00000100:00100000:0.0:1746127006.694552:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991741440:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127006.694566:0:12333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694574:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 29 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694579:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694585:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694590:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.694591:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.694593:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694606:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694613:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 16 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.694621:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994288256:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694641:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694647:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 13 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.694654:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994288384:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694668:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 29 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694674:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 29 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.694681:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994288512:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.694692:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.694719:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21795 00000100:00100000:0.0:1746127006.694724:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991741696:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127006.694738:0:16295:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694751:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 38 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694757:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694763:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 14 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694768:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.694769:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.694771:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694785:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 14 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694792:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 14 pid: 3542 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.694799:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994288640:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694819:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694825:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 11 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.694837:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994288768:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.694852:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 38 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694858:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 38 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.694864:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994288896:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.694874:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ce98000 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.694887:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21796 00000100:00100000:0.0:1746127006.694892:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991741952:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127006.694907:0:3148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694915:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694921:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.694927:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 16 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694933:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 29 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694938:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746127006.694939:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746127006.694941:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 7/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694954:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 29 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.694958:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21797 00010000:00010000:0.0:1746127006.694961:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 29 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.694965:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991742208:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127006.694968:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289024:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.694972:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.694978:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efa5bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e536fc expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694986:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.694993:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 17 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.694999:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093643800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289152:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.695052:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.695061:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efa5bf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536fc expref: 17 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.695062:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.695069:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 13 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.695080:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093643100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289280:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.695096:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efa5bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536fc expref: 17 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.695099:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.695104:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de400, rc 0) 00010000:00010000:0.0:1746127006.695106:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.695113:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093642300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289408:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.695120:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991742208:12345-192.168.203.42@tcp:101:cat.0 Request processed in 157us (1121us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127006.695123:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.695125:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21797 00000100:00100000:3.0:1746127006.695604:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994287616:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.696719:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.699774:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994287360:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.699841:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994287232:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.699862:0:9612:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.700311:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994287104:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127006.700335:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c37e00/0x34dc807b6efa58e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536f5 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.700349:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c37e00/0x34dc807b6efa58e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536f5 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.700361:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c37e00, rc 0) 00000100:00100000:2.0:1746127006.700908:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.701085:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994287744:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.701094:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994287872:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.701101:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994288000:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.701108:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994288128:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.701125:0:1964:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.701155:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991741312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7036us (7272us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127006.701162:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21790 00000100:00100000:2.0:1746127006.701443:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.701457:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742464 00000100:00100000:2.0:1746127006.701461:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742464 00010000:00010000:2.0:1746127006.701483:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 30 pid: 12340 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.701502:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10221 00000100:00100000:2.0:1746127006.701508:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991742464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.701518:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.701529:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 30 pid: 12340 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.701539:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 30 pid: 12340 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.701554:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efa510 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a1 expref: 30 pid: 12340 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.701564:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.702107:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994287488:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.702149:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994288256:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.702165:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289024:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.702253:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994288896:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.702264:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991742464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 755us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.702275:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10221 00000100:00100000:2.0:1746127006.702304:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093643800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289152:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.702343:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742336 00000100:00100000:1.0:1746127006.702347:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742336 00002000:00100000:1.0:1746127006.702377:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1220608->1679359) req@ffff880094f14e00 x1830945991742336/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.702385:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14e00 with x1830945991742336 ext(1220608->1679359) 00010000:00010000:1.0:1746127006.702391:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 39 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.702401:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 39 pid: 12340 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746127006.702407:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f14e00 00000100:00100000:1.0:1746127006.702441:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1937 00000100:00100000:1.0:1746127006.702447:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991742336:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127006.702733:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093643100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289280:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.702742:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093642300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289408:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.702756:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994287616:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.702769:0:3148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.702946:0:11152:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.708943:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.708971:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.708994:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.709011:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.709025:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.709052:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.709069:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.709080:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.709085:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994288384:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.709090:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.709169:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742848 00000100:00100000:2.0:1746127006.709176:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742848 00010000:00010000:2.0:1746127006.709211:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 41 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.709234:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991743616 00000100:00100000:2.0:1746127006.709238:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991743616 00010000:00010000:2.0:1746127006.709252:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 16 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.709264:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991743360 00000100:00100000:2.0:1746127006.709266:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991743360 00010000:00010000:2.0:1746127006.709277:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 13 pid: 9613 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.709288:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10222 00000100:00100000:2.0:1746127006.709296:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991742848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.709308:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.709328:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 41 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.709338:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 41 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.709360:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664dc00/0x34dc807b6efa4ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53654 expref: 41 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.709375:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.709440:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991743744 00000100:00100000:1.0:1746127006.709444:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991743744 00010000:00010000:1.0:1746127006.709459:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 14 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.709469:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991744128 00000100:00100000:1.0:1746127006.709471:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991744128 00010000:00010000:1.0:1746127006.709479:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.709487:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742592 00000100:00100000:1.0:1746127006.709489:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742592 00010000:00010000:1.0:1746127006.709496:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 12 pid: 3148 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.709504:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742976 00000100:00100000:1.0:1746127006.709506:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742976 00010000:00010000:1.0:1746127006.709514:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 41 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.709522:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991743232 00000100:00100000:1.0:1746127006.709524:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991743232 00010000:00010000:1.0:1746127006.709530:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 42 pid: 3542 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.709537:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991743872 00000100:00100000:1.0:1746127006.709538:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991743872 00010000:00010000:1.0:1746127006.709546:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 17 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.709555:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10223 00000100:00100000:1.0:1746127006.709559:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991743616:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.709567:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.709578:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 17 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.709586:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 17 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.709597:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944a4400/0x34dc807b6efa430 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535d6 expref: 17 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.709615:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.709668:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994288512:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.709690:0:12333:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.709708:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.709711:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991742720 00000100:00100000:3.0:1746127006.709713:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991742720 00010000:00010000:3.0:1746127006.709725:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 15 pid: 3148 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.709741:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10224 00000100:00100000:3.0:1746127006.709746:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991743360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.709752:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.709760:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 13 pid: 9613 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.709768:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 13 pid: 9613 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.709779:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efa517 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536a8 expref: 13 pid: 9613 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.709792:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.709823:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991743360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 77us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.709829:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10224 00000100:00100000:3.0:1746127006.709842:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10225 00000100:00100000:3.0:1746127006.709846:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991743744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.709851:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.709858:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 15 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.709865:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 15 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.709879:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dec00/0x34dc807b6efa51e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536af expref: 15 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.709886:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.709902:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991743744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 56us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.709907:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10225 00000100:00100000:3.0:1746127006.709917:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10226 00000100:00100000:3.0:1746127006.709921:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991744128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.709927:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127006.709931:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127006.709934:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.709942:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.709953:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096643200/0x34dc807b6efa4df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53685 expref: 29 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.709960:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.709976:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991744128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 54us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.709981:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10226 00000100:00100000:3.0:1746127006.709991:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991743104 00000100:00100000:3.0:1746127006.709994:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991743104 00010000:00010000:3.0:1746127006.710004:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.710013:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10227 00000100:00100000:3.0:1746127006.710017:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991742592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.710023:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.710043:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 12 pid: 3148 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.710050:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 12 pid: 3148 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.710061:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa541 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536d2 expref: 12 pid: 3148 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.710067:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.710080:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991742592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 63us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.710085:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10227 00000100:00100000:3.0:1746127006.710095:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10228 00000100:00100000:3.0:1746127006.710099:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991742976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.710104:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.710111:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 42 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.710117:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 42 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.710142:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009914b000/0x34dc807b6efa365 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53566 expref: 42 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.710150:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.710163:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991742976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.710167:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10228 00000100:00100000:3.0:1746127006.710175:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10229 00000100:00100000:3.0:1746127006.710179:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991743232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.710185:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.710190:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 40 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.710197:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 40 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.710206:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efa499 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53638 expref: 40 pid: 3542 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.710214:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.710215:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.710219:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.710226:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.710243:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127006.710247:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.710387:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991743616:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 825us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.710392:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10223 00000100:00100000:1.0:1746127006.710402:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991743488 00000100:00100000:1.0:1746127006.710405:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991743488 00010000:00010000:1.0:1746127006.710416:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 14 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.710426:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10230 00000100:00100000:1.0:1746127006.710430:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991743872:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.710435:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.710443:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 15 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.710450:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 15 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.710461:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efa4ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53670 expref: 15 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.710468:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.710480:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991743872:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 50us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.710485:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10230 00000100:00100000:1.0:1746127006.710494:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10231 00000100:00100000:1.0:1746127006.710499:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991742720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.710505:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.710510:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 14 pid: 3148 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.710517:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 14 pid: 3148 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.710526:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efa53a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536c4 expref: 14 pid: 3148 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.710533:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.710534:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127006.710537:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.710543:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.710557:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.710570:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991742720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 71us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.710574:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10231 00000100:00100000:1.0:1746127006.710584:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10232 00000100:00100000:1.0:1746127006.710589:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991743104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.710595:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.710601:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.710609:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.710619:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa4a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5364d expref: 28 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.710626:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.710638:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991743104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 49us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.710642:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10232 00000100:00100000:1.0:1746127006.710651:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10233 00000100:00100000:1.0:1746127006.710656:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991743488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.710661:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.710666:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 12 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.710673:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 12 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.710682:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de200/0x34dc807b6efa52c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536cb expref: 12 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.710689:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.710700:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991743488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 44us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.710705:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10233 00000100:00100000:3.0:1746127006.711228:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991743232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 83us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.711234:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10229 00010000:00010000:3.0:1746127006.711274:0:1964:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711281:0:1964:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711299:0:1964:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711306:0:1964:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711312:0:1964:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711317:0:1964:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd00e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127006.711321:0:1964:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711327:0:1964:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.711330:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991742848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2035us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.711336:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10222 00010000:00010000:3.0:1746127006.711341:0:1964:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711347:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd00e00/0x34dc807b6efa5a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.711375:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991742080:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 17039us (17452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.711381:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21793 00010000:00010000:2.0:1746127006.711386:0:11152:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.711391:0:11152:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.711403:0:11152:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.711408:0:11152:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.711414:0:11152:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.711421:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127006.711423:0:11152:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c37400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127006.711425:0:11152:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.711430:0:11152:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.711439:0:11152:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.711444:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c37400/0x34dc807b6efa59c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.711463:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991744000 00000100:00100000:3.0:1746127006.711466:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991744000 00010000:00010000:3.0:1746127006.711479:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 10 pid: 9613 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.711484:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991741824:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 17231us (17572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.711489:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21792 00000100:00100000:3.0:1746127006.711500:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10234 00000100:00100000:3.0:1746127006.711504:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991744000:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127006.711504:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127006.711510:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.711521:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 10 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.711529:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 10 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.711539:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.711555:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991744000:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 50us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.711560:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10234 00000100:00100000:3.0:1746127006.711568:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991744256 00000100:00100000:3.0:1746127006.711571:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991744256 00010000:00010000:3.0:1746127006.711579:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 12 pid: 3542 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.711582:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994288640:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.711591:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10235 00000100:00100000:3.0:1746127006.711595:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991744256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127006.711597:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efa525 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536bd expref: 9 pid: 9613 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.711601:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.711608:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 12 pid: 3542 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.711613:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994288768:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.711615:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 12 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.711631:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e4c00/0x34dc807b6efa39d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53589 expref: 12 pid: 3542 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746127006.711637:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711639:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.711640:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.711643:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.711649:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.712887:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.712914:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.712936:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991744384 00000100:00100000:2.0:1746127006.712942:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991744384 00000100:00100000:0.0:1746127006.712952:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127006.712963:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 14 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.712982:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991744512 00000100:00100000:2.0:1746127006.712984:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991744512 00000100:00100000:0.0:1746127006.712989:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991744640 00010000:00010000:2.0:1746127006.712993:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.712994:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991744640 00000100:00100000:2.0:1746127006.713012:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10236 00000100:00100000:2.0:1746127006.713018:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991744384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.713025:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127006.713037:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21798 00000100:00100000:0.0:1746127006.713044:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4404:x1830945991744640:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.713052:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 15 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.713059:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 15 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.713064:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.713072:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c36400/0x34dc807b6efa502 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53693 expref: 15 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.713078:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53703 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.713081:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.713083:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.713086:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.713093:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713144:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.713161:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10237 00000100:00100000:3.0:1746127006.713166:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991744512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.713173:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.713181:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.713189:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.713199:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7400/0x34dc807b6efa3ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e535c1 expref: 27 pid: 16295 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.713208:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.713209:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.713211:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713217:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713227:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.713320:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991742336:12345-192.168.203.42@tcp:4:cat.0 Request processed in 10805us (12346us total) trans 17179875617 rc 0/0 00000100:00100000:1.0:1746127006.713330:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1937 00002000:00100000:1.0:1746127006.713339:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1220608->1679359) req@ffff880094f14e00 x1830945991742336/t17179875617(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.713348:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14e00 with x1830945991742336 ext(1220608->1679359) 00010000:00010000:1.0:1746127006.713356:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.713369:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746127006.713379:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f14e00 00000100:00100000:3.0:1746127006.713688:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2029:x1830945991744512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 520us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.713694:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10237 00010000:00010000:3.0:1746127006.713714:0:12333:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713723:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713735:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713741:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713747:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713752:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd01600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127006.713755:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713761:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713770:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.713775:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd01600/0x34dc807b6efa5aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.713808:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991741440:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 19256us (19858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.713814:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21794 00000100:00100000:3.0:1746127006.713835:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991744256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2240us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.713841:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10235 00010000:00010000:0.0:1746127006.714503:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.714512:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.714514:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.714519:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.714532:0:11152:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714542:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127006.714546:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.714557:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11e00, rc 0) 00000100:00100000:2.0:1746127006.714571:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991744384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1552us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.714578:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10236 00000100:00100000:0.0:1746127006.714580:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4404:x1830945991744640:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1536us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.714587:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21798 00010000:00010000:2.0:1746127006.714604:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714611:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714628:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714635:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714641:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714645:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012341b800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127006.714648:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714653:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714664:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.714669:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012341b800/0x34dc807b6efa5b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714718:0:3148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714725:0:3148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714735:0:3148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714741:0:3148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714746:0:3148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714751:0:3148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007dc11600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127006.714754:0:3148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714759:0:3148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714767:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.714768:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.714773:0:3148:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 13 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714784:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 13 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.714807:0:3148:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 13 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.714817:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289536:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127006.714858:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.714904:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991741696:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 20179us (20937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.714910:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21795 00000100:00100000:0.0:1746127006.724730:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.725103:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991744768 00000100:00100000:2.0:1746127006.725113:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991744768 00010000:00010000:2.0:1746127006.725180:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.725294:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10238 00000100:00100000:2.0:1746127006.725302:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991744768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.725317:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.725339:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.725351:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.725374:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efa509 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1679359) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5369a expref: 38 pid: 12340 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.725514:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.725516:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.725521:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.725530:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.725562:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127006.725634:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725642:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725663:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725671:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725678:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725684:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd01e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127006.725687:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725694:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725704:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.725710:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd01e00/0x34dc807b6efa595 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.725856:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991744768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 552us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.725863:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10238 00000100:00100000:0.0:1746127006.726459:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2029:x1830945991741568:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 32240us (32558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.726467:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21791 00000100:00100000:3.0:1746127006.734710:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289536:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127006.734754:0:3148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.734763:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11600/0x34dc807b6efa5b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.734837:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991741952:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 39943us (40857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.734845:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21796 00000100:00100000:2.0:1746127006.742426:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.742478:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.742480:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991745024 00000100:00100000:1.0:1746127006.742491:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991745024 00002000:00100000:1.0:1746127006.742538:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094f15f80 x1830945991745024/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.742549:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f15f80 with x1830945991745024 ext(4194304->4829183) 00000100:00100000:0.0:1746127006.742549:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991745280 00002000:00010000:1.0:1746127006.742554:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f15f80 00000100:00100000:0.0:1746127006.742555:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991745280 00000100:00100000:1.0:1746127006.742580:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8723 00000100:00100000:0.0:1746127006.742584:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17314 00000100:00100000:1.0:1746127006.742586:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991745024:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127006.742589:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4409:x1830945991745280:12345-192.168.203.42@tcp:36:mirror_io.0 00010000:00010000:0.0:1746127006.742625:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127006.742650:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efa572 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536e7 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.742680:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127006.742685:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127006.742738:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4409:x1830945991745280:12345-192.168.203.42@tcp:36:mirror_io.0 Request processed in 148us (258us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746127006.742744:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17314 00000100:00100000:0.0:1746127006.751083:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.751199:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991745536 00000100:00100000:3.0:1746127006.751207:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991745536 00000100:00100000:3.0:1746127006.751251:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6607 00000100:00100000:3.0:1746127006.751258:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:4409:x1830945991745536:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:0.0:1746127006.752359:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991745024:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9770us (9940us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746127006.752369:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8723 00002000:00100000:0.0:1746127006.752377:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094f15f80 x1830945991745024/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.752387:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f15f80 with x1830945991745024 ext(4194304->4829183) 00002000:00010000:0.0:1746127006.752392:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f15f80 00000100:00100000:3.0:1746127006.752616:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4409:x1830945991745536:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 1357us (1538us total) trans 8589938269 rc 0/0 00000100:00100000:3.0:1746127006.752627:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6607 00000100:00100000:1.0:1746127006.763016:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.763073:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.763110:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.763150:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.763167:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.763495:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991745792 00000100:00100000:3.0:1746127006.763504:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991745792 00000100:00100000:3.0:1746127006.763545:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991746048 00000100:00100000:3.0:1746127006.763547:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991746048 00000100:00100000:3.0:1746127006.763558:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991745664 00000100:00100000:3.0:1746127006.763559:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991745664 00000100:00100000:3.0:1746127006.763568:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991745920 00000100:00100000:3.0:1746127006.763569:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991745920 00000100:00100000:3.0:1746127006.763582:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21799 00000100:00100000:3.0:1746127006.763589:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991745792:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127006.763607:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.763627:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53711 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127006.763650:0:3148:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c89d, atime: 0x6813c89b, ctime: 0x6813c89d, blocks: 0x800 00010000:00010000:3.0:1746127006.763669:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.763671:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.763679:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.763694:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.763704:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915bc00, rc 0) 00000100:00100000:2.0:1746127006.763908:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21800 00000100:00100000:2.0:1746127006.763916:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991746048:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.763924:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.763936:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5371f expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127006.763949:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c89d, atime: 0x6813c89b, ctime: 0x6813c89d, blocks: 0x800 00010000:00010000:2.0:1746127006.763959:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.763960:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.763964:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.763974:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.763980:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c400, rc 0) 00000100:00100000:2.0:1746127006.764013:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991746048:12345-192.168.203.42@tcp:101:cat.0 Request processed in 98us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.764019:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21800 00000100:00100000:2.0:1746127006.764046:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21801 00000100:00100000:2.0:1746127006.764051:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991745664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.764057:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.764066:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5370a expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127006.764079:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c89c, atime: 0x6813c89c, ctime: 0x6813c89c, blocks: 0x7f8 00010000:00010000:2.0:1746127006.764086:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.764087:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.764091:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.764098:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127006.764253:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21802 00000100:00100000:0.0:1746127006.764260:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991745920:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127006.764267:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.764276:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53718 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746127006.764290:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c89c, atime: 0x6813c89b, ctime: 0x6813c89b, blocks: 0x808 00010000:00010000:0.0:1746127006.764298:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.764299:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.764303:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.764311:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 14 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.764317:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11600, rc 0) 00000100:00100000:0.0:1746127006.764331:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991745920:12345-192.168.203.42@tcp:101:cat.0 Request processed in 73us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.764336:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21802 00000100:00100000:1.0:1746127006.764623:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.764668:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991746304 00000100:00100000:0.0:1746127006.764672:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991746304 00010000:00010000:2.0:1746127006.764891:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664dc00, rc 0) 00000100:00100000:2.0:1746127006.764908:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991745664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 857us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.764913:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21801 00000100:00100000:3.0:1746127006.764954:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991745792:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1365us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.764962:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21799 00000100:00100000:0.0:1746127006.764989:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21803 00000100:00100000:0.0:1746127006.764994:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991746304:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127006.765000:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.765008:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53726 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746127006.765019:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c89d, atime: 0x6813c89c, ctime: 0x6813c89d, blocks: 0x1008 00010000:00010000:0.0:1746127006.765036:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.765038:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.765042:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.765054:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.765060:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10600, rc 0) 00000100:00100000:0.0:1746127006.765074:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991746304:12345-192.168.203.42@tcp:101:cat.0 Request processed in 81us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.765078:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21803 00000100:00100000:2.0:1746127006.765289:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991746432 00000100:00100000:2.0:1746127006.765292:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991746432 00000100:00100000:2.0:1746127006.765317:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6608 00000100:00100000:2.0:1746127006.765321:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:4409:x1830945991746432:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:2.0:1746127006.765777:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:4409:x1830945991746432:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 454us (2702us total) trans 8589938270 rc 0/0 00000100:00100000:2.0:1746127006.765783:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6608 00000100:00100000:0.0:1746127006.778020:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.778175:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991746688 00000100:00100000:2.0:1746127006.778185:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991746688 00000100:00100000:2.0:1746127006.778236:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17315 00000100:00100000:2.0:1746127006.778244:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+56:4417:x1830945991746688:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127006.778269:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.778288:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37e00/0x34dc807b6efa5f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5372d expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.778532:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127006.778613:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127006.778625:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:2.0:1746127006.778636:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127006.778727:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c37e00/0x34dc807b6efa5f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 59 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.778822:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 58 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.778830:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127006.778833:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127006.778835:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36000, rc 0) 00000100:00100000:2.0:1746127006.778942:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+58:4417:x1830945991746688:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 698us (932us total) trans 8589938271 rc 0/0 00000100:00100000:2.0:1746127006.778948:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17315 00000100:00100000:2.0:1746127006.779310:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.779328:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.779703:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991746816 00000100:00100000:0.0:1746127006.779709:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991746816 00000100:00100000:2.0:1746127006.779712:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.779740:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991746944 00000100:00100000:0.0:1746127006.779742:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991746944 00000100:00100000:2.0:1746127006.779746:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991747072 00000100:00100000:2.0:1746127006.779748:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991747072 00000100:00100000:0.0:1746127006.779757:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21804 00000100:00100000:2.0:1746127006.779762:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21805 00000100:00100000:0.0:1746127006.779763:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2029:x1830945991746816:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127006.779767:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991746944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.779773:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.779773:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.779784:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5373b expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.779784:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53734 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.779803:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.779804:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.779812:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 27 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.779824:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 27 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.779836:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11000, rc 0) 00000100:00100000:0.0:1746127006.779860:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991746816:12345-192.168.203.42@tcp:101:cat.0 Request processed in 97us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.779865:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21804 00010000:00010000:2.0:1746127006.779875:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127006.779875:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21806 00010000:00010000:2.0:1746127006.779876:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127006.779880:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991747072:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.779881:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 39 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.779885:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.779890:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 39 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.779891:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53742 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.779897:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36600, rc 0) 00010000:00010000:0.0:1746127006.779900:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.779901:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.779909:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 40 pid: 1964 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127006.779911:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991746944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 144us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.779916:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21805 00010000:00010000:0.0:1746127006.779918:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 40 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.779925:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11a00, rc 0) 00000100:00100000:2.0:1746127006.779934:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.779936:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991747072:12345-192.168.203.42@tcp:101:cat.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.779941:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21806 00000100:00100000:2.0:1746127006.779943:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991747200 00000100:00100000:2.0:1746127006.779945:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991747200 00000100:00100000:2.0:1746127006.779957:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21807 00000100:00100000:2.0:1746127006.779962:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991747200:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.779967:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.779974:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53749 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.779976:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127006.779984:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.779986:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127006.779986:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991747328 00000100:00100000:0.0:1746127006.779988:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991747328 00010000:00010000:2.0:1746127006.779989:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.779997:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 29 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127006.780001:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21808 00010000:00010000:2.0:1746127006.780005:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d200, rc 0) 00000100:00100000:0.0:1746127006.780005:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991747328:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127006.780010:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127006.780016:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991747200:12345-192.168.203.42@tcp:101:cat.0 Request processed in 55us (82us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127006.780016:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53750 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.780021:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21807 00010000:00010000:0.0:1746127006.780024:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.780041:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.780046:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.780054:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 29 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.780060:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11800, rc 0) 00000100:00100000:0.0:1746127006.780073:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991747328:12345-192.168.203.42@tcp:101:cat.0 Request processed in 68us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.780077:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21808 00000100:00100000:2.0:1746127006.780080:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.780814:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991747456 00000100:00100000:0.0:1746127006.780819:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991747456 00000100:00100000:0.0:1746127006.780840:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21809 00000100:00100000:0.0:1746127006.780845:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2029:x1830945991747456:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127006.780852:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.780858:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53757 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.780869:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.780871:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.780875:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 40 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.780884:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 40 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.780891:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11400, rc 0) 00000100:00100000:0.0:1746127006.780909:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991747456:12345-192.168.203.42@tcp:101:cat.0 Request processed in 65us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.780914:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21809 00000100:00100000:0.0:1746127006.791424:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.792473:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991747584 00000100:00100000:3.0:1746127006.792483:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991747584 00000100:00100000:3.0:1746127006.792528:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21810 00000100:00100000:3.0:1746127006.792535:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4417:x1830945991747584:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127006.792554:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.792571:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5375e expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.792600:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.792607:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 30 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.792612:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.792614:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.792617:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2342912->2498559] (req 2342912->2498559) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 30 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.792646:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 30 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.792656:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 30 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.792666:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289664:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.792759:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.792767:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 15 pid: 11152 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.792775:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289792:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.792792:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.793648:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.794123:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289664:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.794154:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994289792:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.794158:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.794188:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991747840 00000100:00100000:0.0:1746127006.794192:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991747840 00010000:00010000:3.0:1746127006.794218:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2342912->2498559] (req 2342912->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 31 pid: 3148 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746127006.794223:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88011dc60700 x1830945991747840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746127006.794229:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991748096 00010000:00010000:3.0:1746127006.794231:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915be00, rc 0) 00002000:00100000:0.0:1746127006.794231:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60700 with x1830945991747840 ext(0->1048575) 00000100:00100000:2.0:1746127006.794233:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991748096 00002000:00010000:0.0:1746127006.794235:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60700 00000100:00100000:0.0:1746127006.794249:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8724 00002000:00100000:2.0:1746127006.794252:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88011dc63480 x1830945991748096/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746127006.794254:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991747840:12345-192.168.203.42@tcp:3:multiop.0 00002000:00100000:2.0:1746127006.794260:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63480 with x1830945991748096 ext(1048576->2097151) 00002000:00010000:2.0:1746127006.794263:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc63480 00000100:00100000:3.0:1746127006.794269:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4417:x1830945991747584:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1730us (2851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.794275:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8725 00000100:00100000:3.0:1746127006.794276:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21810 00000100:00100000:2.0:1746127006.794280:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991748096:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127006.802374:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.802405:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.802430:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.802447:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.802482:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991748608 00000100:00100000:0.0:1746127006.802490:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991748608 00002000:00100000:0.0:1746127006.802527:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880095ca9500 x1830945991748608/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.802534:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9500 with x1830945991748608 ext(1048576->2097151) 00002000:00010000:0.0:1746127006.802539:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ca9500 00000100:00100000:0.0:1746127006.802561:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991748864 00000100:00100000:0.0:1746127006.802563:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991748864 00002000:00100000:0.0:1746127006.802576:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880095ca8380 x1830945991748864/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.802581:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8380 with x1830945991748864 ext(1048576->2097151) 00002000:00010000:0.0:1746127006.802584:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca8380 00000100:00100000:0.0:1746127006.802595:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8726 00000100:00100000:0.0:1746127006.802601:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991748608:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127006.802604:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8727 00000100:00100000:1.0:1746127006.802612:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991748864:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127006.802739:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991748224 00000100:00100000:2.0:1746127006.802743:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991748224 00010000:00010000:2.0:1746127006.802765:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 34 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.802784:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991748352 00000100:00100000:2.0:1746127006.802787:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991748352 00010000:00010000:2.0:1746127006.802796:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 16 pid: 11152 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.802809:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10239 00000100:00100000:2.0:1746127006.802814:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991748224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.802826:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.802847:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 34 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.802858:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 34 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.802880:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11800/0x34dc807b6efa621 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53750 expref: 34 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.802888:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10240 00000100:00100000:3.0:1746127006.802896:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991748352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.802904:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.802906:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127006.802913:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 16 pid: 11152 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.802922:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 16 pid: 11152 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.802936:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11e00/0x34dc807b6efa5c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53703 expref: 16 pid: 11152 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.802949:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.802951:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.802957:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.802965:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.802995:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.803005:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994289920:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127006.803520:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991748224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 702us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.803526:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10239 00000100:00100000:3.0:1746127006.805019:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.805206:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991747840:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 10949us (11558us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127006.805216:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8724 00002000:00100000:1.0:1746127006.805225:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88011dc60700 x1830945991747840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.805233:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60700 with x1830945991747840 ext(0->1048575) 00002000:00010000:1.0:1746127006.805240:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60700 00000100:00100000:0.0:1746127006.811008:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.811043:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991748992 00000100:00100000:2.0:1746127006.811052:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991748992 00000100:00100000:2.0:1746127006.811098:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21811 00000100:00100000:2.0:1746127006.811105:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4413:x1830945991748992:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127006.811122:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.811154:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53765 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.811187:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.811195:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 43 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.811200:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.811202:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.811205:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3313664->4001791] (req 3313664->4001791) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.811237:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 43 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.811248:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 43 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.811259:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994290048:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.811345:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.811352:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 15 pid: 1964 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.811360:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994290176:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.811387:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.811505:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991748096:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 17224us (17347us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127006.811513:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8725 00002000:00100000:2.0:1746127006.811521:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88011dc63480 x1830945991748096/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.811604:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63480 with x1830945991748096 ext(1048576->2097151) 00002000:00010000:2.0:1746127006.811609:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc63480 00000100:00100000:3.0:1746127006.813950:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994289920:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127006.813995:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.814263:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991748352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 11365us (11852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.814272:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10240 00000100:00100000:0.0:1746127006.814776:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.814983:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991749248 00000100:00100000:2.0:1746127006.814989:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991749248 00002000:00100000:2.0:1746127006.815023:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2342912->2347007) req@ffff880095ca9c00 x1830945991749248/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.815044:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9c00 with x1830945991749248 ext(2342912->2347007) 00002000:00010000:2.0:1746127006.815048:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca9c00 00000100:00100000:2.0:1746127006.815073:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8728 00000100:00100000:2.0:1746127006.815078:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991749248:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127006.815225:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991749248:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 145us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127006.815232:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8728 00002000:00100000:2.0:1746127006.815236:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2342912->2347007) req@ffff880095ca9c00 x1830945991749248/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.815243:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9c00 with x1830945991749248 ext(2342912->2347007) 00002000:00010000:2.0:1746127006.815246:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca9c00 00000100:00100000:0.0:1746127006.815704:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.815720:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.815746:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991749376 00000100:00100000:3.0:1746127006.815750:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991749376 00010000:00010000:3.0:1746127006.815772:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 42 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.815774:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991749504 00000100:00100000:0.0:1746127006.815777:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991749504 00010000:00010000:0.0:1746127006.815793:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 16 pid: 1964 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.815799:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10241 00000100:00100000:3.0:1746127006.815804:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991749376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127006.815810:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10242 00010000:00010000:3.0:1746127006.815813:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127006.815815:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991749504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127006.815821:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.815828:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 42 pid: 16295 timeout: 1001 lvb_type: 1 00010000:00010000:0.0:1746127006.815830:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 16 pid: 1964 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.815839:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 42 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.815953:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991748864:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 13342us (13503us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127006.815960:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8727 00002000:00100000:1.0:1746127006.815966:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880095ca8380 x1830945991748864/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.815974:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8380 with x1830945991748864 ext(1048576->2097151) 00002000:00010000:1.0:1746127006.815977:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca8380 00010000:00010000:0.0:1746127006.816171:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 16 pid: 1964 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.816227:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.816230:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.816237:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.816246:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.816280:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127006.816294:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.816294:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11400/0x34dc807b6efa628 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53757 expref: 42 pid: 16295 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.816297:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991749504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 480us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.816302:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10242 00000100:00100000:3.0:1746127006.816304:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994290304:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127006.816311:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994290048:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.816335:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10600/0x34dc807b6efa5e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53726 expref: 15 pid: 1964 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746127006.816343:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994290176:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.816361:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00010000:00010000:2.0:1746127006.816363:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 14 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.816372:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad800, rc 0) 00000100:00100000:2.0:1746127006.816394:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4413:x1830945991748992:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5290us (5396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.816401:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21811 00000100:00100000:1.0:1746127006.817502:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991748608:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 14898us (15066us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127006.817510:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8726 00002000:00100000:1.0:1746127006.817516:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880095ca9500 x1830945991748608/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.817524:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9500 with x1830945991748608 ext(1048576->2097151) 00002000:00010000:1.0:1746127006.817528:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ca9500 00000100:00100000:3.0:1746127006.818364:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994290304:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127006.818399:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.818427:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991749376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2623us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.818434:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10241 00000100:00100000:0.0:1746127006.821614:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.821665:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.821756:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991749760 00000100:00100000:1.0:1746127006.821765:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991749760 00002000:00100000:1.0:1746127006.821809:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3313664->3317759) req@ffff880095caaa00 x1830945991749760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.821819:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caaa00 with x1830945991749760 ext(3313664->3317759) 00002000:00010000:1.0:1746127006.821825:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caaa00 00000100:00100000:1.0:1746127006.821840:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991750016 00000100:00100000:1.0:1746127006.821843:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991750016 00002000:00100000:1.0:1746127006.821854:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2494464->2498559) req@ffff880130a78e00 x1830945991750016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.821868:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78e00 with x1830945991750016 ext(2494464->2498559) 00002000:00010000:1.0:1746127006.821871:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a78e00 00000100:00100000:1.0:1746127006.821895:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8729 00000100:00100000:1.0:1746127006.821902:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991749760:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127006.822046:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991749760:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 126us (422us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127006.822052:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8729 00002000:00100000:1.0:1746127006.822058:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3313664->3317759) req@ffff880095caaa00 x1830945991749760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.822065:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caaa00 with x1830945991749760 ext(3313664->3317759) 00002000:00010000:1.0:1746127006.822068:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caaa00 00000100:00100000:1.0:1746127006.822081:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8730 00000100:00100000:1.0:1746127006.822086:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991750016:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127006.822183:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991750016:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 97us (517us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127006.822189:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8730 00002000:00100000:1.0:1746127006.822193:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2494464->2498559) req@ffff880130a78e00 x1830945991750016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.822201:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78e00 with x1830945991750016 ext(2494464->2498559) 00002000:00010000:1.0:1746127006.822203:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a78e00 00000100:00100000:0.0:1746127006.830417:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.830534:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991750272 00000100:00100000:3.0:1746127006.830544:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991750272 00002000:00100000:3.0:1746127006.830594:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3997696->4001791) req@ffff880130a7aa00 x1830945991750272/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.830604:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7aa00 with x1830945991750272 ext(3997696->4001791) 00002000:00010000:3.0:1746127006.830609:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7aa00 00000100:00100000:3.0:1746127006.830630:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8731 00000100:00100000:3.0:1746127006.830637:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991750272:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.830786:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991750272:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 145us (375us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127006.830793:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8731 00002000:00100000:3.0:1746127006.830798:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3997696->4001791) req@ffff880130a7aa00 x1830945991750272/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.830806:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7aa00 with x1830945991750272 ext(3997696->4001791) 00002000:00010000:3.0:1746127006.830809:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7aa00 00000100:00100000:0.0:1746127006.831416:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.831587:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991750528 00000100:00100000:3.0:1746127006.831591:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991750528 00002000:00100000:3.0:1746127006.831610:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880130a79500 x1830945991750528/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 504/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.831618:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79500 with x1830945991750528 ext(2097152->3145727) 00002000:00010000:3.0:1746127006.831622:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79500 00000100:00100000:3.0:1746127006.831634:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8732 00000100:00100000:3.0:1746127006.831640:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991750528:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127006.838008:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991750528:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6357us (6582us total) trans 0 rc 892928/892928 00000100:00100000:3.0:1746127006.838020:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8732 00002000:00100000:3.0:1746127006.838040:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880130a79500 x1830945991750528/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 504/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.838050:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79500 with x1830945991750528 ext(2097152->3145727) 00002000:00010000:3.0:1746127006.838056:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79500 00000100:00100000:2.0:1746127006.845590:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.845909:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991750656 00000100:00100000:0.0:1746127006.845919:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991750656 00000100:00100000:0.0:1746127006.845962:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21812 00000100:00100000:0.0:1746127006.845969:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4418:x1830945991750656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127006.845985:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.846002:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5376c expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.846048:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.846055:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.846057:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127006.846059:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.846092:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.846103:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 13 pid: 3148 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.846114:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994290432:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.846228:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.848894:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.848944:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994290432:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.848974:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.848993:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f86200, rc 0) 00000100:00100000:2.0:1746127006.849060:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4418:x1830945991750656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3090us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.849068:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21812 00000100:00100000:3.0:1746127006.851054:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991750784 00000100:00100000:3.0:1746127006.851066:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991750784 00002000:00100000:3.0:1746127006.851111:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3313664->4001791) req@ffff880130a79f80 x1830945991750784/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.851119:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79f80 with x1830945991750784 ext(3313664->4001791) 00010000:00010000:3.0:1746127006.851144:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 14 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.851159:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 14 pid: 3148 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.851166:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a79f80 00000100:00100000:3.0:1746127006.851197:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1938 00000100:00100000:3.0:1746127006.851205:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991750784:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127006.860683:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991750784:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 9466us (11784us total) trans 17179875618 rc 0/0 00000100:00100000:0.0:1746127006.860696:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1938 00002000:00100000:0.0:1746127006.860708:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3313664->4001791) req@ffff880130a79f80 x1830945991750784/t17179875618(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.860718:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79f80 with x1830945991750784 ext(3313664->4001791) 00010000:00010000:0.0:1746127006.860728:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746127006.860746:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 1001 lvb_type: 0 00002000:00010000:0.0:1746127006.860753:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a79f80 00000100:00100000:0.0:1746127006.865326:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.865441:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991750912 00000100:00100000:3.0:1746127006.865450:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991750912 00010000:00010000:3.0:1746127006.865491:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.866245:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10243 00000100:00100000:3.0:1746127006.866253:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991750912:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.866267:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.866286:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.866297:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.866318:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad800/0x34dc807b6efa636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3313664->4001791) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53765 expref: 16 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.866349:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.866351:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.866358:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 39 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.866365:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 39 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.866397:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 39 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.866408:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994290560:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127006.866505:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2300 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.869493:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994290560:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127006.869544:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.869586:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991750912:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3334us (4272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.869598:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10243 00000100:00100000:0.0:1746127006.875512:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.876561:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991751424 00000100:00100000:2.0:1746127006.876572:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991751424 00000100:00100000:1.0:1746127006.876831:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.877809:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991751296 00000100:00100000:0.0:1746127006.877816:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991751296 00002000:00100000:0.0:1746127006.877848:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122385500 x1830945991751296/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.877859:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385500 with x1830945991751296 ext(2097152->4194303) 00002000:00010000:0.0:1746127006.877864:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122385500 00000100:00100000:0.0:1746127006.877899:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8733 00000100:00100000:0.0:1746127006.877906:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991751296:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:2.0:1746127006.878077:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880130a7b100 x1830945991751424/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127006.878086:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b100 with x1830945991751424 ext(3145728->4194303) 00002000:00010000:2.0:1746127006.878090:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7b100 00000100:00100000:2.0:1746127006.878108:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8734 00000100:00100000:2.0:1746127006.878115:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991751424:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127006.894086:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991751424:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15960us (18572us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.894098:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8734 00002000:00100000:3.0:1746127006.894110:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880130a7b100 x1830945991751424/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.894119:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b100 with x1830945991751424 ext(3145728->4194303) 00002000:00010000:3.0:1746127006.894124:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7b100 00010000:00010000:2.0:1746127006.897344:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127006.900040:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.900080:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.900111:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.900212:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991751808 00000100:00100000:0.0:1746127006.900220:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991751808 00000100:00100000:2.0:1746127006.900263:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991751552 00000100:00100000:2.0:1746127006.900266:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991751552 00000100:00100000:0.0:1746127006.900275:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17316 00000100:00100000:0.0:1746127006.900282:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:4425:x1830945991751808:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:2.0:1746127006.900293:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991751680 00000100:00100000:2.0:1746127006.900295:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991751680 00000100:00100000:2.0:1746127006.900309:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21813 00010000:00010000:0.0:1746127006.900310:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127006.900313:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991751552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.900320:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.900329:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86000/0x34dc807b6efa644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53781 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.900330:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a46a00/0x34dc807b6efa64b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53773 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.900382:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994290688:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127006.900468:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.900487:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21814 00000100:00100000:2.0:1746127006.900492:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991751680:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127006.900493:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991751296:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22585us (23660us total) trans 0 rc 2097152/2097152 00010000:00010000:2.0:1746127006.900498:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.900508:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5377a expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127006.900515:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8733 00010000:00010000:2.0:1746127006.900522:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.900524:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746127006.900524:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122385500 x1830945991751296/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127006.900533:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746127006.900533:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385500 with x1830945991751296 ext(2097152->4194303) 00002000:00010000:1.0:1746127006.900537:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122385500 00010000:00010000:2.0:1746127006.900547:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.900557:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47800, rc 0) 00010000:00010000:0.0:1746127006.900557:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.900570:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00000100:00100000:2.0:1746127006.900573:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991751680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 81us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.900578:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21814 00010000:00010000:0.0:1746127006.900580:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.900593:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.900600:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.900606:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.900674:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.900683:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.900690:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 57 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.900695:0:13466:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.900715:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 57 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.900726:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 57 pid: 13466 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.900734:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a79180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994290816:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.900778:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.900785:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 32 pid: 13448 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.900797:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994290944:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.900814:0:13466:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.903778:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.903828:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.903872:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991752064 00000100:00100000:0.0:1746127006.903879:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991752064 00000100:00100000:0.0:1746127006.903917:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991752320 00000100:00100000:0.0:1746127006.903919:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991752320 00000100:00100000:0.0:1746127006.903933:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6609 00000100:00100000:0.0:1746127006.903940:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+58:32472:x1830945991752064:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746127006.904191:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+59:32472:x1830945991752064:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 250us (421us total) trans 8589938272 rc 0/0 00000100:00100000:0.0:1746127006.904198:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6609 00000100:00100000:0.0:1746127006.904213:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6610 00000100:00100000:0.0:1746127006.904217:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:27908:x1830945991752320:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746127006.904272:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+34:27908:x1830945991752320:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 54us (443us total) trans 8589938273 rc 0/0 00000100:00100000:0.0:1746127006.904277:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6610 00000100:00100000:1.0:1746127006.904775:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a79180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994290816:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.904786:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994290944:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.904814:0:13466:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:2.0:1746127006.905156:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994290688:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127006.905180:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a46a00/0x34dc807b6efa64b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53773 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.905192:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a46a00/0x34dc807b6efa64b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53773 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.905216:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46a00, rc 0) 00000100:00100000:2.0:1746127006.905250:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991751552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4935us (5233us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127006.905256:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21813 00000100:00100000:0.0:1746127006.906062:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.906697:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991752448 00000100:00100000:3.0:1746127006.906706:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991752448 00010000:00010000:3.0:1746127006.906742:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 59 pid: 13466 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.906768:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10244 00000100:00100000:3.0:1746127006.906775:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+59:2026:x1830945991752448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.906788:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.906793:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 59 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.906803:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 59 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.906821:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c36000/0x34dc807b6efa5f7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5372d expref: 59 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.906837:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.906841:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.906850:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.906854:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.906858:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.906905:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+58:2026:x1830945991752448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 130us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.906910:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10244 00000100:00100000:2.0:1746127006.909106:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.909231:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991752576 00000100:00100000:3.0:1746127006.909243:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991752576 00010000:00010000:3.0:1746127006.909273:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 34 pid: 13448 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.909301:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10245 00000100:00100000:3.0:1746127006.909308:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2029:x1830945991752576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.909319:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.909324:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 34 pid: 13448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.909335:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 34 pid: 13448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.909360:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dd600/0x34dc807b6efa580 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e536ee expref: 34 pid: 13448 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.909371:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.909376:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.910004:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.910014:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.910057:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127006.910081:0:13466:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910089:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127006.910113:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2029:x1830945991752576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 804us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.910121:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10245 00000004:00200000:1.0:1746127006.910160:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127006.910165:0:13466:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127006.910181:0:13466:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910191:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910200:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910211:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910221:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910226:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011ea87600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127006.910230:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910236:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910244:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127006.910246:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127006.910250:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910254:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87600/0x34dc807b6efa652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910273:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910277:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910280:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910283:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011ea87000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127006.910285:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910289:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910297:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929fd00) 00010000:00010000:1.0:1746127006.910299:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127006.910301:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910305:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea87000/0x34dc807b6efa660 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127006.910341:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86000/0x34dc807b6efa644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 18 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.910354:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 17 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.910360:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127006.910362:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127006.910364:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea86800, rc 0) 00000100:00100000:1.0:1746127006.910403:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:4425:x1830945991751808:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 10122us (10291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.910409:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17316 00000100:00100000:3.0:1746127006.911377:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.913731:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991752832 00000100:00100000:1.0:1746127006.913744:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991752832 00002000:00100000:1.0:1746127006.913805:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009da76d80 x1830945991752832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.913817:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da76d80 with x1830945991752832 ext(4194304->4829183) 00002000:00010000:1.0:1746127006.913823:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da76d80 00000100:00100000:1.0:1746127006.914369:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8735 00000100:00100000:1.0:1746127006.914379:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991752832:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127006.917501:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.917600:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991752960 00000100:00100000:2.0:1746127006.917620:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991752960 00000100:00100000:2.0:1746127006.917677:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21815 00000100:00100000:2.0:1746127006.917686:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2028:x1830945991752960:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127006.917706:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.917727:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53788 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.917757:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.917759:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.917770:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.917787:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.917799:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be46e00, rc 0) 00000100:00100000:2.0:1746127006.917843:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991752960:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 158us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.917849:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21815 00000100:00100000:2.0:1746127006.919054:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.919294:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991753088 00000100:00100000:0.0:1746127006.919300:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991753088 00000100:00100000:0.0:1746127006.919443:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21816 00000100:00100000:0.0:1746127006.919450:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2029:x1830945991753088:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127006.919466:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.919484:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5378f expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.919502:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.919505:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127006.919512:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 8 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.919526:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 8 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127006.919534:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5207600, rc 0) 00000100:00100000:0.0:1746127006.919665:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991753088:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 215us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.919671:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21816 00000100:00100000:0.0:1746127006.921710:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.921753:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.921781:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.921806:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991753472 00000100:00100000:0.0:1746127006.921806:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.921815:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991753472 00000100:00100000:3.0:1746127006.921829:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991753728 00000100:00100000:3.0:1746127006.921831:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991753728 00000100:00100000:0.0:1746127006.921831:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.921845:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.921858:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127006.921866:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a7a680 x1830945991753728/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746127006.921873:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127006.921875:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7a680 with x1830945991753728 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.921881:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7a680 00000100:00100000:3.0:1746127006.921896:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991753984 00000100:00100000:3.0:1746127006.921898:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991753984 00002000:00100000:3.0:1746127006.921908:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a7a300 x1830945991753984/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.921914:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7a300 with x1830945991753984 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.921917:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7a300 00000100:00100000:3.0:1746127006.921925:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991754240 00000100:00100000:3.0:1746127006.921927:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991754240 00002000:00100000:3.0:1746127006.921937:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a7b800 x1830945991754240/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.921944:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b800 with x1830945991754240 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.921947:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7b800 00000100:00100000:3.0:1746127006.921958:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8736 00000100:00100000:3.0:1746127006.921964:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991753728:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127006.922112:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8737 00000100:00100000:1.0:1746127006.922122:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991753984:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127006.922759:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8738 00000100:00100000:3.0:1746127006.922765:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991754240:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127006.922823:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991753216 00000100:00100000:2.0:1746127006.922829:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991753216 00000100:00100000:2.0:1746127006.922854:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991754368 00000100:00100000:2.0:1746127006.922856:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991754368 00000100:00100000:2.0:1746127006.922868:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991754624 00000100:00100000:2.0:1746127006.922869:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991754624 00000100:00100000:2.0:1746127006.922886:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991754496 00000100:00100000:2.0:1746127006.922888:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991754496 00000100:00100000:2.0:1746127006.922901:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21817 00000100:00100000:2.0:1746127006.922906:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991753216:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127006.922915:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.922932:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53796 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.922951:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.922953:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.922961:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.922984:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.922996:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47c00, rc 0) 00000100:00100000:2.0:1746127006.923024:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991753216:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 118us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.923040:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21817 00000100:00100000:2.0:1746127006.923055:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21818 00000100:00100000:2.0:1746127006.923060:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991754368:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127006.923067:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.923076:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5379d expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.923086:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.923087:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.923091:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.923100:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.923111:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47600, rc 0) 00000100:00100000:2.0:1746127006.923126:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991754368:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 66us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.923150:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21818 00000100:00100000:2.0:1746127006.923160:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21819 00000100:00100000:2.0:1746127006.923164:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991754624:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127006.923170:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.923176:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537ab expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.923185:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.923187:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.923191:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.923198:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.923205:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be46200, rc 0) 00000100:00100000:2.0:1746127006.923218:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991754624:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 54us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.923222:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21819 00000100:00100000:2.0:1746127006.923230:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21820 00000100:00100000:2.0:1746127006.923234:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991754496:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127006.923242:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.923248:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be47a00/0x34dc807b6efa691 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537a4 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.923285:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994291072:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127006.923332:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00002000:00100000:3.0:1746127006.923513:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880130a78380 x1830945991753472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.923522:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78380 with x1830945991753472 ext(0->1048575) 00002000:00010000:3.0:1746127006.923526:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a78380 00000100:00100000:3.0:1746127006.923544:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8739 00000100:00100000:3.0:1746127006.923548:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991753472:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127006.928784:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991752832:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14389us (17391us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746127006.928799:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8735 00002000:00100000:0.0:1746127006.928815:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009da76d80 x1830945991752832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127006.928826:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009da76d80 with x1830945991752832 ext(4194304->4829183) 00002000:00010000:0.0:1746127006.928832:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009da76d80 00000100:00100000:3.0:1746127006.936699:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991753728:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14723us (14905us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.936721:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8736 00002000:00100000:3.0:1746127006.936734:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a7a680 x1830945991753728/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.936744:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7a680 with x1830945991753728 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.936750:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7a680 00000100:00100000:2.0:1746127006.936997:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994291072:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127006.937041:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be47a00/0x34dc807b6efa691 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537a4 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.937056:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be47a00/0x34dc807b6efa691 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537a4 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127006.937072:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47a00, rc 0) 00000100:00100000:2.0:1746127006.937094:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991754496:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 13858us (15219us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127006.937100:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21820 00000100:00100000:1.0:1746127006.937359:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991753984:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15238us (15550us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127006.937366:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8737 00002000:00100000:1.0:1746127006.937372:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a7a300 x1830945991753984/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127006.937379:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7a300 with x1830945991753984 ext(1048576->2097151) 00002000:00010000:1.0:1746127006.937382:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7a300 00000100:00100000:0.0:1746127006.940857:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.941005:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991754240:12345-192.168.203.42@tcp:3:cat.0 Request processed in 18239us (19171us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.941018:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8738 00002000:00100000:3.0:1746127006.941043:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a7b800 x1830945991754240/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.941052:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b800 with x1830945991754240 ext(1048576->2097151) 00002000:00010000:3.0:1746127006.941058:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7b800 00000100:00100000:0.0:1746127006.941449:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991754880 00000100:00100000:0.0:1746127006.941456:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991754880 00000100:00100000:0.0:1746127006.941693:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17317 00000100:00100000:0.0:1746127006.941700:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:4425:x1830945991754880:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127006.941717:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127006.941737:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa698 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537b2 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.941837:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.941852:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 18 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.941859:0:13466:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127006.941888:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 18 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127006.941901:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 18 pid: 13466 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746127006.941912:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994291200:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.942975:0:13466:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127006.943111:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.943204:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991755136 00000100:00100000:2.0:1746127006.943210:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991755136 00000100:00100000:2.0:1746127006.943280:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17318 00000100:00100000:2.0:1746127006.943287:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+58:4428:x1830945991755136:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127006.943303:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.943315:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537b9 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.943376:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.943387:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.943394:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127006.944086:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991753472:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20535us (22330us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.944096:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8739 00002000:00100000:3.0:1746127006.944104:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880130a78380 x1830945991753472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.944114:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78380 with x1830945991753472 ext(0->1048575) 00002000:00010000:3.0:1746127006.944119:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a78380 00000100:00100000:0.0:1746127006.944357:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.944519:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991755264 00000100:00100000:3.0:1746127006.944522:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991755264 00010000:00010000:3.0:1746127006.944541:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 19 pid: 13466 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.944713:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994291200:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127006.944732:0:13466:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127006.944875:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10246 00000100:00100000:3.0:1746127006.944881:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2029:x1830945991755264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.944892:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.944897:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 19 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.944907:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 19 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.944925:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011ea86800/0x34dc807b6efa667 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53781 expref: 19 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.944941:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.944944:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.944952:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.944957:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.944963:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.944967:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.944971:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.944988:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.945010:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2029:x1830945991755264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 129us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.945019:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10246 00010000:00010000:3.0:1746127006.945043:0:13466:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127006.945048:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:3.0:1746127006.945064:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127006.945193:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 19 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.945205:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 18 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.945211:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.945214:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127006.945216:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf6600, rc 0) 00000100:00100000:3.0:1746127006.945237:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4425:x1830945991754880:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3538us (4392us total) trans 8589938274 rc 0/0 00000100:00100000:3.0:1746127006.945243:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17317 00010000:00010000:3.0:1746127006.945270:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.945276:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127006.945284:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127006.945327:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 61 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.945341:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 60 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.945346:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.945348:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127006.945350:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a89a00, rc 0) 00000100:00100000:3.0:1746127006.945368:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+60:4428:x1830945991755136:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2082us (2258us total) trans 8589938275 rc 0/0 00000100:00100000:3.0:1746127006.945374:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17318 00000100:00100000:0.0:1746127006.950015:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.950156:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991755392 00000100:00100000:3.0:1746127006.950166:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991755392 00000100:00100000:3.0:1746127006.950216:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17319 00000100:00100000:3.0:1746127006.950224:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4425:x1830945991755392:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127006.950247:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.950267:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6efa6c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537c0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.950357:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.950377:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 19 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.950384:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 59 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.950390:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.950424:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 59 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.950436:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 59 pid: 13448 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.950447:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994291328:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.950769:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 19 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.950868:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 19 pid: 13466 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.950876:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994291456:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.950901:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.951826:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994291328:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.951961:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.952246:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994291456:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.952549:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991755520 00000100:00100000:1.0:1746127006.952555:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991755520 00010000:00010000:1.0:1746127006.952584:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 60 pid: 13448 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746127006.952610:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10247 00000100:00100000:1.0:1746127006.952615:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+60:2028:x1830945991755520:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127006.952625:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127006.952630:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 60 pid: 13448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.952640:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 60 pid: 13448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.952661:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a89a00/0x34dc807b6efa6ad lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b9 expref: 60 pid: 13448 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746127006.952684:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127006.952689:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127006.952698:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127006.952703:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127006.952708:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127006.952738:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+59:2028:x1830945991755520:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 122us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.952743:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10247 00010000:00010000:3.0:1746127006.952804:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127006.952848:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.952939:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991755648 00000100:00100000:2.0:1746127006.952946:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991755648 00010000:00010000:2.0:1746127006.952961:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 20 pid: 13466 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.952986:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10248 00000100:00100000:2.0:1746127006.952991:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+20:2029:x1830945991755648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.952998:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.953002:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 20 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.953010:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 20 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.953022:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf6600/0x34dc807b6efa69f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537b2 expref: 20 pid: 13466 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746127006.953044:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127006.953048:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.953103:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.953111:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127006.953126:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.953163:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2029:x1830945991755648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 172us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.953169:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10248 00010000:00010000:3.0:1746127006.953247:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.953253:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127006.953299:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127006.953303:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127006.953317:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.953344:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6efa6c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.953359:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.953365:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.953368:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127006.953370:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213f600, rc 0) 00000100:00100000:3.0:1746127006.953406:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4425:x1830945991755392:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3183us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.953411:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17319 00000100:00100000:0.0:1746127006.953762:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.953964:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.954197:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991755776 00000100:00100000:3.0:1746127006.954203:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991755776 00000100:00100000:3.0:1746127006.954226:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991755904 00000100:00100000:3.0:1746127006.954228:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991755904 00000100:00100000:3.0:1746127006.954242:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21821 00000100:00100000:3.0:1746127006.954247:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4428:x1830945991755776:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127006.954262:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.954274:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537c7 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.954296:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 41 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.954309:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.954316:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.954322:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.954324:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.954327:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.954346:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.954356:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 15 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.954367:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994291584:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.954426:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127006.954434:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 9 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746127006.954442:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994291712:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127006.954466:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 41 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.954474:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 41 pid: 3148 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.954481:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994291840:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.954493:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.954556:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21822 00000100:00100000:2.0:1746127006.954563:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4426:x1830945991755904:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127006.954571:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127006.954579:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537ce expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.954593:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.954598:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.954600:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127006.954602:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 16 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.954615:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.954626:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 28 pid: 3148 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746127006.954633:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994291968:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.954651:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127006.955987:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.956001:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994291584:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127006.956002:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994291968:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127006.956011:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994291712:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127006.956012:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.956017:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994291840:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127006.956021:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 16 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.956039:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127006.956043:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88200, rc 0) 00000100:00100000:2.0:1746127006.956057:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991756288 00000100:00100000:2.0:1746127006.956061:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991756288 00010000:00010000:3.0:1746127006.956073:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 41 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127006.956073:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4426:x1830945991755904:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1511us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127006.956078:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21822 00010000:00010000:3.0:1746127006.956082:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fe00, rc 0) 00010000:00010000:2.0:1746127006.956083:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 16 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.956085:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991756032 00000100:00100000:1.0:1746127006.956090:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991756032 00000100:00100000:3.0:1746127006.956100:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4428:x1830945991755776:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1852us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.956100:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991756160 00000100:00100000:2.0:1746127006.956101:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991756160 00000100:00100000:3.0:1746127006.956105:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21821 00010000:00010000:2.0:1746127006.956109:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 10 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746127006.956122:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127006.956125:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10249 00000100:00100000:2.0:1746127006.956144:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991756288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127006.956145:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21823 00000100:00100000:1.0:1746127006.956152:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991756032:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127006.956155:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127006.956160:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10250 00010000:00010000:1.0:1746127006.956163:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127006.956167:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991756160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.956174:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.956174:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 16 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746127006.956175:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6efa6de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537d5 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.956182:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 16 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.956195:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 10 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.956209:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a47800/0x34dc807b6efa659 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5377a expref: 16 pid: 11152 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746127006.956209:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994292096:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127006.956210:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 10 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746127006.956222:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127006.956223:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be46200/0x34dc807b6efa68a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ab expref: 10 pid: 11152 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746127006.956230:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127006.956240:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991756288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.956245:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991756160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127006.956246:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10249 00000100:00100000:1.0:1746127006.956248:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.956250:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10250 00000100:00100000:3.0:1746127006.956268:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991756416 00000100:00100000:3.0:1746127006.956271:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991756416 00002000:00100000:3.0:1746127006.956293:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2342912->3145727) req@ffff88012d3fc000 x1830945991756416/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 504/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.956303:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fc000 with x1830945991756416 ext(2342912->3145727) 00010000:00010000:3.0:1746127006.956309:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 29 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.956317:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 29 pid: 3148 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746127006.956323:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d3fc000 00000100:00100000:3.0:1746127006.956343:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1939 00000100:00100000:3.0:1746127006.956348:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991756416:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746127006.957266:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994292096:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127006.957285:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6efa6de lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537d5 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.957299:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096642800/0x34dc807b6efa6de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537d5 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127006.957320:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642800, rc 0) 00000100:00100000:1.0:1746127006.957339:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991756032:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1189us (1359us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127006.957343:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21823 00000100:00100000:0.0:1746127006.957871:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.957958:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991756544 00000100:00100000:3.0:1746127006.957963:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991756544 00010000:00010000:3.0:1746127006.957984:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 41 pid: 3148 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746127006.958004:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10251 00000100:00100000:3.0:1746127006.958009:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991756544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.958016:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.958038:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 41 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.958048:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 41 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.958064:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f86200/0x34dc807b6efa63d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5376c expref: 41 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.958077:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.958079:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.958085:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.958094:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.958117:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.958149:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994292224:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127006.958200:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.959731:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991756416:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3376us (3601us total) trans 21474842886 rc 0/0 00000100:00100000:3.0:1746127006.959742:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1939 00002000:00100000:3.0:1746127006.959753:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2342912->3145727) req@ffff88012d3fc000 x1830945991756416/t21474842886(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 504/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.959762:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fc000 with x1830945991756416 ext(2342912->3145727) 00010000:00010000:3.0:1746127006.959771:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 31 pid: 3148 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746127006.959785:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 31 pid: 3148 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127006.959792:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d3fc000 00000100:00100000:0.0:1746127006.960382:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.960417:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.960695:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994292224:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127006.960726:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.960755:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991756544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2746us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.960762:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10251 00000100:00100000:3.0:1746127006.960782:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991757056 00000100:00100000:3.0:1746127006.960786:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991757056 00002000:00100000:3.0:1746127006.960809:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2117632->2121727) req@ffff88012d3ffb80 x1830945991757056/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.960815:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ffb80 with x1830945991757056 ext(2117632->2121727) 00002000:00010000:3.0:1746127006.960818:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3ffb80 00000100:00100000:3.0:1746127006.960834:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8740 00000100:00100000:3.0:1746127006.960838:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991757056:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127006.960940:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991757056:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 100us (521us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127006.960946:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8740 00002000:00100000:3.0:1746127006.960951:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2117632->2121727) req@ffff88012d3ffb80 x1830945991757056/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/4536 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.960957:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ffb80 with x1830945991757056 ext(2117632->2121727) 00002000:00010000:3.0:1746127006.960960:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3ffb80 00000100:00100000:3.0:1746127006.960977:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991756800 00000100:00100000:3.0:1746127006.960980:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991756800 00000100:00100000:3.0:1746127006.961002:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17320 00000100:00100000:3.0:1746127006.961006:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4425:x1830945991756800:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127006.961018:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127006.961050:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fa00/0x34dc807b6efa6e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537dc expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.961165:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961181:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961194:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961205:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961215:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961222:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961227:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213fc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127006.961230:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961238:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961248:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127006.961251:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127006.961254:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961259:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fc00/0x34dc807b6efa6ec lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127006.961284:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fa00/0x34dc807b6efa6e5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537dc expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.961291:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fa00/0x34dc807b6efa6e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537dc expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.961298:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fa00, rc 0) 00000100:00100000:3.0:1746127006.961331:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4425:x1830945991756800:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 324us (951us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127006.961337:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17320 00000100:00100000:0.0:1746127006.966019:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127006.966274:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.966365:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991757440 00000100:00100000:3.0:1746127006.966375:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991757440 00000100:00100000:3.0:1746127006.966423:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6611 00000100:00100000:3.0:1746127006.966431:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4425:x1830945991757440:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1746127006.966634:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.966656:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991757696 00000100:00100000:1.0:1746127006.966659:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991757696 00000100:00100000:1.0:1746127006.966678:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6612 00000100:00100000:1.0:1746127006.966682:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+59:4428:x1830945991757696:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127006.966772:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+60:4428:x1830945991757696:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 89us (138us total) trans 8589938277 rc 0/0 00000100:00100000:1.0:1746127006.966776:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6612 00000100:00100000:2.0:1746127006.966855:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991757184 00000100:00100000:2.0:1746127006.966859:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991757184 00010000:00010000:2.0:1746127006.966884:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 31 pid: 3148 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127006.966919:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10252 00000100:00100000:2.0:1746127006.966926:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991757184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127006.966935:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127006.966955:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 31 pid: 3148 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127006.966966:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 31 pid: 3148 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127006.966991:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efa62f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->2498559) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5375e expref: 31 pid: 3148 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127006.967003:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.967006:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127006.967013:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 15 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.967021:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 15 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127006.967066:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 15 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127006.967078:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994292352:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127006.967149:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.967629:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:4425:x1830945991757440:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 1198us (1620us total) trans 8589938276 rc 0/0 00000100:00100000:3.0:1746127006.967635:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6611 00000100:00100000:3.0:1746127006.971484:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994292352:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127006.971509:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.971570:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991757184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4642us (5294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.971581:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10252 00000100:00100000:0.0:1746127006.974051:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.974703:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991757952 00000100:00100000:3.0:1746127006.974713:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991757952 00002000:00100000:3.0:1746127006.974761:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012d3ff480 x1830945991757952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.974771:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff480 with x1830945991757952 ext(2097152->3145727) 00002000:00010000:3.0:1746127006.974777:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3ff480 00000100:00100000:3.0:1746127006.975094:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8741 00000100:00100000:3.0:1746127006.975101:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991757952:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127006.985816:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991757952:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10704us (11763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127006.985829:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8741 00002000:00100000:3.0:1746127006.985840:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88012d3ff480 x1830945991757952/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:12/0 lens 488/440 e 0 to 0 dl 1746127017 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.985856:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff480 with x1830945991757952 ext(2097152->3145727) 00002000:00010000:3.0:1746127006.985862:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3ff480 00000100:00100000:0.0:1746127006.988393:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.988560:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991758080 00000100:00100000:1.0:1746127006.988569:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991758080 00000100:00100000:1.0:1746127006.988619:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21824 00000100:00100000:1.0:1746127006.988627:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4426:x1830945991758080:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127006.988646:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127006.988664:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537e3 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.988694:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 39 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.988703:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127006.988706:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127006.988708:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 16 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.988734:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 39 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.988742:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 39 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127006.988751:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994292480:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127006.988843:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127006.990506:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127006.990594:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994292480:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127006.990622:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 16 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127006.990637:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642800, rc 0) 00000100:00100000:3.0:1746127006.990662:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991758208 00000100:00100000:3.0:1746127006.990667:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991758208 00000100:00100000:1.0:1746127006.990668:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4426:x1830945991758080:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2043us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127006.990675:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21824 00002000:00100000:3.0:1746127006.990704:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2121727) req@ffff88012d3ff800 x1830945991758208/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/0 e 0 to 0 dl 1746127017 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.990712:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff800 with x1830945991758208 ext(2097152->2121727) 00010000:00010000:3.0:1746127006.990718:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 40 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127006.990729:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 40 pid: 11152 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127006.990736:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3ff800 00000100:00100000:3.0:1746127006.990764:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1940 00000100:00100000:3.0:1746127006.990770:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991758208:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127006.994482:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991758208:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3702us (3969us total) trans 17179875619 rc 0/0 00000100:00100000:3.0:1746127006.994495:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1940 00002000:00100000:3.0:1746127006.994506:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2121727) req@ffff88012d3ff800 x1830945991758208/t17179875619(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:12/0 lens 488/448 e 0 to 0 dl 1746127017 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127006.994516:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff800 with x1830945991758208 ext(2097152->2121727) 00010000:00010000:3.0:1746127006.994526:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 42 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127006.994541:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 42 pid: 11152 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127006.994548:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3ff800 00000100:00100000:0.0:1746127006.996002:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127006.996061:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991758336 00000100:00100000:3.0:1746127006.996069:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991758336 00010000:00010000:3.0:1746127006.996096:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 42 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127006.996154:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10253 00000100:00100000:3.0:1746127006.996163:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991758336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127006.996176:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127006.996193:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 42 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127006.996203:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 42 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127006.996229:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213fe00/0x34dc807b6efa6d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c7 expref: 42 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127006.996255:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.996257:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127006.996264:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.996276:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127006.996337:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127006.996350:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994292608:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127006.996450:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127006.997973:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994292608:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127006.998014:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127006.998057:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991758336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1895us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127006.998066:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10253 00000100:00100000:0.0:1746127007.003051:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.003102:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.003228:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991758848 00000100:00100000:1.0:1746127007.003228:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991758592 00000100:00100000:3.0:1746127007.003238:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991758848 00000100:00100000:1.0:1746127007.003238:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991758592 00000100:00080000:0.0:1746127007.003381:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746127007.003384:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1746127007.003392:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012d3fe300 x1830945991758848/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.003402:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe300 with x1830945991758848 ext(3145728->4194303) 00002000:00010000:3.0:1746127007.003407:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fe300 00002000:00100000:1.0:1746127007.003421:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012d3fd880 x1830945991758592/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746127007.003428:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8742 00002000:00100000:1.0:1746127007.003433:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fd880 with x1830945991758592 ext(2097152->4194303) 00000100:00100000:3.0:1746127007.003436:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991758848:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:1.0:1746127007.003436:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fd880 00000100:00100000:1.0:1746127007.003458:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8743 00000100:00100000:1.0:1746127007.003464:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991758592:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.015645:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991758848:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12190us (12523us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127007.015663:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8742 00002000:00100000:3.0:1746127007.015675:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012d3fe300 x1830945991758848/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.015685:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe300 with x1830945991758848 ext(3145728->4194303) 00002000:00010000:3.0:1746127007.015695:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fe300 00000100:00100000:2.0:1746127007.023386:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991758592:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19908us (20329us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127007.023398:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8743 00002000:00100000:2.0:1746127007.023409:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012d3fd880 x1830945991758592/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.023418:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fd880 with x1830945991758592 ext(2097152->4194303) 00002000:00010000:2.0:1746127007.023424:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fd880 00000100:00100000:0.0:1746127007.030279:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.030383:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991759104 00000100:00100000:2.0:1746127007.030393:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991759104 00002000:00100000:2.0:1746127007.030443:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012d3fed80 x1830945991759104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.030453:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fed80 with x1830945991759104 ext(4194304->4829183) 00002000:00010000:2.0:1746127007.030459:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fed80 00000100:00100000:2.0:1746127007.030547:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8744 00000100:00100000:2.0:1746127007.030556:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991759104:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127007.034590:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991759104:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4021us (4307us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127007.034604:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8744 00002000:00100000:2.0:1746127007.034615:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012d3fed80 x1830945991759104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.034624:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fed80 with x1830945991759104 ext(4194304->4829183) 00002000:00010000:2.0:1746127007.034630:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fed80 00000100:00100000:0.0:1746127007.054846:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.054918:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991759360 00000100:00100000:3.0:1746127007.054926:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991759360 00000100:00100000:3.0:1746127007.055014:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17321 00000100:00100000:3.0:1746127007.055022:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4434:x1830945991759360:12345-192.168.203.42@tcp:101:multiop.0 00000100:00080000:0.0:1746127007.055076:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746127007.055078:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.055097:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa6fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537ea expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.055250:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.055264:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.055272:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.055302:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.055318:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 18 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.055336:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994292736:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.055428:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127007.056587:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994292736:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.056628:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127007.057006:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.057086:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991759488 00000100:00100000:3.0:1746127007.057091:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991759488 00010000:00010000:3.0:1746127007.057122:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 19 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.057181:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10254 00000100:00100000:3.0:1746127007.057187:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2026:x1830945991759488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.057197:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.057202:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 19 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.057211:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 19 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.057230:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa6c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537c0 expref: 19 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.057260:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.057264:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.057276:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.057282:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.057298:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.057331:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991759488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 144us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.057337:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10254 00010000:00010000:3.0:1746127007.057356:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.057361:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127007.057375:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00080000:0.0:1746127007.057521:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746127007.057834:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa6fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.057846:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 35 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.057852:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.057854:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127007.057857:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fe00, rc 0) 00000100:00100000:3.0:1746127007.057937:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:4434:x1830945991759360:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2915us (3102us total) trans 8589938278 rc 0/0 00000100:00100000:3.0:1746127007.057944:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17321 00000100:00100000:0.0:1746127007.084070:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.084141:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991759744 00000100:00100000:3.0:1746127007.084151:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991759744 00000100:00100000:3.0:1746127007.084227:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17322 00000100:00100000:3.0:1746127007.084234:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+60:4436:x1830945991759744:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127007.084258:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746127007.084272:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746127007.084278:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa70f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537f1 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.084388:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.084402:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.084412:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127007.084422:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127007.084521:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f600/0x34dc807b6efa70f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 63 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.084548:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 62 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.084556:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.084558:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127007.084561:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5206800, rc 0) 00000100:00100000:3.0:1746127007.084609:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+62:4436:x1830945991759744:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 375us (550us total) trans 8589938279 rc 0/0 00000100:00100000:3.0:1746127007.084615:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17322 00000100:00100000:0.0:1746127007.111268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.111372:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991759872 00000100:00100000:1.0:1746127007.111383:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991759872 00000100:00100000:1.0:1746127007.111448:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21825 00000100:00100000:1.0:1746127007.111457:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4436:x1830945991759872:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127007.111475:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.111495:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537f8 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.111525:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.111534:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.111541:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 31 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.111547:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.111549:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.111553:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1433600->1826815] (req 1433600->1826815) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.111591:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 31 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.111601:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 31 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.111614:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994292864:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.111719:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.111727:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 9 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.111734:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994292992:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.111758:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.111766:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 15 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.111773:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994293120:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.111791:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127007.116721:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994292864:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.116740:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994292992:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.117518:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.117585:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.117688:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991760000 00000100:00100000:1.0:1746127007.117695:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991760000 00000100:00100000:3.0:1746127007.117706:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991760128 00000100:00100000:3.0:1746127007.117710:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991760128 00010000:00010000:3.0:1746127007.117738:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 32 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.117738:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.117776:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10255 00000100:00100000:1.0:1746127007.117783:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991760000:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127007.117790:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10256 00000100:00100000:3.0:1746127007.117796:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991760128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.117796:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.117805:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.117816:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.117817:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 32 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.117827:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 32 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.117896:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.117916:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664d200/0x34dc807b6efa61a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53749 expref: 32 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.117932:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be47600/0x34dc807b6efa683 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5379d expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.117942:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.117986:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991760128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 189us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.117992:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10256 00010000:00010000:1.0:1746127007.117995:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.118012:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991760000:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 230us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.118018:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10255 00000100:00100000:1.0:1746127007.120116:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994293120:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.120186:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1433600->1826815] (req 1433600->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.120206:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011ea87a00, rc 0) 00000100:00100000:1.0:1746127007.120243:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4436:x1830945991759872:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8788us (8985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.120250:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21825 00000100:00100000:0.0:1746127007.122236:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.122351:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991760256 00000100:00100000:1.0:1746127007.122359:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991760256 00010000:00010000:1.0:1746127007.122392:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 16 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.122727:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10257 00000100:00100000:1.0:1746127007.122735:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991760256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.122748:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.122767:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 16 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.122778:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 16 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.122800:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664c400/0x34dc807b6efa5d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5371f expref: 16 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.123015:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.123018:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.123040:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.123053:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.123086:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.123099:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994293248:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127007.123213:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127007.125005:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994293248:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127007.125035:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127007.125103:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.125275:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991760512 00000100:00100000:3.0:1746127007.125282:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991760512 00000100:00100000:1.0:1746127007.125317:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991760256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2582us (3087us total) trans 0 rc 0/0 00002000:00100000:3.0:1746127007.125326:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1433600->1437695) req@ffff880094a62300 x1830945991760512/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746127007.125327:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10257 00002000:00100000:3.0:1746127007.125336:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a62300 with x1830945991760512 ext(1433600->1437695) 00002000:00010000:3.0:1746127007.125340:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a62300 00000100:00100000:3.0:1746127007.125358:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8745 00000100:00100000:3.0:1746127007.125630:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991760512:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127007.125860:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991760512:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 223us (748us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127007.125870:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8745 00002000:00100000:3.0:1746127007.125880:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1433600->1437695) req@ffff880094a62300 x1830945991760512/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.125887:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a62300 with x1830945991760512 ext(1433600->1437695) 00002000:00010000:3.0:1746127007.125892:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a62300 00000100:00100000:0.0:1746127007.130724:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.130828:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991760768 00000100:00100000:3.0:1746127007.130836:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991760768 00002000:00100000:3.0:1746127007.130880:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1822720->1826815) req@ffff880094a61f80 x1830945991760768/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.130891:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61f80 with x1830945991760768 ext(1822720->1826815) 00002000:00010000:3.0:1746127007.130896:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a61f80 00000100:00100000:3.0:1746127007.130914:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8746 00000100:00100000:3.0:1746127007.130920:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991760768:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127007.131073:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991760768:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 152us (357us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127007.131079:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8746 00002000:00100000:3.0:1746127007.131084:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1822720->1826815) req@ffff880094a61f80 x1830945991760768/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.131091:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61f80 with x1830945991760768 ext(1822720->1826815) 00002000:00010000:3.0:1746127007.131094:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a61f80 00000100:00100000:0.0:1746127007.160011:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.160091:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.160161:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991760896 00000100:00100000:3.0:1746127007.160170:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991760896 00000100:00100000:3.0:1746127007.160212:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991761024 00000100:00100000:3.0:1746127007.160214:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991761024 00000100:00100000:3.0:1746127007.160244:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21826 00000100:00100000:3.0:1746127007.160251:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991760896:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.160269:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.160287:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e537ff expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.160310:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.160312:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.160320:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 31 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127007.160333:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21827 00010000:00010000:3.0:1746127007.160334:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 31 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127007.160342:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991761024:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.160345:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f47c00, rc 0) 00010000:00010000:2.0:1746127007.160352:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.160363:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53806 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.160375:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.160377:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.160383:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 42 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.160393:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 42 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.160400:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88000, rc 0) 00000100:00100000:2.0:1746127007.160683:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991761024:12345-192.168.203.42@tcp:101:cat.0 Request processed in 340us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.160689:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21827 00000100:00100000:3.0:1746127007.160695:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991760896:12345-192.168.203.42@tcp:101:cat.0 Request processed in 443us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.160701:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21826 00000100:00100000:1.0:1746127007.160801:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.160897:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991761152 00000100:00100000:3.0:1746127007.160900:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991761152 00000100:00100000:3.0:1746127007.160923:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21828 00000100:00100000:3.0:1746127007.160928:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991761152:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.160935:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.160945:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800809d7800/0x34dc807b6efa739 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5380d expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.160983:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293376:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127007.161057:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00002000:00010000:3.0:1746127007.168341:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127003 -> 1746127005 00000100:00100000:3.0:1746127007.168373:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293376:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127007.168430:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800809d7800/0x34dc807b6efa739 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5380d expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.168444:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800809d7800/0x34dc807b6efa739 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5380d expref: 16 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.168471:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800809d7800, rc 0) 00000100:00100000:3.0:1746127007.168531:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991761152:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7600us (7730us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127007.168544:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21828 00000100:00100000:0.0:1746127007.171223:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.171324:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991761408 00000100:00100000:2.0:1746127007.171334:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991761408 00002000:00100000:2.0:1746127007.171382:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094a60a80 x1830945991761408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 504/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.171391:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a60a80 with x1830945991761408 ext(1048576->2097151) 00002000:00010000:2.0:1746127007.171396:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a60a80 00000100:00100000:2.0:1746127007.172098:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8747 00000100:00100000:2.0:1746127007.172108:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991761408:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127007.180325:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.180402:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991761536 00000100:00100000:3.0:1746127007.180411:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991761536 00000100:00100000:3.0:1746127007.180469:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21829 00000100:00100000:3.0:1746127007.180477:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4443:x1830945991761536:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.180499:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.180523:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53814 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.180552:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.180564:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.180566:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.180569:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.180604:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.180616:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 32 pid: 1964 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.180628:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293504:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.181085:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.182305:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.182369:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991761664 00000100:00100000:2.0:1746127007.182376:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991761664 00002000:00100000:2.0:1746127007.182418:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1433600->1826815) req@ffff880094a63b80 x1830945991761664/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.182428:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a63b80 with x1830945991761664 ext(1433600->1826815) 00000100:00100000:3.0:1746127007.182435:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293504:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.182436:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 33 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.182449:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 33 pid: 1964 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.182455:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a63b80 00000100:00100000:2.0:1746127007.182474:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1941 00010000:00010000:3.0:1746127007.182478:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127007.182480:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991761664:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:3.0:1746127007.182490:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009da60a00, rc 0) 00000100:00100000:3.0:1746127007.182522:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4443:x1830945991761536:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2046us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.182633:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21829 00000100:00100000:2.0:1746127007.185955:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991761408:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13834us (14723us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746127007.185968:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8747 00002000:00100000:2.0:1746127007.185979:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094a60a80 x1830945991761408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 504/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.185989:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a60a80 with x1830945991761408 ext(1048576->2097151) 00010000:00010000:2.0:1746127007.185999:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 33 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.186014:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 33 pid: 1964 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.186021:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a60a80 00000100:00100000:2.0:1746127007.196051:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991761664:12345-192.168.203.42@tcp:4:cat.0 Request processed in 13546us (13725us total) trans 21474842887 rc 0/0 00000100:00100000:2.0:1746127007.196066:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1941 00002000:00100000:2.0:1746127007.196078:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1433600->1826815) req@ffff880094a63b80 x1830945991761664/t21474842887(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/448 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.196088:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a63b80 with x1830945991761664 ext(1433600->1826815) 00010000:00010000:2.0:1746127007.196099:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 33 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.196118:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 33 pid: 1964 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.196124:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a63b80 00000100:00100000:0.0:1746127007.203436:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.203581:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991761920 00000100:00100000:2.0:1746127007.203590:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991761920 00002000:00100000:2.0:1746127007.211013:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009942ed80 x1830945991761920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.211039:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ed80 with x1830945991761920 ext(2097152->4194303) 00000100:00100000:1.0:1746127007.211040:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:2.0:1746127007.211045:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942ed80 00000100:00100000:2.0:1746127007.211098:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991762176 00000100:00100000:2.0:1746127007.211105:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991762176 00000100:00100000:3.0:1746127007.211107:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8748 00000100:00100000:3.0:1746127007.211119:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991761920:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:2.0:1746127007.211145:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122384380 x1830945991762176/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.211151:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384380 with x1830945991762176 ext(2097152->4194303) 00002000:00010000:2.0:1746127007.211154:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122384380 00000100:00100000:2.0:1746127007.211164:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8749 00000100:00100000:2.0:1746127007.211168:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991762176:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127007.211504:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.211523:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991762304 00000100:00100000:1.0:1746127007.211526:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991762304 00010000:00010000:1.0:1746127007.211548:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 34 pid: 1964 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.211578:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10258 00000100:00100000:1.0:1746127007.211583:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991762304:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.211593:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.211608:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 34 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.211620:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 34 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.211641:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011ea87a00/0x34dc807b6efa724 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1826815) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f8 expref: 34 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.211665:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.211668:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.211675:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.211682:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.211715:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.211727:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994293632:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127007.211796:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.221999:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.222770:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994293632:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127007.222793:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127007.222829:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991762304:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 11246us (11325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.222839:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10258 00000100:00100000:2.0:1746127007.224522:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991762560 00000100:00100000:2.0:1746127007.224534:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991762560 00002000:00100000:2.0:1746127007.224575:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009942d500 x1830945991762560/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.224585:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d500 with x1830945991762560 ext(1048576->2097151) 00002000:00010000:2.0:1746127007.224591:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942d500 00000100:00100000:2.0:1746127007.224611:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8750 00000100:00100000:2.0:1746127007.224617:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991762560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.242168:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.242417:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991762176:12345-192.168.203.42@tcp:3:cat.0 Request processed in 31245us (31376us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127007.242428:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8749 00002000:00100000:2.0:1746127007.242439:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122384380 x1830945991762176/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.242454:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384380 with x1830945991762176 ext(2097152->4194303) 00002000:00010000:2.0:1746127007.242459:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122384380 00000100:00100000:0.0:1746127007.243203:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991762688 00000100:00100000:0.0:1746127007.243211:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991762688 00000100:00100000:0.0:1746127007.243257:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21830 00000100:00100000:0.0:1746127007.243264:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4434:x1830945991762688:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127007.243280:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127007.243297:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5381b expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.243328:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 19 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.243337:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 33 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.243343:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.243344:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.243347:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.243374:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 33 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.243384:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.243394:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293760:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.243472:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 19 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.243480:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 19 pid: 9612 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.243488:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293888:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.243503:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127007.251436:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293760:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.251449:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994293888:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.251481:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.251504:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3e00, rc 0) 00000100:00100000:1.0:1746127007.251560:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4434:x1830945991762688:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8295us (9402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.251568:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21830 00000100:00100000:3.0:1746127007.252227:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991761920:12345-192.168.203.42@tcp:3:cat.0 Request processed in 41110us (48800us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127007.252237:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8748 00002000:00100000:3.0:1746127007.252245:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009942ed80 x1830945991761920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.252254:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ed80 with x1830945991761920 ext(2097152->4194303) 00010000:00010000:3.0:1746127007.252262:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 32 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.252274:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 32 pid: 11152 timeout: 1002 lvb_type: 1 00002000:00010000:3.0:1746127007.252280:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942ed80 00000100:00100000:1.0:1746127007.254244:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.254506:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991762816 00000100:00100000:0.0:1746127007.254515:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991762816 00010000:00010000:0.0:1746127007.254547:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 19 pid: 9612 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.255439:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10259 00000100:00100000:0.0:1746127007.255448:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991762816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.255463:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127007.255484:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 19 pid: 9612 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.255496:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 19 pid: 9612 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.255519:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88200/0x34dc807b6efa6d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ce expref: 19 pid: 9612 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.255538:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127007.255584:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991762816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 137us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.255593:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10259 00000100:00100000:0.0:1746127007.258164:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991762560:12345-192.168.203.42@tcp:3:cat.0 Request processed in 33536us (36165us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127007.258178:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8750 00002000:00100000:0.0:1746127007.258190:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009942d500 x1830945991762560/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.258199:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d500 with x1830945991762560 ext(1048576->2097151) 00002000:00010000:0.0:1746127007.258205:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942d500 00000100:00100000:0.0:1746127007.262571:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.262759:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991762944 00000100:00100000:1.0:1746127007.262768:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991762944 00000100:00100000:1.0:1746127007.262822:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21831 00000100:00100000:1.0:1746127007.262829:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4442:x1830945991762944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127007.262848:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.262866:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53822 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.262897:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.262899:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.262907:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 33 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.262921:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 33 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.262932:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe800, rc 0) 00000100:00100000:1.0:1746127007.262980:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4442:x1830945991762944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.262986:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21831 00000100:00100000:2.0:1746127007.270547:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.270643:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991763072 00000100:00100000:3.0:1746127007.270653:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991763072 00010000:00010000:3.0:1746127007.270689:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746127007.270718:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10260 00000100:00100000:3.0:1746127007.270725:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991763072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.270738:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.270758:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.270771:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.270801:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f47c00/0x34dc807b6efa72b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ff expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.270831:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.270833:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.270840:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.270849:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.270883:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 15 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.270896:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994294016:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127007.270975:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.273530:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.273562:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.273630:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.273664:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991763328 00000100:00100000:3.0:1746127007.273670:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994294016:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127007.273670:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991763328 00010000:00010000:3.0:1746127007.273709:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746127007.273711:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880094e6d880 x1830945991763328/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.273721:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d880 with x1830945991763328 ext(3145728->4194303) 00002000:00010000:2.0:1746127007.273725:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6d880 00000100:00100000:2.0:1746127007.273739:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991763712 00000100:00100000:2.0:1746127007.273741:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991763712 00000100:00100000:3.0:1746127007.273748:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991763072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3023us (3212us total) trans 0 rc 0/0 00002000:00100000:2.0:1746127007.273749:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2412544->2416639) req@ffff880094e6c380 x1830945991763712/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.273755:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6c380 with x1830945991763712 ext(2412544->2416639) 00000100:00100000:3.0:1746127007.273756:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10260 00002000:00010000:2.0:1746127007.273758:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6c380 00000100:00100000:2.0:1746127007.273767:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8751 00000100:00100000:2.0:1746127007.273771:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991763328:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.273842:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8752 00000100:00100000:3.0:1746127007.273848:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991763712:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.274086:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991763712:12345-192.168.203.42@tcp:3:cat.0 Request processed in 237us (455us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127007.274092:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8752 00002000:00100000:3.0:1746127007.274097:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2412544->2416639) req@ffff880094e6c380 x1830945991763712/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.274104:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6c380 with x1830945991763712 ext(2412544->2416639) 00002000:00010000:3.0:1746127007.274107:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6c380 00000100:00100000:1.0:1746127007.274581:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991763456 00000100:00100000:1.0:1746127007.274586:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991763456 00000100:00100000:1.0:1746127007.274612:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21832 00000100:00100000:1.0:1746127007.274617:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4443:x1830945991763456:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127007.274639:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.274655:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53829 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.274679:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.274686:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127007.274688:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127007.274692:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.274720:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.274731:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 17 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.274742:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994294144:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.274790:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.284682:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.285341:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991763840 00000100:00100000:2.0:1746127007.285350:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991763840 00000100:00100000:2.0:1746127007.285408:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21833 00000100:00100000:2.0:1746127007.285417:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4434:x1830945991763840:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127007.285440:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.285458:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53830 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.285489:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.285497:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 41 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.285503:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.285505:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.285508:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2375679] (req 2097152->2375679) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 17 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.285541:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 41 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.285552:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 41 pid: 1507 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.285564:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994294272:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.285667:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 17 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.285675:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 17 pid: 1964 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.285688:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994294400:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.285709:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.286093:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.286200:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994294144:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.286225:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.286243:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebf800, rc 0) 00000100:00100000:1.0:1746127007.286284:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4443:x1830945991763456:12345-192.168.203.42@tcp:101:cat.0 Request processed in 11666us (12720us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.286290:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21832 00000100:00100000:0.0:1746127007.286536:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991763328:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12763us (13012us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127007.286543:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8751 00002000:00100000:0.0:1746127007.286552:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880094e6d880 x1830945991763328/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.286560:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d880 with x1830945991763328 ext(3145728->4194303) 00002000:00010000:0.0:1746127007.286565:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6d880 00000100:00100000:0.0:1746127007.286580:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991763968 00000100:00100000:0.0:1746127007.286584:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991763968 00002000:00100000:0.0:1746127007.286609:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2412544->3145727) req@ffff88012d3ff100 x1830945991763968/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.286615:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff100 with x1830945991763968 ext(2412544->3145727) 00010000:00010000:0.0:1746127007.286620:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 17 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.286630:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 17 pid: 11152 timeout: 1002 lvb_type: 0 00002000:00010000:0.0:1746127007.286635:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d3ff100 00000100:00100000:0.0:1746127007.286649:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1942 00000100:00100000:0.0:1746127007.286654:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991763968:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127007.290000:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994294272:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.290824:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.290860:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.290970:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991764096 00000100:00100000:1.0:1746127007.290976:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991764096 00010000:00010000:1.0:1746127007.291012:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 42 pid: 1507 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.291187:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994294400:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.291218:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2375679] (req 2097152->2375679) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 17 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.291233:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88c00, rc 0) 00000100:00100000:2.0:1746127007.291280:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4434:x1830945991763840:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5864us (7153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.291288:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21833 00000100:00100000:1.0:1746127007.291459:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991764224 00000100:00100000:1.0:1746127007.291463:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991764224 00010000:00010000:1.0:1746127007.291478:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 17 pid: 1964 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.291507:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10261 00000100:00100000:1.0:1746127007.291515:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991764096:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.291540:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.291560:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 42 pid: 1507 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.291571:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 42 pid: 1507 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.291594:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efa732 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53806 expref: 42 pid: 1507 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746127007.291636:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10262 00000100:00100000:3.0:1746127007.291644:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991764224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.291652:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.291661:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 17 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.291670:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 17 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.291682:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096642800/0x34dc807b6efa6f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537e3 expref: 17 pid: 1964 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.291702:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.291703:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.291710:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.291718:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.291751:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.291762:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994294528:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127007.291809:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2600 going to sleep for 11 seconds 00010000:00010000:1.0:1746127007.291880:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.291903:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991764096:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 389us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.291909:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10261 00000100:00100000:0.0:1746127007.293114:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.293278:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991764352 00000100:00100000:2.0:1746127007.293285:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991764352 00000100:00100000:2.0:1746127007.293340:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21834 00000100:00100000:2.0:1746127007.293348:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4442:x1830945991764352:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.293365:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.293380:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53837 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.293405:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.293412:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127007.293414:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127007.293418:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.293444:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.293454:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.293466:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994294656:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.293980:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.295038:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994294656:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.295063:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.295079:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a89400, rc 0) 00000100:00100000:2.0:1746127007.295117:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4442:x1830945991764352:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1769us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.295124:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21834 00000100:00100000:2.0:1746127007.295189:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994294528:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127007.295217:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.295237:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991764224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3595us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.295247:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10262 00000100:00100000:0.0:1746127007.295266:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.295327:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991764608 00000100:00100000:3.0:1746127007.295333:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991764608 00002000:00100000:3.0:1746127007.295363:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2371584->2375679) req@ffff880094a63100 x1830945991764608/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.295372:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a63100 with x1830945991764608 ext(2371584->2375679) 00010000:00010000:3.0:1746127007.295378:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.295387:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127007.295395:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a63100 00000100:00100000:3.0:1746127007.295424:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1943 00000100:00100000:3.0:1746127007.295431:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991764608:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.296224:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991764608:12345-192.168.203.42@tcp:3:cat.0 Request processed in 790us (954us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127007.296230:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1943 00002000:00100000:3.0:1746127007.296236:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2371584->2375679) req@ffff880094a63100 x1830945991764608/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.296249:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a63100 with x1830945991764608 ext(2371584->2375679) 00010000:00010000:3.0:1746127007.296254:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.296264:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127007.296269:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a63100 00000100:00100000:2.0:1746127007.298711:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991763968:12345-192.168.203.42@tcp:4:cat.0 Request processed in 12046us (12608us total) trans 21474842888 rc 0/0 00000100:00100000:2.0:1746127007.298727:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1942 00002000:00100000:2.0:1746127007.298739:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2412544->3145727) req@ffff88012d3ff100 x1830945991763968/t21474842888(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/448 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.298748:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff100 with x1830945991763968 ext(2412544->3145727) 00010000:00010000:2.0:1746127007.298757:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.298770:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.298776:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d3ff100 00000100:00100000:0.0:1746127007.298794:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.298923:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991764864 00000100:00100000:2.0:1746127007.298931:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991764864 00002000:00100000:2.0:1746127007.298961:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2375679) req@ffff880094f16a00 x1830945991764864/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.298968:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f16a00 with x1830945991764864 ext(2097152->2375679) 00010000:00010000:2.0:1746127007.298973:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.298981:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.298987:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f16a00 00000100:00100000:2.0:1746127007.299011:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1944 00000100:00100000:2.0:1746127007.299018:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991764864:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127007.302641:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.302854:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991764992 00000100:00100000:3.0:1746127007.302863:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991764992 00010000:00010000:3.0:1746127007.302899:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.302929:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10263 00000100:00100000:3.0:1746127007.302937:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991764992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.302950:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.302969:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.303067:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.303091:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3e00/0x34dc807b6efa747 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2412544->3145727] (req 2412544->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5381b expref: 19 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.303109:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.303111:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.303118:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.303125:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.303181:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.303193:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994294784:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127007.303199:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991764864:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4181us (4405us total) trans 17179875620 rc 0/0 00000100:00100000:2.0:1746127007.303207:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1944 00002000:00100000:2.0:1746127007.303216:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2375679) req@ffff880094f16a00 x1830945991764864/t17179875620(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/448 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.303224:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f16a00 with x1830945991764864 ext(2097152->2375679) 00010000:00010000:2.0:1746127007.303231:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.303242:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.303247:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f16a00 00000100:00100000:3.0:1746127007.303252:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.304880:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.304956:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994294784:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127007.304996:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.305057:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991765120 00000100:00100000:2.0:1746127007.305065:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991765120 00010000:00010000:2.0:1746127007.305098:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.305186:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10264 00000100:00100000:2.0:1746127007.305197:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991765120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.305213:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.305235:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.305248:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.305274:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88c00/0x34dc807b6efa75c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2375679) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53830 expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.305306:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.305309:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.305318:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.305327:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.305362:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127007.305375:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994294912:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127007.305459:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127007.306070:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991764992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3132us (3437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.306078:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10263 00000100:00100000:0.0:1746127007.307432:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.307493:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991765376 00000100:00100000:2.0:1746127007.307501:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991765376 00002000:00100000:2.0:1746127007.307542:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009ab0e300 x1830945991765376/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.307551:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0e300 with x1830945991765376 ext(2097152->3145727) 00002000:00010000:2.0:1746127007.307556:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0e300 00000100:00100000:3.0:1746127007.308755:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994294912:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127007.308778:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.308792:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8753 00000100:00100000:2.0:1746127007.308802:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991765376:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.308822:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991765120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3629us (3951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.308830:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10264 00000100:00100000:0.0:1746127007.312756:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.314277:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991765632 00000100:00100000:3.0:1746127007.314292:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991765632 00002000:00100000:3.0:1746127007.314343:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009ab0c380 x1830945991765632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.314359:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0c380 with x1830945991765632 ext(3145728->4194303) 00002000:00010000:3.0:1746127007.314366:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0c380 00000100:00100000:3.0:1746127007.314394:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8754 00000100:00100000:3.0:1746127007.314401:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991765632:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127007.315910:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991765376:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7097us (8473us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127007.315925:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8753 00002000:00100000:2.0:1746127007.315939:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009ab0e300 x1830945991765376/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.315950:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0e300 with x1830945991765376 ext(2097152->3145727) 00002000:00010000:2.0:1746127007.315956:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0e300 00000100:00100000:3.0:1746127007.324569:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991765632:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10157us (11813us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127007.324583:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8754 00002000:00100000:3.0:1746127007.324596:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88009ab0c380 x1830945991765632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.324605:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0c380 with x1830945991765632 ext(3145728->4194303) 00002000:00010000:3.0:1746127007.324611:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0c380 00000100:00100000:0.0:1746127007.328732:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.328821:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991765760 00000100:00100000:2.0:1746127007.328832:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991765760 00000100:00100000:2.0:1746127007.330333:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21835 00000100:00100000:2.0:1746127007.330343:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4443:x1830945991765760:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.330364:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.330383:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5383e expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.330410:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.330412:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.330420:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 18 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.330434:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 18 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.330445:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88400, rc 0) 00000100:00100000:2.0:1746127007.330508:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4443:x1830945991765760:12345-192.168.203.42@tcp:101:cat.0 Request processed in 167us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.330516:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21835 00000100:00100000:1.0:1746127007.333196:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.333244:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991765888 00000100:00100000:1.0:1746127007.333248:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.333254:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991765888 00000100:00100000:2.0:1746127007.333299:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991766016 00000100:00100000:2.0:1746127007.333302:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991766016 00000100:00100000:2.0:1746127007.333318:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21836 00000100:00100000:2.0:1746127007.333324:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991765888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.333343:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.333364:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53845 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127007.333381:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21837 00010000:00010000:2.0:1746127007.333388:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.333390:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127007.333390:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991766016:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.333400:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.333400:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.333415:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.333415:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5384c expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.333426:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88c00, rc 0) 00010000:00010000:0.0:1746127007.333431:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.333433:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.333442:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 35 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.333457:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 35 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.333467:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e982c00, rc 0) 00000100:00100000:2.0:1746127007.333474:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991765888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 149us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.333479:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21836 00000100:00100000:0.0:1746127007.333497:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991766016:12345-192.168.203.42@tcp:101:cat.0 Request processed in 106us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.333503:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21837 00000100:00100000:0.0:1746127007.339807:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.339854:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.340047:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991766528 00000100:00100000:3.0:1746127007.340057:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991766528 00000100:00100000:0.0:1746127007.340071:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127007.340105:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88011dc61500 x1830945991766528/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.340115:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc61500 with x1830945991766528 ext(4194304->4829183) 00002000:00010000:3.0:1746127007.340121:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc61500 00000100:00100000:3.0:1746127007.340171:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991766656 00000100:00100000:3.0:1746127007.340174:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991766656 00002000:00100000:3.0:1746127007.340186:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88011dc63800 x1830945991766656/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.340194:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63800 with x1830945991766656 ext(2097152->4194303) 00002000:00010000:3.0:1746127007.340197:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc63800 00000100:00100000:3.0:1746127007.340203:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991766784 00000100:00100000:3.0:1746127007.340204:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991766784 00002000:00100000:3.0:1746127007.340213:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88011dc63b80 x1830945991766784/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.340220:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63b80 with x1830945991766784 ext(3145728->4194303) 00002000:00010000:3.0:1746127007.340227:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63b80 00000100:00100000:3.0:1746127007.340238:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8755 00000100:00100000:3.0:1746127007.340244:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991766528:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127007.340270:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8756 00000100:00100000:1.0:1746127007.340280:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991766656:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127007.340745:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8757 00000100:00100000:0.0:1746127007.340753:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991766784:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.346279:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991766528:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6023us (6471us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127007.346292:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8755 00002000:00100000:3.0:1746127007.346304:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88011dc61500 x1830945991766528/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.346313:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc61500 with x1830945991766528 ext(4194304->4829183) 00002000:00010000:3.0:1746127007.346319:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc61500 00000100:00100000:2.0:1746127007.351510:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991766784:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10747us (11427us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127007.351522:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8757 00002000:00100000:2.0:1746127007.351534:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88011dc63b80 x1830945991766784/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.351544:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63b80 with x1830945991766784 ext(3145728->4194303) 00002000:00010000:2.0:1746127007.351552:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63b80 00000100:00100000:1.0:1746127007.367309:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991766656:12345-192.168.203.42@tcp:3:cat.0 Request processed in 27024us (27446us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127007.367321:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8756 00002000:00100000:1.0:1746127007.367331:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88011dc63800 x1830945991766656/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.367340:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63800 with x1830945991766656 ext(2097152->4194303) 00002000:00010000:1.0:1746127007.367346:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc63800 00000100:00100000:0.0:1746127007.374857:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.374915:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991767040 00000100:00100000:1.0:1746127007.374922:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991767040 00002000:00100000:1.0:1746127007.374960:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88011dc60a80 x1830945991767040/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.374969:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60a80 with x1830945991767040 ext(4194304->4829183) 00002000:00010000:1.0:1746127007.374974:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60a80 00000100:00100000:1.0:1746127007.375007:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8758 00000100:00100000:1.0:1746127007.375387:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991767040:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127007.382660:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991767040:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7639us (7803us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127007.382670:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8758 00002000:00100000:1.0:1746127007.382679:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88011dc60a80 x1830945991767040/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.382688:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60a80 with x1830945991767040 ext(4194304->4829183) 00002000:00010000:1.0:1746127007.382693:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60a80 00000100:00100000:0.0:1746127007.396938:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.397059:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991767168 00000100:00100000:3.0:1746127007.397069:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991767168 00000100:00100000:3.0:1746127007.397243:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21838 00000100:00100000:3.0:1746127007.397253:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4445:x1830945991767168:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127007.397273:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.397292:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53853 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.397324:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.397335:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 35 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.397342:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.397348:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.397350:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.397354:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3403776->4194303] (req 3403776->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 35 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.397384:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.397394:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 35 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.397405:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994295040:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.397520:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 35 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.397527:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 35 pid: 9612 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746127007.397534:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994295168:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.397560:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.397568:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 17 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.397576:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994295296:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.397592:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127007.399270:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994295040:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.399280:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994295168:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.399287:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994295296:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.399404:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3403776->4194303] (req 3403776->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 35 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.399419:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b000, rc 0) 00000100:00100000:3.0:1746127007.399467:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4445:x1830945991767168:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2216us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.399474:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21838 00000100:00100000:0.0:1746127007.401967:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.402031:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.402689:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991767424 00000100:00100000:2.0:1746127007.402698:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991767424 00010000:00010000:2.0:1746127007.402739:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 35 pid: 9612 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.402781:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991767296 00000100:00100000:2.0:1746127007.402784:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991767296 00010000:00010000:2.0:1746127007.402794:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 36 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.402816:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10265 00000100:00100000:2.0:1746127007.402823:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991767424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.402838:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.402861:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 36 pid: 9612 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.402872:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 36 pid: 9612 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.402894:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e982c00/0x34dc807b6efa778 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5384c expref: 36 pid: 9612 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.402910:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10266 00010000:00010000:2.0:1746127007.402912:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.402920:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991767296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.402929:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.402937:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 35 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.402945:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 35 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.402955:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991767424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 132us (996us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127007.402956:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efa74e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53822 expref: 35 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.402962:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10265 00010000:00010000:1.0:1746127007.402971:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.402989:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991767296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.402994:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10266 00000100:00100000:0.0:1746127007.403320:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.403429:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991767552 00000100:00100000:2.0:1746127007.403433:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991767552 00010000:00010000:2.0:1746127007.403445:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 18 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.404012:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10267 00000100:00100000:2.0:1746127007.404019:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991767552:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.404041:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.404052:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 18 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.404061:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 18 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.404075:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efa755 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53829 expref: 18 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.404084:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.404086:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.404092:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.404100:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.404147:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127007.404164:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994295424:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127007.404493:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.408791:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994295424:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127007.408815:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.408872:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991767552:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4852us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.408884:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10267 00000100:00100000:0.0:1746127007.409002:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.409519:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991767808 00000100:00100000:2.0:1746127007.409526:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991767808 00002000:00100000:2.0:1746127007.409563:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (3403776->3407871) req@ffff88009c5e3b80 x1830945991767808/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.409573:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3b80 with x1830945991767808 ext(3403776->3407871) 00002000:00010000:2.0:1746127007.409578:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e3b80 00000100:00100000:2.0:1746127007.409595:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8759 00000100:00100000:2.0:1746127007.409601:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991767808:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127007.409715:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991767808:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 114us (713us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127007.409721:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8759 00002000:00100000:2.0:1746127007.409730:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (3403776->3407871) req@ffff88009c5e3b80 x1830945991767808/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.409737:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e3b80 with x1830945991767808 ext(3403776->3407871) 00002000:00010000:2.0:1746127007.409740:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e3b80 00000100:00100000:0.0:1746127007.418207:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.418310:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991767936 00000100:00100000:3.0:1746127007.418319:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991767936 00000100:00100000:3.0:1746127007.418366:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21839 00000100:00100000:3.0:1746127007.418372:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4445:x1830945991767936:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127007.418389:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.418404:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5385a expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.418431:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.418437:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 17 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.418440:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.418441:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.418443:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.418467:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 17 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.418475:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 17 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.418483:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994295552:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.418579:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.418586:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 43 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.418593:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994295680:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.418613:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127007.420756:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994295552:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.420766:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994295680:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.420792:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.420808:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918a400, rc 0) 00000100:00100000:3.0:1746127007.420853:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4445:x1830945991767936:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2480us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.420862:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21839 00000100:00100000:0.0:1746127007.421801:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.421857:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991768064 00000100:00100000:2.0:1746127007.421863:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991768064 00010000:00010000:2.0:1746127007.421893:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 43 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.422213:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10268 00000100:00100000:2.0:1746127007.422220:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991768064:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127007.422494:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.422587:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991768192 00000100:00100000:1.0:1746127007.422591:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991768192 00010000:00010000:1.0:1746127007.422607:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.422625:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10269 00000100:00100000:1.0:1746127007.422629:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991768192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.422635:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.422653:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.422664:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.422685:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88400/0x34dc807b6efa76a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5383e expref: 18 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.422701:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.422730:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991768192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.422735:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10269 00010000:00010000:2.0:1746127007.423041:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.423053:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 43 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.423062:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 43 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.423074:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a89400/0x34dc807b6efa763 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53837 expref: 43 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.423491:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.423494:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.423501:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.423509:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.423539:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127007.423555:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994295808:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127007.423620:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.426598:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994295808:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127007.426617:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.426673:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991768064:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4452us (4872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.426683:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10268 00000100:00100000:0.0:1746127007.428008:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.428729:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991768448 00000100:00100000:2.0:1746127007.428737:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991768448 00002000:00100000:2.0:1746127007.428779:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (3223552->3227647) req@ffff88012d288700 x1830945991768448/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.428789:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288700 with x1830945991768448 ext(3223552->3227647) 00002000:00010000:2.0:1746127007.428794:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288700 00000100:00100000:2.0:1746127007.428820:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8760 00000100:00100000:2.0:1746127007.428827:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991768448:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127007.428967:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991768448:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 140us (963us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127007.428973:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8760 00002000:00100000:2.0:1746127007.428977:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (3223552->3227647) req@ffff88012d288700 x1830945991768448/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.428984:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288700 with x1830945991768448 ext(3223552->3227647) 00002000:00010000:2.0:1746127007.428986:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288700 00000100:00100000:0.0:1746127007.446178:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.446402:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991768576 00000100:00100000:3.0:1746127007.446409:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991768576 00000100:00100000:3.0:1746127007.446454:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21840 00000100:00100000:3.0:1746127007.446459:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4450:x1830945991768576:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127007.446475:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.446490:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53861 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.446513:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 18 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.446520:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 8 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.446527:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 41 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.446536:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.446538:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.446541:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1503232->1974271] (req 1503232->1974271) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 18 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.446566:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 41 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.446576:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 41 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746127007.446586:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994295936:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.446664:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 8 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.446672:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 8 pid: 16295 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746127007.446679:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296064:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.448604:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 18 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.448614:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 18 pid: 3148 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746127007.448629:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296192:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.448644:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127007.452943:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994295936:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.452955:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296064:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.452962:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296192:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.453015:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1503232->1974271] (req 1503232->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 18 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.453041:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918ae00, rc 0) 00000100:00100000:0.0:1746127007.453504:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.453528:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.453555:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.453608:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991768704 00000100:00100000:0.0:1746127007.453614:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991768704 00000100:00100000:1.0:1746127007.453644:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991768960 00000100:00100000:1.0:1746127007.453655:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991768960 00010000:00010000:0.0:1746127007.453658:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 9 pid: 16295 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.453688:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991768832 00000100:00100000:0.0:1746127007.453691:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991768832 00010000:00010000:1.0:1746127007.453694:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 19 pid: 3148 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.453701:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 42 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.453721:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10270 00000100:00100000:0.0:1746127007.453728:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991768704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.453739:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127007.453747:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10271 00000100:00100000:2.0:1746127007.453754:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10272 00000100:00100000:1.0:1746127007.453755:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991768832:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.453758:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 9 pid: 16295 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.453762:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991768960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.453766:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.453768:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127007.453768:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 9 pid: 16295 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.453775:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 19 pid: 3148 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.453789:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5207600/0x34dc807b6efa675 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5378f expref: 9 pid: 16295 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.453801:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 42 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.453806:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127007.453812:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 42 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.453829:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c36600/0x34dc807b6efa60c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5373b expref: 42 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.453838:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991768704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 110us (391us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127007.453839:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 19 pid: 3148 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.453844:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10270 00010000:00010000:2.0:1746127007.453854:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009915bc00/0x34dc807b6efa5cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53711 expref: 19 pid: 3148 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.453857:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.453858:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00080000:0.0:1746127007.453862:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746127007.453865:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 18 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.453873:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 18 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.454090:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4450:x1830945991768576:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7629us (7919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.454097:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21840 00010000:00010000:2.0:1746127007.454765:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127007.454848:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 17 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.454858:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994296320:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127007.455447:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991768960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1682us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.455455:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10272 00000100:00100000:1.0:1746127007.455464:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127007.456597:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994296320:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127007.456614:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.456716:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991768832:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2961us (3159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.456726:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10271 00000100:00100000:0.0:1746127007.457211:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.457419:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991769216 00000100:00100000:3.0:1746127007.457609:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991769216 00002000:00100000:3.0:1746127007.457658:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1503232->1507327) req@ffff88012d288e00 x1830945991769216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.457668:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288e00 with x1830945991769216 ext(1503232->1507327) 00002000:00010000:3.0:1746127007.457672:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288e00 00000100:00100000:3.0:1746127007.457702:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8761 00000100:00100000:3.0:1746127007.457709:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991769216:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127007.457852:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991769216:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 143us (643us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127007.457861:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8761 00002000:00100000:3.0:1746127007.458043:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1503232->1507327) req@ffff88012d288e00 x1830945991769216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.458052:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288e00 with x1830945991769216 ext(1503232->1507327) 00002000:00010000:3.0:1746127007.458054:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288e00 00000100:00100000:0.0:1746127007.462715:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.463773:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991769472 00000100:00100000:3.0:1746127007.463783:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991769472 00002000:00100000:3.0:1746127007.463827:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1970176->1974271) req@ffff8800a1789f80 x1830945991769472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.463836:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789f80 with x1830945991769472 ext(1970176->1974271) 00002000:00010000:3.0:1746127007.463842:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a1789f80 00000100:00100000:3.0:1746127007.463861:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8762 00000100:00100000:3.0:1746127007.463866:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991769472:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127007.464036:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991769472:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 168us (1329us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127007.464042:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8762 00002000:00100000:3.0:1746127007.464047:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1970176->1974271) req@ffff8800a1789f80 x1830945991769472/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.464053:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789f80 with x1830945991769472 ext(1970176->1974271) 00002000:00010000:3.0:1746127007.464056:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a1789f80 00000100:00100000:0.0:1746127007.478296:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.479278:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991769600 00000100:00100000:3.0:1746127007.479288:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991769600 00000100:00100000:3.0:1746127007.479341:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21841 00000100:00100000:3.0:1746127007.479349:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991769600:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.479369:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.479386:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6efa794 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53868 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.479436:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296448:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127007.479526:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00002000:00010000:3.0:1746127007.480915:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127005 -> 1746127006 00002000:00010000:3.0:1746127007.480919:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127003 -> 1746127006 00002000:00010000:3.0:1746127007.480921:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127005 -> 1746127006 00000100:00100000:3.0:1746127007.480940:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296448:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127007.480985:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6efa794 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53868 expref: 42 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.480998:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918a600/0x34dc807b6efa794 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53868 expref: 42 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.481012:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918a600, rc 0) 00000100:00100000:3.0:1746127007.481062:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991769600:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1713us (2778us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127007.481068:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21841 00000100:00100000:0.0:1746127007.484248:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.484370:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991769728 00000100:00100000:3.0:1746127007.484378:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991769728 00000100:00100000:3.0:1746127007.484425:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21842 00000100:00100000:3.0:1746127007.484433:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4455:x1830945991769728:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.484450:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.484467:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5386f expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.484496:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.484503:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.484504:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.484508:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.484535:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.484547:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 16 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.484557:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296576:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.484647:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127007.486470:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994296576:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.486522:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 42 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.486538:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b400, rc 0) 00000100:00100000:3.0:1746127007.486673:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4455:x1830945991769728:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2239us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.486680:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21842 00000100:00100000:0.0:1746127007.486767:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.486853:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991769856 00000100:00100000:3.0:1746127007.486859:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991769856 00002000:00100000:3.0:1746127007.486894:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1503232->1974271) req@ffff8800a1789c00 x1830945991769856/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.486903:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789c00 with x1830945991769856 ext(1503232->1974271) 00010000:00010000:3.0:1746127007.486909:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 17 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.486921:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 17 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127007.486926:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a1789c00 00000100:00100000:3.0:1746127007.486957:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1945 00000100:00100000:3.0:1746127007.486964:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991769856:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127007.490900:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991769856:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 3927us (4144us total) trans 17179875621 rc 0/0 00000100:00100000:3.0:1746127007.490911:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1945 00002000:00100000:3.0:1746127007.490921:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1503232->1974271) req@ffff8800a1789c00 x1830945991769856/t17179875621(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/448 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.490928:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789c00 with x1830945991769856 ext(1503232->1974271) 00010000:00010000:3.0:1746127007.490937:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 19 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.490949:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 19 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127007.490957:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a1789c00 00000100:00100000:0.0:1746127007.492678:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.492761:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991769984 00000100:00100000:1.0:1746127007.492770:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991769984 00010000:00010000:1.0:1746127007.492802:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 19 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.492841:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10273 00000100:00100000:1.0:1746127007.492849:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991769984:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.492867:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.492884:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 19 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.492895:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 19 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.492918:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918ae00/0x34dc807b6efa78d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->1974271) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53861 expref: 19 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.492941:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.492943:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.492949:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.492957:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.492991:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.493007:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994296704:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127007.493098:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127007.494678:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994296704:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127007.494698:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.494725:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991769984:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1877us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.494735:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10273 00000100:00100000:0.0:1746127007.497803:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.497850:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.497948:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991770240 00000100:00100000:3.0:1746127007.497956:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991770240 00002000:00100000:3.0:1746127007.497999:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a1788a80 x1830945991770240/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.498009:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788a80 with x1830945991770240 ext(1048576->2097151) 00002000:00010000:3.0:1746127007.498014:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a1788a80 00000100:00100000:3.0:1746127007.498053:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991770496 00000100:00100000:3.0:1746127007.498056:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991770496 00002000:00100000:3.0:1746127007.498073:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a1789180 x1830945991770496/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.498080:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789180 with x1830945991770496 ext(1048576->2097151) 00002000:00010000:3.0:1746127007.498083:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1789180 00000100:00100000:3.0:1746127007.498096:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8763 00000100:00100000:3.0:1746127007.498103:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991770240:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127007.498103:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8764 00000100:00100000:1.0:1746127007.498112:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991770496:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127007.508387:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991770496:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10265us (10524us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127007.508400:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8764 00002000:00100000:1.0:1746127007.508413:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a1789180 x1830945991770496/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.508422:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789180 with x1830945991770496 ext(1048576->2097151) 00002000:00010000:1.0:1746127007.508428:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1789180 00000100:00100000:3.0:1746127007.509854:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991770240:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11710us (12019us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127007.509863:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8763 00002000:00100000:3.0:1746127007.509871:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a1788a80 x1830945991770240/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.509879:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788a80 with x1830945991770240 ext(1048576->2097151) 00002000:00010000:3.0:1746127007.509884:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a1788a80 00000100:00100000:0.0:1746127007.519731:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.519773:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.519807:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991770880 00000100:00100000:0.0:1746127007.519815:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991770880 00002000:00100000:0.0:1746127007.519863:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3403775) req@ffff8800a1788000 x1830945991770880/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.519873:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788000 with x1830945991770880 ext(2097152->3403775) 00002000:00010000:0.0:1746127007.519878:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1788000 00000100:00100000:0.0:1746127007.519893:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991771008 00000100:00100000:0.0:1746127007.519895:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991771008 00002000:00100000:0.0:1746127007.519906:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cc3d500 x1830945991771008/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 504/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.519912:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3d500 with x1830945991771008 ext(2097152->4194303) 00002000:00010000:0.0:1746127007.519914:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3d500 00000100:00100000:0.0:1746127007.519926:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8765 00000100:00100000:0.0:1746127007.519933:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991770880:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127007.520465:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8766 00000100:00100000:2.0:1746127007.520473:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991771008:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127007.533832:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991770880:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13886us (14099us total) trans 0 rc 1306624/1306624 00000100:00100000:2.0:1746127007.533845:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8765 00002000:00100000:2.0:1746127007.533856:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3403775) req@ffff8800a1788000 x1830945991770880/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1306624/1306624 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.533866:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1788000 with x1830945991770880 ext(2097152->3403775) 00002000:00010000:2.0:1746127007.533872:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1788000 00000100:00100000:2.0:1746127007.538835:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991771008:12345-192.168.203.42@tcp:3:cat.0 Request processed in 18352us (19050us total) trans 0 rc 2015232/2015232 00000100:00100000:2.0:1746127007.538849:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8766 00002000:00100000:2.0:1746127007.538860:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cc3d500 x1830945991771008/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 504/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 2015232/2015232 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.538869:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3d500 with x1830945991771008 ext(2097152->4194303) 00002000:00010000:2.0:1746127007.538874:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3d500 00000100:00100000:0.0:1746127007.547238:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.547314:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991771264 00000100:00100000:2.0:1746127007.547324:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991771264 00002000:00100000:2.0:1746127007.547373:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009cc3c700 x1830945991771264/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.547383:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3c700 with x1830945991771264 ext(4194304->4829183) 00002000:00010000:2.0:1746127007.547389:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3c700 00000100:00100000:2.0:1746127007.547411:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8767 00000100:00100000:2.0:1746127007.547419:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991771264:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127007.552757:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991771264:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5327us (5520us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127007.552769:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8767 00002000:00100000:2.0:1746127007.552780:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009cc3c700 x1830945991771264/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.552789:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3c700 with x1830945991771264 ext(4194304->4829183) 00002000:00010000:2.0:1746127007.552794:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3c700 00000100:00100000:0.0:1746127007.572283:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.572360:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991771392 00000100:00100000:3.0:1746127007.572371:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991771392 00000100:00100000:3.0:1746127007.572435:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17323 00000100:00100000:3.0:1746127007.572443:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:4458:x1830945991771392:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127007.572467:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.572486:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918bc00/0x34dc807b6efa7a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53876 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.572545:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572557:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572567:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572580:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572585:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572590:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572658:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572669:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.572676:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 61 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.572686:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.572716:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 61 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.572727:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 61 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.572739:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994296832:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.572859:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.572867:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 34 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.572875:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994296960:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.572894:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127007.580358:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994296832:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.580371:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994296960:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.580417:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127007.582259:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.582310:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.582502:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991771648 00000100:00100000:1.0:1746127007.582511:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991771648 00000100:00100000:1.0:1746127007.582564:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991771904 00000100:00100000:1.0:1746127007.582566:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991771904 00000100:00100000:1.0:1746127007.582584:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6613 00000100:00100000:1.0:1746127007.582592:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+62:14253:x1830945991771648:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746127007.582678:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6614 00000100:00100000:3.0:1746127007.582686:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+35:32472:x1830945991771904:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746127007.583260:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+36:32472:x1830945991771904:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 574us (948us total) trans 8589938281 rc 0/0 00000100:00100000:3.0:1746127007.583267:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6614 00000100:00100000:1.0:1746127007.583414:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+63:14253:x1830945991771648:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 822us (1160us total) trans 8589938280 rc 0/0 00000100:00100000:1.0:1746127007.583421:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6613 00000100:00100000:0.0:1746127007.585239:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.585486:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991772032 00000100:00100000:1.0:1746127007.585494:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991772032 00010000:00010000:1.0:1746127007.585529:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 36 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.585717:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.585965:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991772160 00000100:00100000:1.0:1746127007.585969:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991772160 00000100:00100000:3.0:1746127007.585974:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10274 00000100:00100000:3.0:1746127007.585984:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2027:x1830945991772032:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.585984:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 63 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.585998:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127007.586002:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10275 00010000:00010000:3.0:1746127007.586005:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 36 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.586006:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+63:2029:x1830945991772160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.586012:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.586015:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 63 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.586016:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 36 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.586033:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 63 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.586053:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efa701 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537ea expref: 36 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.586110:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.586114:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127007.586123:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5206800/0x34dc807b6efa716 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e537f1 expref: 63 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.586124:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.586235:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127007.586244:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.586249:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127007.586256:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127007.586318:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586328:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127007.586496:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+62:2029:x1830945991772160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 486us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.586501:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2027:x1830945991772032:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 518us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.586503:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10275 00000100:00100000:3.0:1746127007.586510:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10274 00000004:00200000:2.0:1746127007.586709:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127007.586714:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127007.586775:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586785:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586794:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586800:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586806:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586811:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918a200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127007.586814:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586819:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586827:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127007.586829:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127007.586833:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.586837:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918a200/0x34dc807b6efa7a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587666:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587673:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587678:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587682:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918b600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127007.587684:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587688:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587695:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b41ee200) 00010000:00010000:2.0:1746127007.587697:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127007.587699:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587703:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918b600/0x34dc807b6efa7b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.587740:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918bc00/0x34dc807b6efa7a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.587751:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.587757:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.587759:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127007.587761:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918ae00, rc 0) 00000100:00100000:2.0:1746127007.589656:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:4458:x1830945991771392:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 17206us (17375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.589667:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17323 00000100:00100000:0.0:1746127007.592335:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.594266:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991772416 00000100:00100000:3.0:1746127007.594281:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991772416 00000100:00100000:3.0:1746127007.594377:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21843 00000100:00100000:3.0:1746127007.594385:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991772416:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127007.594403:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.594420:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53884 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.594420:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.594441:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127007.594442:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.594443:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.594452:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 10 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.594467:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 10 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127007.594472:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127007.594476:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918a600, rc 0) 00000100:00100000:1.0:1746127007.594513:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991772672 00000100:00100000:3.0:1746127007.594517:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991772416:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 134us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.594517:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991772672 00000100:00100000:3.0:1746127007.594523:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21843 00000100:00100000:3.0:1746127007.594535:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991772288 00000100:00100000:3.0:1746127007.594539:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991772288 00000100:00100000:1.0:1746127007.594544:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991772544 00000100:00100000:1.0:1746127007.594547:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991772544 00000100:00100000:3.0:1746127007.594550:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21844 00000100:00100000:3.0:1746127007.594554:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991772672:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127007.594561:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127007.594562:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21845 00000100:00100000:1.0:1746127007.594568:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991772544:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127007.594570:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6efa7c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53892 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.594574:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.594585:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665d000/0x34dc807b6efa7cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5388b expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.594605:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994297088:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127007.594613:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994297216:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127007.594722:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21846 00000100:00100000:2.0:1746127007.594728:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991772288:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127007.594739:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.594747:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5387d expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.594758:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.594760:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.594764:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.594774:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.594781:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b5c00, rc 0) 00000100:00100000:2.0:1746127007.595066:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991772288:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 337us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.595072:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21846 00000100:00100000:3.0:1746127007.595108:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.597591:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00002000:00010000:1.0:1746127007.601374:0:9612:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127005 -> 1746127006 00002000:00010000:1.0:1746127007.601382:0:9612:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127005 -> 1746127006 00002000:00010000:1.0:1746127007.601385:0:9612:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127005 -> 1746127006 00000100:00100000:1.0:1746127007.601411:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994297216:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127007.601449:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009665d000/0x34dc807b6efa7cc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5388b expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.601463:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665d000/0x34dc807b6efa7cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5388b expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.601474:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665d000, rc 0) 00000100:00100000:1.0:1746127007.601537:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991772544:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 6967us (7062us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127007.601549:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21845 00002000:00010000:3.0:1746127007.601652:0:12333:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746127005 -> 1746127006 00002000:00010000:3.0:1746127007.601656:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127004 -> 1746127006 00002000:00010000:3.0:1746127007.601658:0:12333:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746127005 -> 1746127006 00000100:00100000:3.0:1746127007.601671:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994297088:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127007.601710:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6efa7c5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53892 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.601719:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918aa00/0x34dc807b6efa7c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53892 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.601728:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918aa00, rc 0) 00000100:00100000:3.0:1746127007.601750:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991772672:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 7194us (7331us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127007.601755:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21844 00000100:00100000:0.0:1746127007.605469:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.605889:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991772928 00000100:00100000:2.0:1746127007.605898:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991772928 00000100:00100000:2.0:1746127007.605956:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17324 00000100:00100000:2.0:1746127007.605965:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:4458:x1830945991772928:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127007.605986:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.606005:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5a00/0x34dc807b6efa7da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53899 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.606116:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.606151:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.606159:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.606192:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.606203:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 20 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.606215:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994297344:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.606312:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.612200:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994297344:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.612230:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127007.612307:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.612379:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991773056 00000100:00100000:3.0:1746127007.612386:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991773056 00010000:00010000:3.0:1746127007.612420:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 21 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.612587:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10276 00000100:00100000:3.0:1746127007.612594:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2026:x1830945991773056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.612608:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.612614:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 21 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.612623:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 21 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.612644:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009918ae00/0x34dc807b6efa7b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53876 expref: 21 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.612658:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.612663:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.612672:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.612679:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127007.612706:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127007.613153:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.613161:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127007.613185:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:3.0:1746127007.613251:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2026:x1830945991773056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 656us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.613259:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10276 00010000:00010000:2.0:1746127007.613309:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5a00/0x34dc807b6efa7da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53899 expref: 21 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.613326:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53899 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.613333:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.613336:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127007.613338:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b5200, rc 0) 00000100:00100000:2.0:1746127007.613371:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+20:4458:x1830945991772928:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 7407us (7911us total) trans 8589938282 rc 0/0 00000100:00100000:2.0:1746127007.613378:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17324 00000100:00100000:0.0:1746127007.615205:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.615289:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991773312 00000100:00100000:2.0:1746127007.615296:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991773312 00000100:00100000:2.0:1746127007.615337:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17325 00000100:00100000:2.0:1746127007.615344:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+20:4458:x1830945991773312:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127007.615368:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.615371:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746127007.615393:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5200/0x34dc807b6efa7e1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53899 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.615406:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.615409:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127007.615420:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4400/0x34dc807b6efa7ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538a0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.615722:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efa7f6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.615734:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efa7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.615741:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efa7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127007.615750:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127007.615826:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4400/0x34dc807b6efa7ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538a0 expref: 22 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.615837:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efa7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538a0 expref: 21 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.615843:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.615846:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127007.615848:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b4c00, rc 0) 00000100:00100000:2.0:1746127007.616169:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:4458:x1830945991773312:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 824us (969us total) trans 8589938283 rc 0/0 00000100:00100000:2.0:1746127007.616177:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17325 00000100:00100000:0.0:1746127007.618561:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.618787:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991773440 00000100:00100000:2.0:1746127007.618796:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991773440 00000100:00100000:2.0:1746127007.619464:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17326 00000100:00100000:2.0:1746127007.619474:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:4458:x1830945991773440:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127007.619499:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.619519:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5207600/0x34dc807b6efa804 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538a7 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.619574:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5207600/0x34dc807b6efa804 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538a7 expref: 22 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.619586:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5207600/0x34dc807b6efa804 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538a7 expref: 22 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.619602:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.619605:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127007.619609:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5207600, rc 0) 00000100:00100000:2.0:1746127007.619663:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+22:4458:x1830945991773440:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 190us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.619669:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17326 00000100:00100000:0.0:1746127007.622878:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.623195:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.623566:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991773696 00000100:00100000:3.0:1746127007.623574:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991773696 00000100:00100000:3.0:1746127007.623839:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991773568 00000100:00100000:3.0:1746127007.623842:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991773568 00000100:00100000:1.0:1746127007.623880:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21847 00000100:00100000:1.0:1746127007.623891:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991773696:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:1.0:1746127007.623936:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.623954:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.623962:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.623968:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.623970:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.623972:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.624003:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 9 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.624014:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 9 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.624038:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994297472:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.624126:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.624156:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 41 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.624164:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994297600:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.624192:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.624325:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.624664:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.624683:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991773952 00000100:00100000:0.0:1746127007.624686:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991773952 00000100:00100000:0.0:1746127007.624703:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774208 00000100:00100000:0.0:1746127007.624704:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774208 00000100:00100000:0.0:1746127007.624715:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21848 00000100:00100000:0.0:1746127007.624720:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991773568:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127007.624743:0:3148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.624755:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624762:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624774:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 32 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624779:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.624781:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.624783:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.624799:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 32 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624807:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 32 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.624816:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994297728:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.624843:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 11 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624850:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 11 pid: 16295 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.624857:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994297856:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.624880:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624892:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 16 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.624899:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994297984:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.624915:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.624932:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21849 00000100:00100000:0.0:1746127007.624938:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991773952:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127007.624954:0:1964:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.624964:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.624971:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624978:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 32 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.624983:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.624984:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.624986:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625002:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 32 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625010:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 32 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.625018:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994298112:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.625053:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625060:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 11 pid: 1507 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.625067:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994298240:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.625091:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625098:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.625105:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994298368:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.625120:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.625174:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.625207:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.625300:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991773824 00000100:00100000:0.0:1746127007.625303:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991773824 00000100:00100000:0.0:1746127007.625320:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774080 00000100:00100000:0.0:1746127007.625323:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774080 00000100:00100000:0.0:1746127007.625334:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21850 00000100:00100000:0.0:1746127007.625339:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991774208:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127007.625355:0:9613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625364:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625369:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127007.625370:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127007.625372:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625385:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 41 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625392:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 41 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.625399:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994298496:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.625419:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.625436:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21851 00000100:00100000:0.0:1746127007.625441:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991773824:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127007.625455:0:9611:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625469:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 17 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625476:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625483:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 41 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625488:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.625490:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.625492:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625506:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 41 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625513:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 41 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.625521:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994298624:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.625543:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625551:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 11 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.625564:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994298752:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.625584:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 17 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.625592:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 17 pid: 9612 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.625600:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994298880:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.625611:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.625627:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21852 00000100:00100000:0.0:1746127007.625632:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991774080:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:0.0:1746127007.625648:0:12340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625659:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625664:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127007.625665:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127007.625667:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625681:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.625692:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 32 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.625700:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994299008:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.625716:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.638044:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.638148:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.638167:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.638192:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774336 00000100:00100000:2.0:1746127007.638200:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774336 00010000:00010000:2.0:1746127007.638238:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 12 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.638261:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774592 00000100:00100000:2.0:1746127007.638263:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774592 00010000:00010000:2.0:1746127007.638273:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 33 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.638284:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774848 00000100:00100000:2.0:1746127007.638285:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774848 00010000:00010000:2.0:1746127007.638296:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 17 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.638308:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10277 00000100:00100000:2.0:1746127007.638314:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991774336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.638326:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.638346:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 12 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638357:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 12 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638383:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.638425:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991774336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.638431:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10277 00000100:00100000:2.0:1746127007.638445:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10278 00000100:00100000:2.0:1746127007.638449:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991774592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.638457:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.638469:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 33 pid: 1964 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638477:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 33 pid: 1964 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638490:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.638520:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991774592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.638526:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10278 00000100:00100000:2.0:1746127007.638537:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10279 00000100:00100000:2.0:1746127007.638542:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991774848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.638548:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.638554:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 17 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638562:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 17 pid: 9613 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638572:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.638587:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991774848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.638592:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10279 00000100:00100000:2.0:1746127007.638646:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.638660:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774464 00000100:00100000:2.0:1746127007.638663:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774464 00010000:00010000:2.0:1746127007.638674:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.638687:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10280 00000100:00100000:2.0:1746127007.638691:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991774464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.638698:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.638704:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.638711:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.638721:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.638722:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.638726:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.638733:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.638747:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.638760:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991774464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 68us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.638764:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10280 00000100:00100000:2.0:1746127007.638832:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.638842:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774720 00000100:00100000:2.0:1746127007.638845:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774720 00010000:00010000:2.0:1746127007.638855:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 13 pid: 16295 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.638868:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10281 00000100:00100000:2.0:1746127007.638871:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991774720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.638877:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.638883:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 13 pid: 16295 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638896:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 13 pid: 16295 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.638906:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.638908:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.638911:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.638917:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.638927:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.638941:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991774720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 68us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.638946:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10281 00000100:00100000:2.0:1746127007.639055:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.639097:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.639107:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991774976 00000100:00100000:2.0:1746127007.639109:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991774976 00010000:00010000:2.0:1746127007.639121:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 18 pid: 9612 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.639167:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10282 00000100:00100000:2.0:1746127007.639173:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991774976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.639180:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.639188:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 18 pid: 9612 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.639197:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 18 pid: 9612 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.639209:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.639227:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991774976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.639233:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10282 00000100:00100000:2.0:1746127007.639280:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.639292:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991775232 00000100:00100000:2.0:1746127007.639294:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991775232 00010000:00010000:2.0:1746127007.639304:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.639316:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10283 00000100:00100000:2.0:1746127007.639321:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991775232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.639327:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.639333:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.639340:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 33 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.639349:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.639360:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991775232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.639368:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10283 00000100:00100000:2.0:1746127007.639416:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991775104 00000100:00100000:2.0:1746127007.639419:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991775104 00002000:00100000:2.0:1746127007.639446:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3403776->4194303) req@ffff880094e6d500 x1830945991775104/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.639454:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d500 with x1830945991775104 ext(3403776->4194303) 00010000:00010000:2.0:1746127007.639460:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.639467:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.639473:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e6d500 00000100:00100000:2.0:1746127007.639491:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1946 00000100:00100000:2.0:1746127007.639496:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991775104:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127007.639701:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994299008:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.639720:0:12340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.639743:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efa5e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53718 expref: 17 pid: 9612 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.639757:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994298880:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.640705:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a88c00/0x34dc807b6efa771 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53845 expref: 34 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.640723:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994298112:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.640749:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11000/0x34dc807b6efa605 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53734 expref: 33 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.640757:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994297728:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.640766:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efa66e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53788 expref: 12 pid: 16295 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.640773:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994297856:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.640784:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efa5db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5370a expref: 16 pid: 9613 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.640792:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994297984:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.640816:0:3148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640828:0:3148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640834:0:3148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640853:0:3148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640860:0:3148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640867:0:3148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640874:0:3148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127007.640877:0:3148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640884:0:3148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640897:0:3148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.640902:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd6000/0x34dc807b6efa812 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127007.640955:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991773568:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 16234us (17760us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.640963:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21848 00010000:00010000:1.0:1746127007.642060:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7b5c00/0x34dc807b6efa7d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5387d expref: 11 pid: 11152 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.642081:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994297472:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.642096:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918b400/0x34dc807b6efa79b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5386f expref: 41 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.642105:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994297600:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.642125:0:9612:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645568:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645577:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645607:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645619:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645626:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645633:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009665c200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127007.645637:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645643:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645661:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.645666:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009665c200/0x34dc807b6efa80b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.645764:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991773696:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 21871us (22888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.645773:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21847 00000100:00100000:0.0:1746127007.656843:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994298496:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.656871:0:9613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127007.657173:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.657249:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994298624:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.657270:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994298752:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.657291:0:9611:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127007.657347:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994298240:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.657361:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994298368:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.657389:0:1964:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.657525:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991775360 00000100:00100000:3.0:1746127007.657540:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991775360 00010000:00010000:3.0:1746127007.657576:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 11 pid: 1507 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746127007.657766:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10284 00000100:00100000:3.0:1746127007.657783:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991775360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.657811:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.657862:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 11 pid: 1507 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.657871:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 11 pid: 1507 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.657898:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918a600/0x34dc807b6efa7be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53884 expref: 11 pid: 1507 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.658072:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127007.658170:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.658217:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991775360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 435us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.658235:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10284 00000100:00100000:0.0:1746127007.658582:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.658598:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.658619:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991775488 00000100:00100000:0.0:1746127007.658622:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991775488 00000100:00100000:1.0:1746127007.658647:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127007.658651:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.658668:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991775872 00000100:00100000:0.0:1746127007.658670:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991775872 00000100:00100000:1.0:1746127007.658700:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991775744 00000100:00100000:1.0:1746127007.658705:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991775744 00010000:00010000:0.0:1746127007.658722:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.658732:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 41 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.658738:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10285 00000100:00100000:0.0:1746127007.658754:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991775488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127007.658756:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10286 00010000:00010000:0.0:1746127007.658761:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127007.658763:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991775872:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.658774:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127007.658786:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.658791:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.658794:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.658802:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.658819:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009da60a00/0x34dc807b6efa740 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53814 expref: 16 pid: 11152 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.658821:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be47c00/0x34dc807b6efa67c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53796 expref: 10 pid: 11152 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.658832:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.658833:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.658839:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127007.658850:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.658858:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.658869:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991775872:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.658875:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10286 00010000:00010000:0.0:1746127007.658888:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.658892:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10287 00000100:00100000:1.0:1746127007.658896:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991775744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.658903:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.658909:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 41 pid: 1964 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.658917:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 41 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.658920:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991775488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 176us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.658927:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10285 00010000:00010000:1.0:1746127007.658933:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11a00/0x34dc807b6efa613 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53742 expref: 41 pid: 1964 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746127007.658940:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.658942:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.658945:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.658953:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.658970:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127007.658974:0:1964:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.658988:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991775744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 91us (344us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127007.658993:0:1964:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.658994:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10287 00010000:00010000:0.0:1746127007.659006:0:1964:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.659056:0:1964:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.659063:0:1964:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.659069:0:1964:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c9200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127007.659085:0:1964:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.659092:0:1964:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.659118:0:1964:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659122:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.659124:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efa819 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659151:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659164:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659170:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659181:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659186:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e8e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127007.659189:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659194:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659204:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.659209:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e8e00/0x34dc807b6efa827 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127007.659227:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991773952:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 34288us (34901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.659243:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21849 00000100:00100000:1.0:1746127007.659250:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991773824:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 33808us (34075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.659256:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21851 00000100:00100000:2.0:1746127007.659438:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991775616 00000100:00100000:2.0:1746127007.659443:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991775616 00002000:00100000:2.0:1746127007.659491:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3227647) req@ffff880095ca9f80 x1830945991775616/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.659500:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9f80 with x1830945991775616 ext(3145728->3227647) 00010000:00010000:2.0:1746127007.659505:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 40 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.659522:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 40 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746127007.659528:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca9f80 00000100:00100000:2.0:1746127007.659541:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1947 00000100:00100000:2.0:1746127007.659556:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991775616:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127007.668831:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991775616:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9267us (10762us total) trans 17179875622 rc 0/0 00000100:00100000:0.0:1746127007.668842:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1947 00002000:00100000:0.0:1746127007.668853:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3227647) req@ffff880095ca9f80 x1830945991775616/t17179875622(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/448 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.668863:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca9f80 with x1830945991775616 ext(3145728->3227647) 00010000:00010000:0.0:1746127007.668871:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.668882:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:0.0:1746127007.668889:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ca9f80 00000100:00100000:3.0:1746127007.670150:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991775104:12345-192.168.203.42@tcp:4:cat.0 Request processed in 30631us (31073us total) trans 21474842889 rc 0/0 00000100:00100000:3.0:1746127007.670158:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1946 00002000:00100000:3.0:1746127007.670164:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (3403776->4194303) req@ffff880094e6d500 x1830945991775104/t21474842889(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/448 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.670173:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d500 with x1830945991775104 ext(3403776->4194303) 00010000:00010000:3.0:1746127007.670179:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.670188:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746127007.670194:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e6d500 00000100:00100000:0.0:1746127007.678638:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.678815:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.678879:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991776000 00000100:00100000:3.0:1746127007.678895:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991776000 00000100:00100000:1.0:1746127007.678931:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991776128 00010000:00010000:3.0:1746127007.678932:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.678942:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991776128 00000100:00100000:3.0:1746127007.678975:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10288 00010000:00010000:1.0:1746127007.678975:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.678983:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991776000:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.678994:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127007.679010:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10289 00000100:00100000:1.0:1746127007.679016:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991776128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.679041:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.679062:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.679074:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.679100:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918a400/0x34dc807b6efa786 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5385a expref: 42 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.679118:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.679120:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.679124:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.679173:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.679199:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127007.679210:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.679220:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.679240:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.679247:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.679249:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991776128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 232us (433us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127007.679254:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.679255:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10289 00010000:00010000:0.0:1746127007.679259:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127007.679263:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.679269:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.679284:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.679289:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efa820 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.679377:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.679387:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.679401:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918b000/0x34dc807b6efa77f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3403776->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53853 expref: 33 pid: 1507 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.679413:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.679416:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.679419:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.679426:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.679448:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127007.679496:0:12340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679502:0:12340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679515:0:12340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679521:0:12340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679527:0:12340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679532:0:12340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e981400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127007.679535:0:12340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679540:0:12340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679549:0:12340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.679555:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e981400/0x34dc807b6efa82e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127007.680184:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2027:x1830945991774208:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 54842us (55518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.680193:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21850 00000100:00100000:3.0:1746127007.680334:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991776000:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1351us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.680341:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10288 00000100:00100000:2.0:1746127007.680389:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991774080:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 54755us (55180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.680395:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21852 00000100:00100000:2.0:1746127007.682852:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.682927:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991776384 00000100:00100000:1.0:1746127007.682935:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991776384 00000100:00100000:1.0:1746127007.683094:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17327 00000100:00100000:1.0:1746127007.683103:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+22:4458:x1830945991776384:12345-192.168.203.42@tcp:36:mirror_io.0 00010000:00010000:1.0:1746127007.683180:0:13466:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.683201:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5207600/0x34dc807b6efa804 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538a7 expref: 22 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683222:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.683226:0:13466:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127007.683248:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.683260:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683267:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 61 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683437:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 34 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683444:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 61 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683449:0:13466:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.683494:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 61 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683515:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 61 pid: 10958 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.683527:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299136:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.683670:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 34 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683677:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 34 pid: 10958 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.683694:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d288000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299264:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.683847:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 61 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683855:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 61 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.683870:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d289180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299392:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.683908:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.683915:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 34 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.683921:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299520:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.683947:0:13466:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.687414:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.687470:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.687505:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.687527:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991776512 00000100:00100000:0.0:1746127007.687558:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991776512 00010000:00010000:0.0:1746127007.687599:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 62 pid: 10958 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.687634:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991776768 00000100:00100000:0.0:1746127007.687636:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991776768 00010000:00010000:0.0:1746127007.687656:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 63 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.687666:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991776640 00000100:00100000:0.0:1746127007.687669:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991776640 00010000:00010000:0.0:1746127007.687686:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 35 pid: 10958 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.687697:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10290 00000100:00100000:0.0:1746127007.687713:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+63:2028:x1830945991776512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.687723:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127007.687735:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 63 pid: 10958 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.687743:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 63 pid: 10958 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.687768:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127007.687772:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127007.687787:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127007.687848:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+63:2028:x1830945991776512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 122us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.687855:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10290 00000100:00100000:0.0:1746127007.687883:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10291 00000100:00100000:0.0:1746127007.687887:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+62:2028:x1830945991776768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.687905:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127007.687910:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 62 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.687917:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 62 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.687926:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127007.687940:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127007.687945:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127007.687947:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.687970:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+62:2028:x1830945991776768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.687975:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10291 00010000:00010000:1.0:1746127007.688298:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098672600/0x34dc807b6ef9e25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53295 expref: 61 pid: 10958 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.688327:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299136:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.688350:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d288000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299264:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.688359:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45600/0x34dc807b6efa158 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53447 expref: 60 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.688381:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d289180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.688391:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994299520:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.688438:0:13466:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:1.0:1746127007.688468:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991776896 00000100:00100000:1.0:1746127007.688471:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991776896 00010000:00010000:1.0:1746127007.688496:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 36 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.688522:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10292 00000100:00100000:1.0:1746127007.688529:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2028:x1830945991776640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.688534:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.688538:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 36 pid: 10958 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.688556:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 36 pid: 10958 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.688581:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6ef9e17 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53287 expref: 36 pid: 10958 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.688589:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.688591:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.688596:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.688649:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2028:x1830945991776640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 120us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.688670:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10292 00000100:00100000:1.0:1746127007.688681:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10293 00000100:00100000:1.0:1746127007.688700:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2028:x1830945991776896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.688707:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.688711:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 34 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.688731:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 34 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.688754:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbfc800/0x34dc807b6efa0fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53408 expref: 34 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.689626:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.689629:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.689649:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.689655:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.689683:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.689744:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2028:x1830945991776896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1057us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.689751:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10293 00010000:00010000:0.0:1746127007.690293:0:13466:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127007.690308:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000040:00080000:0.0:1746127007.690721:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1398, 88 off130624 00000004:00080000:0.0:1746127007.690729:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902732599446ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127007.690807:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1417, 88 off132392 00000004:00080000:0.0:1746127007.690813:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902732683886ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.692613:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1418, 88 off132480 00000004:00080000:1.0:1746127007.692621:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902734491748ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.692689:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1399, 88 off130712 00000004:00080000:1.0:1746127007.692693:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902734563627ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.692750:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1400, 88 off130800 00000004:00080000:1.0:1746127007.692754:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902734624457ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.692902:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1419, 88 off132568 00000004:00080000:1.0:1746127007.692906:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902734776598ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.692925:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1420, 88 off132656 00000004:00080000:1.0:1746127007.692946:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902734816253ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.692954:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1421, 88 off132744 00000004:00080000:1.0:1746127007.692956:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902734827050ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.692984:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1401, 88 off130888 00000004:00080000:1.0:1746127007.692986:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902734856893ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.693050:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1422, 88 off132832 00000004:00080000:1.0:1746127007.693076:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902734925712ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.693093:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1402, 88 off130976 00000004:00080000:1.0:1746127007.693096:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902734966552ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.693114:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1423, 88 off132920 00000004:00080000:1.0:1746127007.693117:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902734987347ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.693320:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1404, 88 off131160 00000004:00080000:1.0:1746127007.693334:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902735204537ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.693371:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1405, 88 off131248 00000004:00080000:1.0:1746127007.693374:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902735244892ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.693396:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1406, 88 off131336 00000004:00080000:1.0:1746127007.693400:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902735270300ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.693409:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1407, 88 off131424 00000004:00080000:1.0:1746127007.693412:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902735282281ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.693429:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1424, 88 off133008 00000004:00080000:1.0:1746127007.693434:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902735304450ns, next at 895431202182ns, rc = 0 00000001:00080000:2.0:1746127007.697072:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938284 is committed 00000004:00080000:2.0:1746127007.697081:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1398 committed 00000004:00080000:2.0:1746127007.697615:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1381 committed 00000004:00080000:2.0:1746127007.697626:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1380 committed 00000004:00080000:2.0:1746127007.697628:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1379 committed 00000004:00080000:2.0:1746127007.697630:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1378 committed 00000004:00080000:2.0:1746127007.697631:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1397 committed 00000004:00080000:2.0:1746127007.697633:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1377 committed 00000004:00080000:2.0:1746127007.697635:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1396 committed 00000004:00080000:2.0:1746127007.697636:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1376 committed 00000004:00080000:2.0:1746127007.697646:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1395 committed 00000004:00080000:2.0:1746127007.697649:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1394 committed 00000004:00080000:2.0:1746127007.697651:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1393 committed 00000004:00080000:2.0:1746127007.697652:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1375 committed 00000004:00080000:2.0:1746127007.697654:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1374 committed 00000004:00080000:2.0:1746127007.697655:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1392 committed 00000004:00080000:2.0:1746127007.697657:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1391 committed 00000004:00080000:2.0:1746127007.697659:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1373 committed 00000001:00080000:2.0:1746127007.697685:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938281 is committed 00000001:00080000:2.0:1746127007.697689:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938280 is committed 00000100:00100000:0.0:1746127007.698359:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994299648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.698524:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.698589:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994300160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.698647:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.698675:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994300672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.698727:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127007.698891:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994299776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127007.698933:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994300032:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746127007.699230:0:13466:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094e6f100 reply state ffff880129799c00 transno 8589938284 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.699260:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.699267:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.699280:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746127007.699284:0:13466:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746127007.699383:0:13466:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746127007.699404:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4458:x1830945991776384:12345-192.168.203.42@tcp:36:mirror_io.0 Request processed in 16290us (16544us total) trans 8589938284 rc 0/0 00000100:00100000:1.0:1746127007.699412:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17327 00010000:00010000:2.0:1746127007.699512:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127007.699532:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127007.699538:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127007.699542:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009665c000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127007.699546:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127007.699563:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127007.699575:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.699589:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127007.699592:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127007.699596:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa835 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00000100:00100000:0.0:1746127007.700802:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994301184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.700850:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.701867:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994299904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.701915:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.702367:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127007.702652:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994299648 00000100:00100000:3.0:1746127007.702661:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994299648 00000100:00100000:3.0:1746127007.702832:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300160 00000100:00100000:3.0:1746127007.702836:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300160 00000100:00100000:3.0:1746127007.702884:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300672 00000100:00100000:3.0:1746127007.702886:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300672 00000100:00100000:3.0:1746127007.702895:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994301184 00000100:00100000:3.0:1746127007.702897:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994301184 00000100:00100000:3.0:1746127007.702918:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21853 00000100:00100000:3.0:1746127007.702935:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3782:x1830945994299648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127007.703223:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3782:x1830945994299648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (4699us total) trans 21474842890 rc 0/0 00000100:00100000:3.0:1746127007.703243:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21853 00000100:00100000:3.0:1746127007.703256:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21854 00000100:00100000:3.0:1746127007.703275:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3782:x1830945994300160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127007.703364:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746127007.703367:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127007.703369:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127007.703370:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127007.703372:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:3.0:1746127007.703416:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3782:x1830945994300160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (4794us total) trans 21474842891 rc 0/0 00000100:00100000:3.0:1746127007.703430:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21854 00000100:00100000:3.0:1746127007.703465:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21855 00000100:00100000:3.0:1746127007.703470:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3782:x1830945994300672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127007.703541:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:3.0:1746127007.703551:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127007.703553:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127007.703554:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127007.703556:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:3.0:1746127007.703596:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3782:x1830945994300672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (4868us total) trans 21474842892 rc 0/0 00000100:00100000:3.0:1746127007.703610:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21855 00000100:00100000:3.0:1746127007.703618:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21856 00000100:00100000:3.0:1746127007.703622:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3782:x1830945994301184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127007.703708:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3782:x1830945994301184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (2870us total) trans 17179875623 rc 0/0 00000100:00100000:3.0:1746127007.703713:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21856 00000100:00080000:3.0:1746127007.703745:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746127007.703748:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746127007.704336:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994300416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.704384:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.704395:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994300928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.704419:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.704438:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994301440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.704449:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.704487:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994299904 00000100:00100000:0.0:1746127007.704505:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994299904 00000100:00100000:0.0:1746127007.704532:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300416 00000100:00100000:0.0:1746127007.704533:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300416 00000100:00100000:0.0:1746127007.704551:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300928 00000100:00100000:0.0:1746127007.704568:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300928 00000100:00100000:0.0:1746127007.704576:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994301440 00000100:00100000:0.0:1746127007.704578:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994301440 00000100:00100000:0.0:1746127007.704598:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21857 00000100:00100000:0.0:1746127007.704616:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3784:x1830945994299904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.704784:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3784:x1830945994299904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (2868us total) trans 21474842893 rc 0/0 00000100:00100000:0.0:1746127007.704789:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21857 00000100:00100000:0.0:1746127007.704811:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21858 00000100:00100000:0.0:1746127007.704815:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3784:x1830945994300416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.704950:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3784:x1830945994300416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (565us total) trans 21474842894 rc 0/0 00000100:00100000:0.0:1746127007.704972:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21858 00000100:00100000:0.0:1746127007.704990:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21859 00000100:00100000:0.0:1746127007.704995:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3784:x1830945994300928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.705112:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3784:x1830945994300928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (691us total) trans 17179875624 rc 0/0 00000100:00100000:0.0:1746127007.705168:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21859 00000100:00100000:0.0:1746127007.705195:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21860 00000100:00100000:0.0:1746127007.705199:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3784:x1830945994301440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.705337:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3784:x1830945994301440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (886us total) trans 17179875625 rc 0/0 00000100:00100000:0.0:1746127007.705361:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21860 00000100:00100000:0.0:1746127007.705414:0:3782:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875606 gen 2 00000004:00080000:0.0:1746127007.705418:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d1b7480, transno 17179875530 00000004:00080000:0.0:1746127007.705429:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9f100, transno 17179875532 00000004:00080000:0.0:1746127007.705431:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9ed80, transno 17179875533 00000004:00080000:0.0:1746127007.705441:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800997d8000, transno 17179875534 00000004:00080000:0.0:1746127007.705443:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9e680, transno 17179875535 00000004:00080000:0.0:1746127007.705449:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9f480, transno 17179875536 00000004:00080000:0.0:1746127007.705451:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9ea00, transno 17179875537 00000004:00080000:0.0:1746127007.705453:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9f800, transno 17179875538 00000004:00080000:0.0:1746127007.705455:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9fb80, transno 17179875539 00000004:00080000:0.0:1746127007.705456:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d1500, transno 17179875555 00000004:00080000:0.0:1746127007.705458:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d1c00, transno 17179875556 00000004:00080000:0.0:1746127007.705460:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d3480, transno 17179875557 00000004:00080000:0.0:1746127007.705462:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d0380, transno 17179875558 00000004:00080000:0.0:1746127007.705463:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d3100, transno 17179875559 00000004:00080000:0.0:1746127007.705472:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d1f80, transno 17179875560 00000004:00080000:0.0:1746127007.705474:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d2300, transno 17179875561 00000004:00080000:0.0:1746127007.705476:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d2d80, transno 17179875562 00000004:00080000:0.0:1746127007.705478:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b7aa00, transno 17179875567 00000004:00080000:0.0:1746127007.705480:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b78a80, transno 17179875568 00000004:00080000:0.0:1746127007.705482:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b79500, transno 17179875569 00000004:00080000:0.0:1746127007.705484:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b79180, transno 17179875570 00000004:00080000:0.0:1746127007.705505:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b78700, transno 17179875571 00000004:00080000:0.0:1746127007.705508:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b7bb80, transno 17179875572 00000004:00080000:0.0:1746127007.705510:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b7b800, transno 17179875573 00000004:00080000:0.0:1746127007.705512:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b78e00, transno 17179875574 00000004:00080000:0.0:1746127007.705514:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc62680, transno 17179875575 00000004:00080000:0.0:1746127007.705517:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c5be680, transno 17179875576 00000004:00080000:0.0:1746127007.705518:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc61c00, transno 17179875577 00000004:00080000:0.0:1746127007.705520:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c5be300, transno 17179875578 00000004:00080000:0.0:1746127007.705530:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c5bc700, transno 17179875579 00000004:00080000:0.0:1746127007.705531:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c5bd500, transno 17179875580 00000004:00080000:0.0:1746127007.705533:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c5bed80, transno 17179875581 00000004:00080000:0.0:1746127007.705535:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c5bce00, transno 17179875582 00000004:00080000:0.0:1746127007.705537:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123474a80, transno 17179875591 00000004:00080000:0.0:1746127007.705538:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba57100, transno 17179875592 00000004:00080000:0.0:1746127007.705540:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba55c00, transno 17179875593 00000004:00080000:0.0:1746127007.705542:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba56680, transno 17179875594 00000004:00080000:0.0:1746127007.705544:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123476680, transno 17179875595 00000004:00080000:0.0:1746127007.705546:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba55180, transno 17179875596 00000004:00080000:0.0:1746127007.705547:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880123477800, transno 17179875597 00000004:00080000:0.0:1746127007.705565:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba56d80, transno 17179875598 00000004:00080000:0.0:1746127007.705568:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd6680, transno 17179875599 00000004:00080000:0.0:1746127007.705570:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd4a80, transno 17179875600 00000004:00080000:0.0:1746127007.705572:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd4e00, transno 17179875601 00000004:00080000:0.0:1746127007.705574:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e2300, transno 17179875602 00000004:00080000:0.0:1746127007.705576:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd64a80, transno 17179875603 00000004:00080000:0.0:1746127007.705578:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e1880, transno 17179875604 00000004:00080000:0.0:1746127007.705589:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd65c00, transno 17179875605 00000004:00080000:0.0:1746127007.705591:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5e3800, transno 17179875606 00000100:00100000:0.0:1746127007.705595:0:3782:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880130a7b480 x1830945994301184/t17179875623(17179875623) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127023 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746127007.705608:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a7b480/2, rc 0, transno 17179875623 00000100:00100000:0.0:1746127007.705620:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994301184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.705631:0:3782:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842870 gen 2 00000004:00080000:0.0:1746127007.705633:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c04a80, transno 21474842814 00000004:00080000:0.0:1746127007.705656:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c06680, transno 21474842815 00000004:00080000:0.0:1746127007.705658:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c05180, transno 21474842816 00000004:00080000:0.0:1746127007.705660:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c07800, transno 21474842817 00000004:00080000:0.0:1746127007.705661:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c06d80, transno 21474842818 00000004:00080000:0.0:1746127007.705663:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c04000, transno 21474842819 00000004:00080000:0.0:1746127007.705675:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c04700, transno 21474842820 00000004:00080000:0.0:1746127007.705677:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c05500, transno 21474842821 00000004:00080000:0.0:1746127007.705679:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122386300, transno 21474842822 00000004:00080000:0.0:1746127007.705681:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122385f80, transno 21474842827 00000004:00080000:0.0:1746127007.705682:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122386a00, transno 21474842828 00000004:00080000:0.0:1746127007.705684:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122384a80, transno 21474842829 00000004:00080000:0.0:1746127007.705686:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122387100, transno 21474842830 00000004:00080000:0.0:1746127007.705687:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122384700, transno 21474842831 00000004:00080000:0.0:1746127007.705689:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122387480, transno 21474842832 00000004:00080000:0.0:1746127007.705694:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122387b80, transno 21474842833 00000004:00080000:0.0:1746127007.705704:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d3800, transno 21474842834 00000004:00080000:0.0:1746127007.705705:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122384000, transno 21474842835 00000004:00080000:0.0:1746127007.705707:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2300, transno 21474842836 00000004:00080000:0.0:1746127007.705709:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1c00, transno 21474842837 00000004:00080000:0.0:1746127007.705711:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c05880, transno 21474842838 00000004:00080000:0.0:1746127007.705717:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0700, transno 21474842839 00000004:00080000:0.0:1746127007.705720:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee9180, transno 21474842840 00000004:00080000:0.0:1746127007.705722:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c06a00, transno 21474842841 00000004:00080000:0.0:1746127007.705731:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede3b80, transno 21474842842 00000004:00080000:0.0:1746127007.705733:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c05f80, transno 21474842843 00000004:00080000:0.0:1746127007.705735:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1180, transno 21474842844 00000004:00080000:0.0:1746127007.705737:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094825180, transno 21474842853 00000004:00080000:0.0:1746127007.705739:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094825f80, transno 21474842854 00000004:00080000:0.0:1746127007.705741:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094827800, transno 21474842855 00000004:00080000:0.0:1746127007.705746:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094826300, transno 21474842856 00000004:00080000:0.0:1746127007.705748:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094824000, transno 21474842857 00000004:00080000:0.0:1746127007.705750:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094824700, transno 21474842858 00000004:00080000:0.0:1746127007.705751:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094827b80, transno 21474842859 00000004:00080000:0.0:1746127007.705761:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd4700, transno 21474842860 00000004:00080000:0.0:1746127007.705763:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f480, transno 21474842861 00000004:00080000:0.0:1746127007.705765:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3d180, transno 21474842862 00000004:00080000:0.0:1746127007.705766:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3c000, transno 21474842863 00000004:00080000:0.0:1746127007.705768:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3ca80, transno 21474842864 00000004:00080000:0.0:1746127007.705770:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3f480, transno 21474842865 00000004:00080000:0.0:1746127007.705772:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3ce00, transno 21474842866 00000004:00080000:0.0:1746127007.705774:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3c380, transno 21474842867 00000004:00080000:0.0:1746127007.705776:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3e300, transno 21474842868 00000004:00080000:0.0:1746127007.705792:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3df80, transno 21474842869 00000004:00080000:0.0:1746127007.705794:0:3782:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c748380, transno 21474842870 00000100:00100000:0.0:1746127007.705798:0:3782:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009d1b5180 x1830945994299648/t21474842890(21474842890) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127023 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746127007.705810:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b5180/2, rc 0, transno 21474842890 00000100:00100000:0.0:1746127007.705825:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994299648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.705840:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd66d80/2, rc 0, transno 21474842891 00000100:00100000:0.0:1746127007.705843:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994300160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.705850:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093640700/2, rc 0, transno 21474842892 00000100:00100000:0.0:1746127007.705852:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994300672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.706653:0:8231:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 45 done 00000100:00100000:0.0:1746127007.706747:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994301696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.706813:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.706869:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994301696 00000100:00100000:0.0:1746127007.706874:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994301696 00000100:00100000:0.0:1746127007.706929:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21861 00000100:00100000:0.0:1746127007.706959:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3782:x1830945994301696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.707098:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3782:x1830945994301696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (284us total) trans 21474842895 rc 0/0 00000100:00100000:0.0:1746127007.707103:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21861 00000004:00080000:0.0:1746127007.707176:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096630380/2, rc 0, transno 21474842895 00000100:00100000:0.0:1746127007.707191:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994301696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.707241:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b6680/2, rc 0, transno 21474842893 00000100:00100000:0.0:1746127007.707245:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994299904:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.707251:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c749500/2, rc 0, transno 21474842894 00000100:00100000:0.0:1746127007.707253:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994300416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.707286:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d1180/2, rc 0, transno 17179875624 00000100:00100000:0.0:1746127007.707289:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994300928:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.707297:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b9aa00/2, rc 0, transno 17179875625 00000100:00100000:0.0:1746127007.707308:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994301440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.707670:0:8233:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 49 done 00000100:00100000:3.0:1746127007.707892:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.708973:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994300544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.709067:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.709118:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994301056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.709186:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.709227:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994301568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.709277:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.709341:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.709385:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994300288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.709440:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.709518:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994300800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.709556:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.709584:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994301312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.709639:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.709696:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300032 00000100:00100000:2.0:1746127007.709702:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300032 00000100:00100000:2.0:1746127007.709785:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300544 00000100:00100000:2.0:1746127007.709800:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300544 00000100:00100000:2.0:1746127007.709824:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994301056 00000100:00100000:2.0:1746127007.709827:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994301056 00000100:00100000:2.0:1746127007.709852:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994301568 00000100:00100000:2.0:1746127007.709854:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994301568 00000100:00100000:2.0:1746127007.709859:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994299776 00000100:00100000:2.0:1746127007.709860:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994299776 00000100:00100000:2.0:1746127007.709866:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300288 00000100:00100000:2.0:1746127007.709867:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300288 00000100:00100000:2.0:1746127007.709894:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21862 00000100:00100000:2.0:1746127007.709905:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994300032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.710192:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994300032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 292us (7824us total) trans 21474842896 rc 0/0 00000100:00100000:2.0:1746127007.710199:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21862 00000100:00100000:2.0:1746127007.710236:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994300800 00000100:00100000:2.0:1746127007.710251:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994300800 00000100:00100000:2.0:1746127007.710262:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994301312 00000100:00100000:2.0:1746127007.710264:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994301312 00000100:00100000:2.0:1746127007.710272:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21863 00000100:00100000:2.0:1746127007.710299:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994300544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127007.710374:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746127007.710388:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127007.710391:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127007.710392:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127007.710394:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:2.0:1746127007.710426:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994300544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (1359us total) trans 21474842897 rc 0/0 00000100:00100000:2.0:1746127007.710432:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21863 00000100:00100000:2.0:1746127007.710474:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21864 00000100:00100000:2.0:1746127007.710479:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994301056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127007.710563:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127007.710566:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127007.710568:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:2.0:1746127007.710569:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127007.710579:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:2.0:1746127007.710615:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994301056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (1429us total) trans 17179875626 rc 0/0 00000100:00100000:2.0:1746127007.710620:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21864 00000100:00100000:2.0:1746127007.710649:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21865 00000100:00100000:2.0:1746127007.710653:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994301568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.710752:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994301568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (1474us total) trans 17179875627 rc 0/0 00000100:00100000:2.0:1746127007.710757:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21865 00000100:00100000:2.0:1746127007.710786:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21866 00000100:00100000:2.0:1746127007.710791:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3783:x1830945994299776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.710918:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994299776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (1575us total) trans 17179875628 rc 0/0 00000100:00100000:2.0:1746127007.710923:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21866 00000100:00100000:2.0:1746127007.711126:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21867 00000100:00100000:2.0:1746127007.711180:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994300288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.711272:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3783:x1830945994300288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1831us total) trans 21474842898 rc 0/0 00000100:00100000:2.0:1746127007.711277:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21867 00000100:00100000:2.0:1746127007.711298:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21868 00000100:00100000:2.0:1746127007.711302:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3783:x1830945994300800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.711396:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994300800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1820us total) trans 17179875629 rc 0/0 00000100:00100000:2.0:1746127007.711401:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21868 00000100:00100000:2.0:1746127007.711427:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21869 00000100:00100000:2.0:1746127007.711431:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3783:x1830945994301312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127007.711494:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:2.0:1746127007.711497:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127007.711498:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127007.711500:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127007.711512:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:2.0:1746127007.711553:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994301312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (1921us total) trans 17179875630 rc 0/0 00000100:00100000:2.0:1746127007.711558:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21869 00000004:00080000:2.0:1746127007.712217:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009da74a80/2, rc 0, transno 17179875628 00000100:00100000:2.0:1746127007.712223:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994299776:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127007.712248:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c74ad80/2, rc 0, transno 21474842898 00000100:00100000:2.0:1746127007.712260:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994300288:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127007.712269:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009da74000/2, rc 0, transno 17179875629 00000100:00100000:2.0:1746127007.712271:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994300800:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127007.712277:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a78a80/2, rc 0, transno 17179875630 00000100:00100000:2.0:1746127007.712280:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994301312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127007.712320:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d1b7100/2, rc 0, transno 21474842896 00000100:00100000:2.0:1746127007.712337:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994300032:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127007.712357:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093643480/2, rc 0, transno 21474842897 00000100:00100000:2.0:1746127007.712360:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994300544:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127007.712384:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d2a00/2, rc 0, transno 17179875626 00000100:00100000:2.0:1746127007.712386:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994301056:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127007.712405:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b98a80/2, rc 0, transno 17179875627 00000100:00100000:2.0:1746127007.712407:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994301568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.713063:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991777024 00000100:00100000:0.0:1746127007.713069:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991777024 00000100:00100000:3.0:1746127007.714089:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17328 00000100:00100000:3.0:1746127007.714097:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4458:x1830945991777024:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127007.714119:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.714207:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538ae expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.714278:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.714289:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.714343:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.714359:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127007.714380:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35c000, rc 0) 00000100:00100000:3.0:1746127007.714485:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4458:x1830945991777024:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 389us (6594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.714491:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17328 00000100:00100000:0.0:1746127007.723721:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.724407:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991777152 00000100:00100000:3.0:1746127007.724416:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991777152 00000100:00100000:3.0:1746127007.726395:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1028 00000100:00100000:3.0:1746127007.726408:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4458:x1830945991777152:12345-192.168.203.42@tcp:103:mirror_io.0 00010000:00010000:3.0:1746127007.726429:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.726451:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efa7f6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538a0 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.726484:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.726489:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.726535:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4458:x1830945991777152:12345-192.168.203.42@tcp:103:mirror_io.0 Request processed in 131us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.726541:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1028 00000100:00100000:3.0:1746127007.729524:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.729634:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991777408 00000100:00100000:1.0:1746127007.729642:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991777408 00000100:00100000:1.0:1746127007.729690:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6615 00000100:00100000:1.0:1746127007.729698:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4458:x1830945991777408:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:1.0:1746127007.730345:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4458:x1830945991777408:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 644us (824us total) trans 8589938285 rc 0/0 00000100:00100000:1.0:1746127007.730352:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6615 00000100:00100000:0.0:1746127007.732066:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.732114:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991777664 00000100:00100000:1.0:1746127007.732173:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991777664 00000100:00100000:1.0:1746127007.732203:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6616 00000100:00100000:1.0:1746127007.732208:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4458:x1830945991777664:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:1.0:1746127007.732322:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4458:x1830945991777664:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 113us (260us total) trans 8589938286 rc 0/0 00000100:00100000:1.0:1746127007.732328:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6616 00000100:00100000:0.0:1746127007.753469:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.753765:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991777920 00000100:00100000:1.0:1746127007.753784:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991777920 00000100:00100000:1.0:1746127007.753857:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17329 00000100:00100000:1.0:1746127007.753873:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4468:x1830945991777920:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127007.753893:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.753917:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982e00/0x34dc807b6efa843 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538b5 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.753987:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.753997:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754045:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754058:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754063:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754068:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754185:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754196:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754202:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:1.0:1746127007.754209:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127007.754262:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754267:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754272:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754277:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127007.754279:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754284:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754292:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127007.754294:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127007.754297:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754301:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa84a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754327:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754335:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754338:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754342:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127007.754344:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754348:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754353:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69aa00) 00010000:00010000:1.0:1746127007.754355:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127007.754357:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754360:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa851 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.754389:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982e00/0x34dc807b6efa843 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 11 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.754398:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 10 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.754403:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.754405:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127007.754407:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983a00, rc 0) 00000100:00100000:1.0:1746127007.754449:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4468:x1830945991777920:12345-192.168.203.42@tcp:101:cat.0 Request processed in 585us (989us total) trans 8589938287 rc 0/0 00000100:00100000:1.0:1746127007.754455:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17329 00000100:00100000:0.0:1746127007.758186:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.758229:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.758347:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991778432 00000100:00100000:1.0:1746127007.758355:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991778432 00000100:00100000:1.0:1746127007.758395:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17330 00000100:00100000:1.0:1746127007.758402:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4466:x1830945991778432:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127007.758420:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.758434:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa866 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538bc expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127007.758488:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991778176 00000100:00100000:3.0:1746127007.758491:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991778176 00010000:00010000:1.0:1746127007.758493:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758502:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758510:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127007.758513:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6617 00000100:00100000:3.0:1746127007.758517:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4468:x1830945991778176:12345-192.168.203.42@tcp:35:cat.0 00010000:00010000:1.0:1746127007.758520:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758524:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758528:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758590:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758597:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758603:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:1.0:1746127007.758610:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:3.0:1746127007.758635:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4468:x1830945991778176:12345-192.168.203.42@tcp:35:cat.0 Request processed in 117us (455us total) trans 8589938288 rc 0/0 00000100:00100000:3.0:1746127007.758641:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6617 00010000:00010000:1.0:1746127007.758660:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758665:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758669:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758673:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e982c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127007.758676:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.758681:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.759243:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127007.759247:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127007.759251:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.759256:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982c00/0x34dc807b6efa86d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.759964:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.759971:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.759980:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.759984:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e983000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127007.759987:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.759992:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.760000:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69ac00) 00010000:00010000:1.0:1746127007.760002:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127007.760004:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.760008:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983000/0x34dc807b6efa874 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.760057:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e982200/0x34dc807b6efa866 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 30 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.761231:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 29 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.761242:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.761252:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127007.761255:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665c000, rc 0) 00000100:00100000:1.0:1746127007.761304:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4466:x1830945991778432:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2901us (3072us total) trans 8589938289 rc 0/0 00000100:00100000:1.0:1746127007.761312:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17330 00000100:00100000:0.0:1746127007.763612:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.764297:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.764327:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.764341:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.764361:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991778816 00000100:00100000:2.0:1746127007.764362:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991778944 00000100:00100000:3.0:1746127007.764367:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991778816 00000100:00100000:2.0:1746127007.764380:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991778944 00000100:00100000:3.0:1746127007.764399:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991779072 00000100:00100000:3.0:1746127007.764401:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991779072 00000100:00100000:3.0:1746127007.764484:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21870 00000100:00100000:3.0:1746127007.764491:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991778816:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.764504:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.764520:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538ca expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127007.764539:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c89c, atime: 0x6813c89c, ctime: 0x6813c89c, blocks: 0x7f8 00010000:00010000:3.0:1746127007.764554:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.764557:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.764563:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.764575:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.764584:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076179400, rc 0) 00000100:00100000:3.0:1746127007.764619:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991778816:12345-192.168.203.42@tcp:101:cat.0 Request processed in 129us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.764625:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21870 00000100:00100000:3.0:1746127007.764638:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21871 00000100:00100000:3.0:1746127007.764642:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991779072:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.764649:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.764659:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538d8 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127007.764669:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c89c, atime: 0x6813c89b, ctime: 0x6813c89b, blocks: 0x808 00010000:00010000:3.0:1746127007.764678:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.764679:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.764682:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.764691:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.764696:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076179600, rc 0) 00000100:00100000:3.0:1746127007.764712:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991779072:12345-192.168.203.42@tcp:101:cat.0 Request processed in 70us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.764716:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21871 00000100:00100000:3.0:1746127007.764724:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21872 00000100:00100000:3.0:1746127007.764729:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991778944:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.764734:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.764739:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538d1 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127007.764748:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c89e, atime: 0x6813c89b, ctime: 0x6813c89e, blocks: 0x800 00010000:00010000:3.0:1746127007.764754:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.764755:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127007.764759:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.764766:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127007.764772:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076178e00, rc 0) 00000100:00100000:3.0:1746127007.764785:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991778944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 56us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.764790:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21872 00000100:00100000:0.0:1746127007.764886:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.764916:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991779200 00000100:00100000:2.0:1746127007.764920:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991779200 00000100:00100000:2.0:1746127007.764942:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21873 00000100:00100000:2.0:1746127007.764947:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991779200:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127007.764951:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127007.764952:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127007.764959:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991779328 00010000:00010000:2.0:1746127007.764960:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538df expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127007.764962:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991779328 00002000:00010000:2.0:1746127007.764969:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c89d, atime: 0x6813c89b, ctime: 0x6813c89d, blocks: 0x800 00010000:00010000:2.0:1746127007.764977:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127007.764977:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21874 00010000:00010000:2.0:1746127007.764978:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127007.764981:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991779328:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.764982:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 18 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.764986:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.764991:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 18 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.764993:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538e6 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.764997:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeaa00, rc 0) 00002000:00010000:0.0:1746127007.765002:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c89e, atime: 0x6813c89e, ctime: 0x6813c89e, blocks: 0x14e0 00010000:00010000:0.0:1746127007.765007:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.765008:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127007.765012:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991779200:12345-192.168.203.42@tcp:101:cat.0 Request processed in 66us (132us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127007.765012:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 19 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.765031:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 19 pid: 9612 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127007.765032:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21873 00010000:00010000:0.0:1746127007.765038:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9200, rc 0) 00000100:00100000:0.0:1746127007.765052:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991779328:12345-192.168.203.42@tcp:101:cat.0 Request processed in 70us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.765056:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21874 00000100:00100000:1.0:1746127007.765122:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991778688 00000100:00100000:1.0:1746127007.765146:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991778688 00000100:00100000:1.0:1746127007.765173:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17331 00000100:00100000:1.0:1746127007.765178:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4465:x1830945991778688:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127007.765191:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.765201:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d800/0x34dc807b6efa8ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538c3 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.765271:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.765281:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 12 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.765287:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 28 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.765293:0:13466:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.765315:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 28 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.765323:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 28 pid: 13466 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.765332:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994301824:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127007.765388:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 12 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.765399:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 12 pid: 13466 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.765406:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d289180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994301952:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.765425:0:13466:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69780 going to sleep for 11 seconds 00000100:00100000:1.0:1746127007.765503:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.765517:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991779456 00000100:00100000:1.0:1746127007.765520:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991779456 00000100:00100000:1.0:1746127007.765537:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21875 00000100:00100000:1.0:1746127007.765542:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991779456:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127007.765547:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.765554:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538ed expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127007.765564:0:9611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c89e, atime: 0x6813c89e, ctime: 0x6813c89e, blocks: 0x1008 00010000:00010000:1.0:1746127007.765571:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.765573:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127007.765577:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 20 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.765585:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 20 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127007.765591:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b4400, rc 0) 00000100:00100000:1.0:1746127007.765607:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991779456:12345-192.168.203.42@tcp:101:cat.0 Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.765614:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21875 00000100:00100000:1.0:1746127007.775701:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.775828:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.775927:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991779584 00000100:00100000:0.0:1746127007.775948:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991779584 00010000:00010000:0.0:1746127007.775997:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 29 pid: 13466 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.776045:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991779712 00000100:00100000:0.0:1746127007.776048:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991779712 00010000:00010000:0.0:1746127007.776059:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 13 pid: 13466 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.776292:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d28b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994301824:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.776337:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d289180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994301952:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.776373:0:13466:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:0.0:1746127007.777037:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10294 00000100:00100000:0.0:1746127007.777047:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991779584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.777071:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127007.777078:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 29 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.777086:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 29 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.777109:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c000/0x34dc807b6efa87b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538bc expref: 29 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.777172:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127007.777177:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127007.777290:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10295 00000100:00100000:3.0:1746127007.777297:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991779712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.777304:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.777309:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 13 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.777449:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127007.777455:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.777539:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991779584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 494us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.777546:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10294 00010000:00010000:3.0:1746127007.777872:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 13 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.777884:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e983a00/0x34dc807b6efa858 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538b5 expref: 13 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.777904:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.777907:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.777914:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.777919:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.777934:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127007.777942:0:13466:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127007.777948:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127007.777962:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991779712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 666us (2135us total) trans 0 rc 0/0 00000004:00200000:2.0:1746127007.777963:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:3.0:1746127007.777968:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10295 00010000:00010000:2.0:1746127007.778074:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665d800/0x34dc807b6efa8ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 13 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.778097:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 12 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.778106:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.778108:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127007.778110:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665ce00, rc 0) 00000100:00100000:2.0:1746127007.778146:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4465:x1830945991778688:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 12968us (14541us total) trans 8589938290 rc 0/0 00000100:00100000:2.0:1746127007.778151:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17331 00000100:00100000:0.0:1746127007.799291:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.799325:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.799353:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991779968 00000100:00100000:0.0:1746127007.799353:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.799361:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991779968 00000100:00100000:0.0:1746127007.799388:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:3.0:1746127007.799399:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880096630000 x1830945991779968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.799408:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630000 with x1830945991779968 ext(0->1048575) 00002000:00010000:3.0:1746127007.799412:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096630000 00000100:00100000:0.0:1746127007.799414:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991780224 00000100:00100000:0.0:1746127007.799417:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991780224 00000100:00100000:3.0:1746127007.799426:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991780480 00000100:00100000:3.0:1746127007.799428:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991780480 00002000:00100000:0.0:1746127007.799433:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880096632d80 x1830945991780224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.799437:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880096630a80 x1830945991780480/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.799440:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096632d80 with x1830945991780224 ext(1048576->2097151) 00002000:00100000:3.0:1746127007.799442:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630a80 with x1830945991780480 ext(1048576->2097151) 00002000:00010000:0.0:1746127007.799442:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096632d80 00002000:00010000:3.0:1746127007.799445:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096630a80 00000100:00100000:0.0:1746127007.799451:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991780736 00000100:00100000:0.0:1746127007.799453:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991780736 00000100:00100000:3.0:1746127007.799455:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8768 00000100:00100000:3.0:1746127007.799460:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991779968:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:0.0:1746127007.799460:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009d1b7b80 x1830945991780736/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.799465:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b7b80 with x1830945991780736 ext(1048576->2097151) 00002000:00010000:0.0:1746127007.799467:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b7b80 00000100:00100000:0.0:1746127007.799474:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8769 00000100:00100000:0.0:1746127007.799478:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991780224:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127007.800057:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8770 00000100:00100000:3.0:1746127007.800063:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991780480:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127007.800065:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8771 00000100:00100000:1.0:1746127007.800071:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991780736:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127007.810243:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.811730:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991780864 00000100:00100000:2.0:1746127007.811742:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991780864 00000100:00100000:2.0:1746127007.811808:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17332 00000100:00100000:2.0:1746127007.811819:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4465:x1830945991780864:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127007.811843:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.811862:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6efa8c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538f4 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.811919:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6efa8c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538f4 expref: 13 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.811931:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6efa8c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538f4 expref: 13 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.811952:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.811954:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127007.811958:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5800, rc 0) 00000100:00100000:2.0:1746127007.812006:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4465:x1830945991780864:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 188us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.812012:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17332 00000100:00100000:3.0:1746127007.813853:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.813936:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991781120 00000100:00100000:2.0:1746127007.813942:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991781120 00000100:00100000:2.0:1746127007.814004:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17333 00000100:00100000:2.0:1746127007.814010:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4471:x1830945991781120:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.814036:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.814105:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5e00/0x34dc807b6efa8cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e538fb expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.814173:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814187:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814196:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814211:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814216:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814221:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127007.814445:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991779968:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14983us (15160us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127007.814452:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8768 00002000:00100000:3.0:1746127007.814460:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880096630000 x1830945991779968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.814468:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630000 with x1830945991779968 ext(0->1048575) 00002000:00010000:3.0:1746127007.814472:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096630000 00010000:00010000:2.0:1746127007.814584:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814593:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814599:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127007.814607:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127007.814662:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814667:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814672:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814677:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129690200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127007.814681:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814686:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814696:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127007.814699:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127007.814702:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814707:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129690200/0x34dc807b6efa8d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814736:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814741:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814745:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814749:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129690c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127007.814752:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814757:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814763:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c81bd00) 00010000:00010000:2.0:1746127007.814765:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127007.814766:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814774:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129690c00/0x34dc807b6efa8dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127007.814806:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5e00/0x34dc807b6efa8cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.814817:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.814823:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.814825:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127007.814826:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129691c00, rc 0) 00000100:00100000:2.0:1746127007.814864:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4471:x1830945991781120:12345-192.168.203.42@tcp:101:cat.0 Request processed in 853us (1013us total) trans 8589938291 rc 0/0 00000100:00100000:2.0:1746127007.814869:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17333 00000100:00100000:1.0:1746127007.817419:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991780736:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17342us (18022us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127007.817429:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8771 00002000:00100000:1.0:1746127007.817439:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009d1b7b80 x1830945991780736/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.817447:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b7b80 with x1830945991780736 ext(1048576->2097151) 00002000:00010000:1.0:1746127007.817456:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b7b80 00000100:00100000:3.0:1746127007.831645:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991780480:12345-192.168.203.42@tcp:3:cat.0 Request processed in 31573us (32282us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127007.831656:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8770 00002000:00100000:3.0:1746127007.831668:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880096630a80 x1830945991780480/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.831677:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096630a80 with x1830945991780480 ext(1048576->2097151) 00002000:00010000:3.0:1746127007.831682:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096630a80 00000100:00100000:0.0:1746127007.845260:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.845351:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.845471:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991780224:12345-192.168.203.42@tcp:3:cat.0 Request processed in 45988us (46142us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127007.845481:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8769 00002000:00100000:1.0:1746127007.845490:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880096632d80 x1830945991780224/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.845498:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096632d80 with x1830945991780224 ext(1048576->2097151) 00002000:00010000:1.0:1746127007.845503:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096632d80 00000100:00100000:2.0:1746127007.846113:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991781632 00000100:00100000:2.0:1746127007.846123:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991781632 00000100:00100000:2.0:1746127007.846730:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991781760 00000100:00100000:3.0:1746127007.846736:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17334 00000100:00100000:2.0:1746127007.846736:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991781760 00000100:00100000:3.0:1746127007.846745:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4465:x1830945991781632:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127007.846763:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127007.846765:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17335 00010000:00010000:3.0:1746127007.846767:0:11634:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:2.0:1746127007.846771:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4468:x1830945991781760:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.846780:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.846789:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5800/0x34dc807b6efa8c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538f4 expref: 14 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.846793:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53909 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.846806:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.846810:0:11634:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127007.846815:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b600/0x34dc807b6efa8f9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53902 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.846838:0:7260:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.846840:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:3.0:1746127007.846875:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.847071:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.847077:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.847083:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:3.0:1746127007.847108:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.847122:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 15 pid: 7260 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.847158:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994302080:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.847228:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.847235:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 8 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.847242:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994302208:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.847262:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.847269:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 29 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.847275:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994302336:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.847289:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2540 going to sleep for 11 seconds 00010000:00010000:2.0:1746127007.847597:0:7260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 15 pid: 7260 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.847605:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 15 pid: 7260 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746127007.847624:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4800, rc 0) 00000100:00100000:2.0:1746127007.847659:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4468:x1830945991781760:12345-192.168.203.42@tcp:101:cat.0 Request processed in 887us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.847780:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.848287:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17335 00000100:00100000:1.0:1746127007.848496:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991781504 00000100:00100000:1.0:1746127007.848502:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991781504 00000100:00100000:1.0:1746127007.848542:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6618 00000100:00100000:1.0:1746127007.848548:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4471:x1830945991781504:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127007.848689:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4471:x1830945991781504:12345-192.168.203.42@tcp:35:cat.0 Request processed in 140us (908us total) trans 8589938292 rc 0/0 00000100:00100000:1.0:1746127007.848695:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6618 00000100:00100000:3.0:1746127007.854108:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994302080:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127007.854400:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.854426:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.855936:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991781888 00000100:00100000:2.0:1746127007.855945:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991781888 00000100:00100000:3.0:1746127007.857284:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b98700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994302208:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.857297:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994302336:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.857321:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:1.0:1746127007.857731:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.857764:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.857810:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782144 00000100:00100000:3.0:1746127007.857816:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782144 00010000:00010000:3.0:1746127007.857842:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 16 pid: 7260 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.857868:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782016 00000100:00100000:3.0:1746127007.857871:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782016 00000100:00100000:0.0:1746127007.857878:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10296 00010000:00010000:3.0:1746127007.857880:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 9 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.857888:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991782144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127007.857896:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10297 00010000:00010000:0.0:1746127007.857900:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127007.857901:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991782016:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.857906:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 16 pid: 7260 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.857908:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.857911:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 9 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.857916:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 16 pid: 7260 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.857929:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 9 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.858038:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.858051:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782400 00000100:00100000:1.0:1746127007.858054:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782400 00010000:00010000:1.0:1746127007.858069:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 31 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746127007.858091:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10298 00000100:00100000:1.0:1746127007.858096:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991782400:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127007.858102:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127007.858105:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 31 pid: 13448 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746127007.858261:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782272 00000100:00100000:2.0:1746127007.858266:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782272 00000100:00100000:2.0:1746127007.858288:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17336 00000100:00100000:2.0:1746127007.858294:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4468:x1830945991781888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.858312:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.858323:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53910 expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.858408:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4800/0x34dc807b6efa8f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53909 expref: 17 pid: 7260 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.858415:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35c000/0x34dc807b6efa83c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ae expref: 9 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746127007.858425:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127007.858429:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127007.858440:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127007.858445:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127007.858491:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991782144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 602us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.858499:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10296 00000100:00100000:0.0:1746127007.858522:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17337 00000100:00100000:0.0:1746127007.858527:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4471:x1830945991782272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127007.858536:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127007.858542:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bfc00/0x34dc807b6efa90e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53917 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.858598:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127007.858606:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 15 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.858611:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127007.858616:0:13466:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:0.0:1746127007.858628:0:13466:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127007.858645:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 15 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.858653:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 15 pid: 13466 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746127007.858662:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d1b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994302464:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.858698:0:13466:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746127007.858875:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 33 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.858887:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129691c00/0x34dc807b6efa8e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538fb expref: 33 pid: 13448 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746127007.858904:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.858907:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.858912:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127007.858918:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127007.858923:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127007.858928:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.858933:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.858950:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127007.858967:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991782400:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 871us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.858973:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10298 00010000:00010000:1.0:1746127007.859058:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127007.859064:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 11634 initiator: MDT0 00000040:00080000:1.0:1746127007.859265:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1408, 88 off131512 00000004:00080000:1.0:1746127007.859271:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901141082ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859289:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1425, 88 off133096 00000004:00080000:1.0:1746127007.859292:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901162437ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.859302:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1426, 88 off133184 00000004:00080000:1.0:1746127007.859305:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901175970ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.859312:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1409, 88 off131600 00000004:00080000:1.0:1746127007.859315:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901185370ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859321:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1410, 88 off131688 00000004:00080000:1.0:1746127007.859324:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901194877ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859330:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1427, 88 off133272 00000004:00080000:1.0:1746127007.859333:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901203507ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.859340:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1428, 88 off133360 00000004:00080000:1.0:1746127007.859342:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901212807ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.859357:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1429, 88 off133448 00000004:00080000:1.0:1746127007.859360:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901230657ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.859367:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1411, 88 off131776 00000004:00080000:1.0:1746127007.859369:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901239994ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859376:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1430, 88 off133536 00000004:00080000:1.0:1746127007.859379:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901249302ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.859386:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1412, 88 off131864 00000004:00080000:1.0:1746127007.859388:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901259172ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859395:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1431, 88 off133624 00000004:00080000:1.0:1746127007.859398:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901268470ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127007.859405:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1413, 88 off131952 00000004:00080000:1.0:1746127007.859407:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901277932ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859414:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1414, 88 off132040 00000004:00080000:1.0:1746127007.859417:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901287587ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859423:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1415, 88 off132128 00000004:00080000:1.0:1746127007.859426:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901296542ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859432:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1416, 88 off132216 00000004:00080000:1.0:1746127007.859435:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902901305779ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127007.859443:0:11634:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1432, 88 off133712 00000004:00080000:1.0:1746127007.859446:0:11634:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902901316549ns, next at 895431202182ns, rc = 0 00010000:00010000:3.0:1746127007.859616:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.859621:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.859627:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.859635:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.859639:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.859660:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991782016:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1757us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.859665:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10297 00010000:00010000:2.0:1746127007.859973:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.859984:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.859993:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.859996:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127007.859998:0:7260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 16 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.860004:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4c00, rc 0) 00000100:00100000:2.0:1746127007.860039:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4468:x1830945991781888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1744us (5640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.860044:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17336 00000100:00100000:0.0:1746127007.860626:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.863059:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782528 00000100:00100000:2.0:1746127007.863070:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782528 00000100:00100000:2.0:1746127007.863149:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17338 00000100:00100000:2.0:1746127007.863158:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4466:x1830945991782528:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127007.863176:0:7260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.863198:0:7260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5391e expref: -99 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.863251:0:7260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 33 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.863263:0:7260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 33 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.863273:0:7260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127007.863276:0:7260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127007.863280:0:7260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.863287:0:7260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5400, rc 0) 00000100:00100000:2.0:1746127007.863334:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4466:x1830945991782528:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 177us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.863340:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17338 00000100:00100000:1.0:1746127007.866389:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.866524:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d1b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994302464:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.866543:0:13466:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127007.866601:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782656 00000100:00100000:3.0:1746127007.866608:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782656 00010000:00010000:3.0:1746127007.866635:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 16 pid: 13466 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.866659:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10299 00000100:00100000:3.0:1746127007.866666:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991782656:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.866676:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.866681:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 16 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.866690:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 16 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.866708:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efa8b3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538c3 expref: 16 pid: 13466 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.866734:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.866738:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.866749:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.866755:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 15 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.866760:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127007.866765:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.866798:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991782656:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 132us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.866804:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10299 00000001:00080000:1.0:1746127007.867203:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938293 is committed 00000004:00080000:1.0:1746127007.867209:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1406 committed 00000004:00080000:1.0:1746127007.867225:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1390 committed 00000004:00080000:1.0:1746127007.867230:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1389 committed 00000004:00080000:1.0:1746127007.867232:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1388 committed 00000004:00080000:1.0:1746127007.867233:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1387 committed 00000004:00080000:1.0:1746127007.867234:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1405 committed 00000004:00080000:1.0:1746127007.867236:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1386 committed 00000004:00080000:1.0:1746127007.867237:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1404 committed 00000004:00080000:1.0:1746127007.867239:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1385 committed 00000004:00080000:1.0:1746127007.867240:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1403 committed 00000004:00080000:1.0:1746127007.867242:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1402 committed 00000004:00080000:1.0:1746127007.867243:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1401 committed 00000004:00080000:1.0:1746127007.867245:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1384 committed 00000004:00080000:1.0:1746127007.867247:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1383 committed 00000004:00080000:1.0:1746127007.867250:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1400 committed 00000004:00080000:1.0:1746127007.867251:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1399 committed 00000004:00080000:1.0:1746127007.867253:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1382 committed 00000001:00080000:1.0:1746127007.867257:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938292 is committed 00000001:00080000:1.0:1746127007.867281:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938286 is committed 00010000:00010000:1.0:1746127007.867398:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 11 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867405:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.867408:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746127007.867410:0:11634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.867416:0:11634:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.867421:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.867427:0:11634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 11 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867433:0:11634:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 11 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867439:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 11 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867444:0:11634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867450:0:11634:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867456:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867474:0:11634:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 29 pid: 7260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.867483:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994303616:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127007.867540:0:11634:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 11 pid: 7260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127007.867547:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994303744:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127007.867568:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f480 going to sleep for 11 seconds 00010000:00010000:1.0:1746127007.867579:0:13466:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.867583:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:1.0:1746127007.867623:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127007.867627:0:13466:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127007.867642:0:13466:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127007.867665:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bfc00/0x34dc807b6efa90e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 30 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867676:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 29 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.867682:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.867684:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746127007.867686:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967bf400, rc 0) 00000100:00100000:1.0:1746127007.867708:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4471:x1830945991782272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 9181us (9944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.867714:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17337 00000100:00100000:2.0:1746127007.867922:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994302848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.867951:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.867967:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994303360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.867979:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.867988:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.868000:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.868010:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.868032:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.868046:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746127007.868050:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994302720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.868064:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.868075:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994303232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.868085:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.868094:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.868118:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.868150:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127007.868164:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127007.868183:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994302848 00000100:00100000:2.0:1746127007.868187:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994302848 00000100:00100000:2.0:1746127007.868209:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994303360 00000100:00100000:2.0:1746127007.868210:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994303360 00000100:00100000:2.0:1746127007.868218:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304128 00000100:00100000:2.0:1746127007.868220:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304128 00000100:00100000:2.0:1746127007.868230:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304640 00000100:00100000:2.0:1746127007.868231:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304640 00000100:00100000:2.0:1746127007.868237:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994302720 00000100:00100000:2.0:1746127007.868239:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994302720 00000100:00100000:2.0:1746127007.868244:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994303232 00000100:00100000:2.0:1746127007.868246:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994303232 00000100:00100000:2.0:1746127007.868250:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304000 00000100:00100000:2.0:1746127007.868251:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304000 00000100:00100000:2.0:1746127007.868257:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304512 00000100:00100000:2.0:1746127007.868259:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304512 00000100:00100000:0.0:1746127007.868685:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994302976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.868709:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868719:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994303488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.868733:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868740:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.868752:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868759:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.868771:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868780:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746127007.868784:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994302592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.868798:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868806:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994303104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.868818:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868825:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994303872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.868837:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868844:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.868860:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.868879:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994302976 00000100:00100000:0.0:1746127007.868882:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994302976 00000100:00100000:0.0:1746127007.868896:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994303488 00000100:00100000:0.0:1746127007.868898:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994303488 00000100:00100000:0.0:1746127007.868904:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304256 00000100:00100000:0.0:1746127007.868905:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304256 00000100:00100000:0.0:1746127007.868910:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304768 00000100:00100000:0.0:1746127007.868912:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304768 00000100:00100000:0.0:1746127007.868916:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994302592 00000100:00100000:0.0:1746127007.868918:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994302592 00000100:00100000:0.0:1746127007.868922:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994303104 00000100:00100000:0.0:1746127007.868924:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994303104 00000100:00100000:0.0:1746127007.868929:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994303872 00000100:00100000:0.0:1746127007.868931:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994303872 00000100:00100000:0.0:1746127007.868937:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304384 00000100:00100000:0.0:1746127007.868938:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304384 00000100:00100000:0.0:1746127007.868946:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21876 00000100:00100000:0.0:1746127007.868950:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994302848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127007.869067:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127007.869070:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.869072:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.869073:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.869075:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746127007.869100:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994302848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (1148us total) trans 21474842899 rc 0/0 00000100:00100000:0.0:1746127007.869105:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21876 00000100:00100000:0.0:1746127007.869116:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21877 00000100:00100000:0.0:1746127007.869119:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994303360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127007.869176:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127007.869178:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127007.869180:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127007.869181:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127007.869183:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:0.0:1746127007.869201:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994303360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1220us total) trans 21474842900 rc 0/0 00000100:00100000:0.0:1746127007.869207:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21877 00000100:00100000:0.0:1746127007.869216:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21878 00000100:00100000:0.0:1746127007.869220:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3785:x1830945994304128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127007.869270:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127007.869273:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.869274:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.869276:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.869277:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746127007.869295:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994304128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1294us total) trans 17179875631 rc 0/0 00000100:00100000:0.0:1746127007.869300:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21878 00000100:00100000:0.0:1746127007.869309:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21879 00000100:00100000:0.0:1746127007.869313:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3785:x1830945994304640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.869361:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994304640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (1328us total) trans 17179875632 rc 0/0 00000100:00100000:0.0:1746127007.869365:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21879 00000100:00100000:0.0:1746127007.869373:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21880 00000100:00100000:0.0:1746127007.869376:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994302720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127007.869406:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127007.869409:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127005 -> 1746127005 00002000:00010000:0.0:1746127007.869410:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127003 -> 1746127003 00002000:00010000:0.0:1746127007.869412:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127005 -> 1746127005 00002000:00010000:0.0:1746127007.869413:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127007.869429:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994302720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (1364us total) trans 21474842901 rc 0/0 00000100:00100000:0.0:1746127007.869434:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21880 00000100:00100000:0.0:1746127007.869442:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21881 00000100:00100000:0.0:1746127007.869445:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994303232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.869495:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994303232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (1409us total) trans 21474842902 rc 0/0 00000100:00100000:0.0:1746127007.869499:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21881 00000100:00100000:0.0:1746127007.869507:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21882 00000100:00100000:0.0:1746127007.869511:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3785:x1830945994304000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127007.869545:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127007.869547:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127004 -> 1746127004 00002000:00010000:0.0:1746127007.869549:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127003 -> 1746127003 00002000:00010000:0.0:1746127007.869551:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127003 -> 1746127003 00002000:00010000:0.0:1746127007.869552:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746127007.869569:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994304000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (1451us total) trans 17179875633 rc 0/0 00000100:00100000:0.0:1746127007.869574:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21882 00000100:00100000:0.0:1746127007.869581:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21883 00000100:00100000:0.0:1746127007.869585:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994302976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127007.869621:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746127007.869623:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127007.869625:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127007.869626:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127007.869628:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:0.0:1746127007.869648:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3782:x1830945994302976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (938us total) trans 21474842903 rc 0/0 00000100:00100000:0.0:1746127007.869653:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21883 00000100:00100000:0.0:1746127007.869662:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21884 00000100:00100000:0.0:1746127007.869665:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994303488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127007.869700:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:0.0:1746127007.869702:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127007.869703:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127007.869705:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127007.869706:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:0.0:1746127007.869723:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3782:x1830945994303488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (989us total) trans 21474842904 rc 0/0 00000100:00100000:0.0:1746127007.869727:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21884 00000100:00100000:0.0:1746127007.869736:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21885 00000100:00100000:0.0:1746127007.869740:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3782:x1830945994304256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127007.869774:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127007.869776:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127007.869777:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:0.0:1746127007.869778:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127007.869780:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746127007.869796:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3782:x1830945994304256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (1043us total) trans 17179875634 rc 0/0 00000100:00100000:0.0:1746127007.869800:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21885 00000100:00100000:0.0:1746127007.869809:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21886 00000100:00100000:0.0:1746127007.869813:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3782:x1830945994304768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.869861:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3782:x1830945994304768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (1089us total) trans 17179875635 rc 0/0 00000100:00100000:0.0:1746127007.869866:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21886 00000100:00100000:0.0:1746127007.869874:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21887 00000100:00100000:0.0:1746127007.869878:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994302592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127007.869912:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127007.869914:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127004 -> 1746127004 00002000:00010000:0.0:1746127007.869916:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127004 -> 1746127004 00002000:00010000:0.0:1746127007.869918:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127004 -> 1746127004 00002000:00010000:0.0:1746127007.869919:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746127007.869935:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3782:x1830945994302592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1136us total) trans 21474842905 rc 0/0 00000100:00100000:0.0:1746127007.869939:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21887 00000100:00100000:0.0:1746127007.869948:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21888 00000100:00100000:0.0:1746127007.869951:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994303104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.869995:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3782:x1830945994303104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (1176us total) trans 21474842906 rc 0/0 00000100:00100000:0.0:1746127007.870000:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21888 00000100:00100000:0.0:1746127007.870008:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21889 00000100:00100000:0.0:1746127007.870012:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3782:x1830945994303872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127007.870057:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127007.870059:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.870061:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127003 -> 1746127003 00002000:00010000:0.0:1746127007.870063:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127007.870065:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127007.870083:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3782:x1830945994303872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1244us total) trans 17179875636 rc 0/0 00000100:00100000:0.0:1746127007.870088:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21889 00000100:00100000:0.0:1746127007.870097:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21890 00000100:00100000:0.0:1746127007.870101:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3782:x1830945994304384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.870173:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3782:x1830945994304384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1312us total) trans 17179875637 rc 0/0 00000100:00100000:0.0:1746127007.870178:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21890 00000004:00080000:0.0:1746127007.870211:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096631180/2, rc 0, transno 21474842905 00000100:00100000:0.0:1746127007.870221:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994302592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870229:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60700/2, rc 0, transno 21474842906 00000100:00100000:0.0:1746127007.870232:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994303104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870240:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a77480/2, rc 0, transno 17179875636 00000100:00100000:0.0:1746127007.870242:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994303872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.870248:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a74e00/2, rc 0, transno 17179875637 00000100:00100000:0.0:1746127007.870250:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.870255:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60000/2, rc 0, transno 21474842903 00000100:00100000:0.0:1746127007.870258:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994302976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870264:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a61880/2, rc 0, transno 21474842904 00000100:00100000:0.0:1746127007.870266:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994303488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870272:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a75180/2, rc 0, transno 17179875634 00000100:00100000:0.0:1746127007.870274:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.870279:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099196300/2, rc 0, transno 17179875635 00000100:00100000:0.0:1746127007.870281:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.870302:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096631c00/2, rc 0, transno 21474842901 00000100:00100000:0.0:1746127007.870305:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994302720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870310:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a62d80/2, rc 0, transno 21474842902 00000100:00100000:0.0:1746127007.870312:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994303232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870318:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a77b80/2, rc 0, transno 17179875633 00000100:00100000:0.0:1746127007.870321:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.870327:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a63480/2, rc 0, transno 21474842899 00000100:00100000:0.0:1746127007.870329:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994302848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870334:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60e00/2, rc 0, transno 21474842900 00000100:00100000:0.0:1746127007.870337:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994303360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127007.870343:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a74a80/2, rc 0, transno 17179875631 00000100:00100000:0.0:1746127007.870345:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127007.870350:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a75500/2, rc 0, transno 17179875632 00000100:00100000:0.0:1746127007.870352:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.870397:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746127007.870403:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.870424:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127007.870443:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994304896 00000100:00100000:0.0:1746127007.870448:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994304896 00000100:00100000:0.0:1746127007.870463:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21891 00000100:00100000:0.0:1746127007.870467:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3782:x1830945994304896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127007.870524:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3782:x1830945994304896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (100us total) trans 21474842907 rc 0/0 00000100:00100000:0.0:1746127007.870529:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21891 00000004:00080000:0.0:1746127007.870546:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cc9ca80/2, rc 0, transno 21474842907 00000100:00100000:0.0:1746127007.870549:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994304896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127007.870674:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21892 00000100:00100000:2.0:1746127007.870679:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994304512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127007.870728:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:2.0:1746127007.870730:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127007.870732:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127007.870734:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127007.870736:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:2.0:1746127007.870761:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994304512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (2596us total) trans 17179875638 rc 0/0 00000100:00100000:2.0:1746127007.870767:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21892 00000004:00080000:0.0:1746127007.872295:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a77800/2, rc 0, transno 17179875638 00000100:00100000:0.0:1746127007.872361:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994304512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127007.879105:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.879192:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.879537:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994303616:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127007.879551:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994303744:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127007.879583:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b600/0x34dc807b6efa8f9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 11 pid: 11634 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746127007.879603:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.880124:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3a200, rc 0) 00000100:00100000:1.0:1746127007.880183:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4465:x1830945991781632:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 33438us (34930us total) trans 8589938293 rc 0/0 00000100:00100000:1.0:1746127007.880190:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17334 00000100:00100000:2.0:1746127007.881416:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782784 00000100:00100000:2.0:1746127007.881426:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782784 00000100:00100000:2.0:1746127007.881459:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991782912 00000100:00100000:2.0:1746127007.881461:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991782912 00000100:00100000:2.0:1746127007.881477:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6619 00000100:00100000:2.0:1746127007.881483:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4466:x1830945991782784:12345-192.168.203.42@tcp:49:multiop.0 00000100:00100000:2.0:1746127007.881561:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4466:x1830945991782784:12345-192.168.203.42@tcp:49:multiop.0 Request processed in 78us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.881567:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6619 00000100:00100000:2.0:1746127007.881578:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6620 00000100:00100000:2.0:1746127007.881582:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4468:x1830945991782912:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:2.0:1746127007.881618:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4468:x1830945991782912:12345-192.168.203.42@tcp:49:cat.0 Request processed in 35us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.881623:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6620 00000100:00100000:0.0:1746127007.881811:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.884070:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.884092:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991783168 00000100:00100000:0.0:1746127007.884098:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991783168 00000100:00100000:0.0:1746127007.884152:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6621 00000100:00100000:0.0:1746127007.884159:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4465:x1830945991783168:12345-192.168.203.42@tcp:49:multiop.0 00000100:00100000:0.0:1746127007.884232:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4465:x1830945991783168:12345-192.168.203.42@tcp:49:multiop.0 Request processed in 74us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.884238:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6621 00000100:00100000:1.0:1746127007.884967:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991783040 00000100:00100000:1.0:1746127007.884973:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991783040 00000100:00100000:1.0:1746127007.885007:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17339 00000100:00100000:1.0:1746127007.885012:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4471:x1830945991783040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127007.885030:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127007.885044:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5996800/0x34dc807b6efa923 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53925 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.885077:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5996800/0x34dc807b6efa923 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53925 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.885086:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5996800/0x34dc807b6efa923 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53925 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127007.885096:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127007.885099:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746127007.885102:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5996800, rc 0) 00000100:00100000:1.0:1746127007.885151:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4471:x1830945991783040:12345-192.168.203.42@tcp:101:cat.0 Request processed in 138us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127007.885156:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17339 00000100:00100000:0.0:1746127007.895344:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.895425:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991783296 00000100:00100000:2.0:1746127007.895433:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991783296 00000100:00100000:2.0:1746127007.896056:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21893 00000100:00100000:2.0:1746127007.896065:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4466:x1830945991783296:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127007.896081:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.896097:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5392c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.896196:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.896203:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.896205:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.896208:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.896238:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.896249:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 19 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.896266:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994305024:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.897236:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c8480 going to sleep for 11 seconds 00010000:00010000:2.0:1746127007.900809:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746127007.907803:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994305024:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.907833:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.907849:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d1afa00, rc 0) 00000100:00100000:2.0:1746127007.907891:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4466:x1830945991783296:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 11827us (12555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.907900:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21893 00000100:00100000:2.0:1746127007.907961:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.910098:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991783424 00000100:00100000:0.0:1746127007.910108:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991783424 00010000:00010000:0.0:1746127007.910156:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 20 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.910194:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10300 00000100:00100000:0.0:1746127007.910201:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991783424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127007.910213:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127007.910228:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 20 pid: 1964 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.910239:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 20 pid: 1964 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.910262:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880076179600/0x34dc807b6efa890 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d8 expref: 20 pid: 1964 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.910445:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.910478:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.910492:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991783680 00000100:00100000:2.0:1746127007.910496:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991783680 00000100:00100000:1.0:1746127007.910580:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.910596:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991783936 00000100:00100000:1.0:1746127007.910599:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991783936 00002000:00100000:1.0:1746127007.910626:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094a61180 x1830945991783936/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.910634:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61180 with x1830945991783936 ext(1048576->2097151) 00002000:00010000:1.0:1746127007.910638:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a61180 00000100:00100000:1.0:1746127007.910650:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8772 00000100:00100000:1.0:1746127007.910655:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991783936:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127007.912231:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991783552 00000100:00100000:3.0:1746127007.912241:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991783552 00000100:00100000:3.0:1746127007.912284:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1029 00000100:00100000:3.0:1746127007.912291:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991783552:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.912302:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.912320:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5996800/0x34dc807b6efa923 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53925 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.912338:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127007.912342:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.912372:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991783552:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.912379:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1029 00010000:00010000:0.0:1746127007.912704:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.912707:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.912715:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 41 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.912723:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 41 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.912792:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 41 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127007.912804:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994305152:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127007.912860:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.912992:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21894 00000100:00100000:2.0:1746127007.913001:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4465:x1830945991783680:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127007.913014:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.913034:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53933 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.913053:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913063:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913065:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913067:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3579904->3903487] (req 3579904->3903487) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.913086:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 23 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913096:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 23 pid: 9611 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.913104:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994305280:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.913127:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.913180:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.913230:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.913244:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991784064 00000100:00100000:2.0:1746127007.913247:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991784064 00000100:00100000:2.0:1746127007.913265:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991784192 00000100:00100000:2.0:1746127007.913267:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991784192 00000100:00100000:2.0:1746127007.913284:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21895 00000100:00100000:2.0:1746127007.913289:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991784064:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.913297:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.913305:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5393a expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.913316:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913318:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913323:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913333:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 33 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913341:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158a00, rc 0) 00000100:00100000:2.0:1746127007.913357:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991784064:12345-192.168.203.42@tcp:101:cat.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.913363:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21895 00000100:00100000:2.0:1746127007.913374:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21896 00000100:00100000:2.0:1746127007.913378:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991784192:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.913384:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.913390:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53941 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.913400:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913401:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913405:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 43 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913413:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 43 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913419:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158600, rc 0) 00000100:00100000:2.0:1746127007.913435:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991784192:12345-192.168.203.42@tcp:101:cat.0 Request processed in 56us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.913443:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21896 00000100:00100000:2.0:1746127007.913482:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.913494:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991784320 00000100:00100000:2.0:1746127007.913496:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991784320 00000100:00100000:2.0:1746127007.913510:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21897 00000100:00100000:2.0:1746127007.913515:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991784320:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.913520:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.913526:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099158200/0x34dc807b6efa946 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53948 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127007.913546:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994305408:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127007.913579:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.913611:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.913623:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991784448 00000100:00100000:2.0:1746127007.913625:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991784448 00000100:00100000:2.0:1746127007.913639:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21898 00000100:00100000:2.0:1746127007.913643:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991784448:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.913648:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.913654:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5394f expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.913663:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913664:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913668:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 34 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913675:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 34 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913682:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159c00, rc 0) 00000100:00100000:2.0:1746127007.913697:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991784448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 54us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.913702:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21898 00000100:00100000:2.0:1746127007.913733:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.913742:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991784576 00000100:00100000:2.0:1746127007.913744:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991784576 00000100:00100000:2.0:1746127007.913758:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21899 00000100:00100000:2.0:1746127007.913762:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991784576:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.913767:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.913773:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53956 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.913782:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913783:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913786:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913794:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 35 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913800:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159400, rc 0) 00000100:00100000:2.0:1746127007.913815:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991784576:12345-192.168.203.42@tcp:101:cat.0 Request processed in 52us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.913820:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21899 00000100:00100000:2.0:1746127007.913891:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.913903:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991784704 00000100:00100000:2.0:1746127007.913905:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991784704 00000100:00100000:2.0:1746127007.913920:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21900 00000100:00100000:2.0:1746127007.913924:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991784704:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127007.913930:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127007.913936:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d1ae400/0x34dc807b6efa95b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5395d expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.913945:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.913951:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d1ae400/0x34dc807b6efa95b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5395d expref: 46 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913958:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d1ae400/0x34dc807b6efa95b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5395d expref: 46 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.913968:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d1ae400, rc 0) 00000100:00100000:2.0:1746127007.913982:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991784704:12345-192.168.203.42@tcp:101:cat.0 Request processed in 57us (90us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127007.913986:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21900 00000100:00100000:2.0:1746127007.923041:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994305152:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127007.923060:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.923788:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994305280:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.923811:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3579904->3903487] (req 3579904->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.923826:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159800, rc 0) 00000100:00100000:2.0:1746127007.924061:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991783424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 13858us (16097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.924071:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10300 00002000:00010000:2.0:1746127007.924139:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime: 1746127004 -> 1746127006 00002000:00010000:2.0:1746127007.924142:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746127003 -> 1746127006 00002000:00010000:2.0:1746127007.924145:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime: 1746127003 -> 1746127006 00000100:00100000:2.0:1746127007.924155:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994305408:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127007.924173:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099158200/0x34dc807b6efa946 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53948 expref: 44 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.924182:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099158200/0x34dc807b6efa946 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53948 expref: 44 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127007.924194:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158200, rc 0) 00000100:00100000:0.0:1746127007.924394:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.924423:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.924477:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991785088 00000100:00100000:0.0:1746127007.924483:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991785088 00002000:00100000:0.0:1746127007.924506:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (2023424->2027519) req@ffff88012cc9fb80 x1830945991785088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.924515:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9fb80 with x1830945991785088 ext(2023424->2027519) 00002000:00010000:0.0:1746127007.924518:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9fb80 00000100:00100000:0.0:1746127007.924534:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8773 00000100:00100000:0.0:1746127007.924540:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991785088:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127007.924619:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991785088:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 78us (195us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127007.924625:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8773 00002000:00100000:0.0:1746127007.924630:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (2023424->2027519) req@ffff88012cc9fb80 x1830945991785088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127007.924637:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9fb80 with x1830945991785088 ext(2023424->2027519) 00002000:00010000:0.0:1746127007.924640:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9fb80 00000100:00100000:3.0:1746127007.924942:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4465:x1830945991783680:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 11940us (14461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.924948:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21894 00000100:00100000:1.0:1746127007.925182:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991783936:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 14524us (14600us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127007.925189:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8772 00002000:00100000:1.0:1746127007.925194:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094a61180 x1830945991783936/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.925201:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61180 with x1830945991783936 ext(1048576->2097151) 00002000:00010000:1.0:1746127007.925204:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a61180 00000100:00100000:2.0:1746127007.925250:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991784320:12345-192.168.203.42@tcp:101:cat.0 Request processed in 11733us (11766us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127007.925256:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21897 00000100:00100000:2.0:1746127007.925273:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991784832 00000100:00100000:2.0:1746127007.925276:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991784832 00010000:00010000:2.0:1746127007.925291:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 20 pid: 9611 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746127007.925307:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10301 00000100:00100000:2.0:1746127007.925312:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991784832:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127007.925319:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127007.925328:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 20 pid: 9611 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.925337:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 20 pid: 9611 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.925357:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7b4400/0x34dc807b6efa8ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ed expref: 20 pid: 9611 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746127007.925366:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.925368:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127007.925372:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.925379:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.925402:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127007.925412:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994305536:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127007.925455:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.938358:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994305536:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127007.938379:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127007.938418:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991784832:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 13105us (14024us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127007.938428:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10301 00000100:00100000:1.0:1746127007.941675:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.941771:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991785344 00000100:00100000:2.0:1746127007.941780:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991785344 00002000:00100000:2.0:1746127007.941828:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3579904->3583999) req@ffff880094a61c00 x1830945991785344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.941838:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61c00 with x1830945991785344 ext(3579904->3583999) 00002000:00010000:2.0:1746127007.941843:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a61c00 00000100:00100000:2.0:1746127007.941874:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8774 00000100:00100000:2.0:1746127007.941881:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991785344:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127007.942067:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991785344:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 184us (397us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127007.942074:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8774 00002000:00100000:2.0:1746127007.942080:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3579904->3583999) req@ffff880094a61c00 x1830945991785344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127007.942086:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61c00 with x1830945991785344 ext(3579904->3583999) 00002000:00010000:2.0:1746127007.942089:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a61c00 00000100:00100000:2.0:1746127007.942648:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.942786:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991785472 00000100:00100000:0.0:1746127007.942790:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991785472 00000100:00100000:0.0:1746127007.944600:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21901 00000100:00100000:0.0:1746127007.944613:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4466:x1830945991785472:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127007.944628:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127007.944643:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53964 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.944668:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 17 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.944676:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.944682:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.944684:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127007.944687:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 36 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127007.944712:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.944723:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.944733:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994305664:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127007.946451:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 17 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127007.946463:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 17 pid: 12333 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746127007.946473:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994305792:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127007.947561:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127007.956250:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.956331:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991785600 00000100:00100000:3.0:1746127007.956340:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991785600 00000100:00100000:3.0:1746127007.956378:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21902 00000100:00100000:3.0:1746127007.956385:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4468:x1830945991785600:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127007.956400:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127007.956413:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5396b expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.956437:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.956443:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.956444:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127007.956447:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 20 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.956468:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.956477:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 42 pid: 12340 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746127007.956487:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994305920:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127007.956560:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127007.959542:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994305664:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127007.959553:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994305792:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127007.959576:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 36 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127007.959591:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9a00, rc 0) 00000100:00100000:2.0:1746127007.959624:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4466:x1830945991785472:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 15016us (16977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127007.959632:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21901 00000100:00100000:0.0:1746127007.962489:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127007.962531:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.963196:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991785856 00000100:00100000:2.0:1746127007.963203:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991785856 00010000:00010000:2.0:1746127007.963234:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 18 pid: 12333 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746127007.964626:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991785984 00000100:00100000:1.0:1746127007.964634:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991785984 00002000:00100000:1.0:1746127007.964669:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3899392->3903487) req@ffff88012cc9e300 x1830945991785984/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.964682:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9e300 with x1830945991785984 ext(3899392->3903487) 00002000:00010000:1.0:1746127007.964687:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9e300 00000100:00100000:1.0:1746127007.964705:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8775 00000100:00100000:1.0:1746127007.964712:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991785984:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127007.964825:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991785984:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 114us (2293us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127007.964832:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8775 00002000:00100000:1.0:1746127007.964837:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (3899392->3903487) req@ffff88012cc9e300 x1830945991785984/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:13/0 lens 488/4536 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.964843:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9e300 with x1830945991785984 ext(3899392->3903487) 00002000:00010000:1.0:1746127007.964845:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9e300 00000100:00100000:3.0:1746127007.965637:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10302 00000100:00100000:3.0:1746127007.965647:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991785856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127007.965662:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127007.965680:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 18 pid: 12333 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.965690:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 18 pid: 12333 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.965709:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caeaa00/0x34dc807b6efa89e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538df expref: 18 pid: 12333 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746127007.965746:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127007.965777:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991785856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 131us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.965782:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10302 00000100:00100000:0.0:1746127007.967875:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.967976:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994305920:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127007.968051:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 20 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127007.968081:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3aa00, rc 0) 00000100:00100000:3.0:1746127007.968156:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4468:x1830945991785600:12345-192.168.203.42@tcp:101:cat.0 Request processed in 11770us (11912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127007.968194:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21902 00000100:00100000:1.0:1746127007.968468:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991786368 00000100:00100000:1.0:1746127007.968475:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991786368 00002000:00100000:1.0:1746127007.968504:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012cc9ce00 x1830945991786368/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.968513:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9ce00 with x1830945991786368 ext(0->1048575) 00002000:00010000:1.0:1746127007.968517:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9ce00 00000100:00100000:1.0:1746127007.968532:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8776 00000100:00100000:1.0:1746127007.968538:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991786368:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127007.973457:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.974261:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.974282:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127007.974327:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127007.974340:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991786624 00000100:00100000:3.0:1746127007.974364:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991786624 00002000:00100000:3.0:1746127007.974406:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094a63800 x1830945991786624/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.974423:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a63800 with x1830945991786624 ext(1048576->2097151) 00002000:00010000:3.0:1746127007.974427:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a63800 00000100:00100000:3.0:1746127007.974456:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991786880 00000100:00100000:3.0:1746127007.974459:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991786880 00002000:00100000:3.0:1746127007.974469:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2023423) req@ffff880094a62a00 x1830945991786880/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.974485:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a62a00 with x1830945991786880 ext(1048576->2023423) 00000100:00100000:0.0:1746127007.974486:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991787136 00000100:00100000:0.0:1746127007.974491:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991787136 00010000:00010000:3.0:1746127007.974492:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 44 pid: 12340 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746127007.974516:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 44 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00100000:0.0:1746127007.974519:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094f14700 x1830945991787136/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746127007.974522:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a62a00 00002000:00100000:0.0:1746127007.974526:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14700 with x1830945991787136 ext(1048576->2097151) 00010000:00010000:0.0:1746127007.974530:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 38 pid: 12333 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746127007.974539:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 38 pid: 12333 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746127007.974542:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991786112 00000100:00100000:3.0:1746127007.974544:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991786112 00002000:00010000:0.0:1746127007.974544:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f14700 00000100:00100000:0.0:1746127007.974554:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1948 00000100:00100000:0.0:1746127007.974561:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991786880:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:3.0:1746127007.974565:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (2023424->2097151) req@ffff880094f14380 x1830945991786112/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/0 e 0 to 0 dl 1746127018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127007.974569:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14380 with x1830945991786112 ext(2023424->2097151) 00010000:00010000:3.0:1746127007.974573:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127007.974580:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127007.974592:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f14380 00000100:00100000:3.0:1746127007.974603:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1949 00000100:00100000:3.0:1746127007.974619:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991787136:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127007.975152:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1950 00000100:00100000:0.0:1746127007.975159:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991786112:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127007.975217:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8777 00000100:00100000:0.0:1746127007.975221:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2028:x1830945991786624:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127007.980234:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127007.980634:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991787392 00000100:00100000:2.0:1746127007.980643:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991787392 00000100:00100000:2.0:1746127007.980691:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6622 00000100:00100000:2.0:1746127007.980699:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4465:x1830945991787392:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127007.983555:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4465:x1830945991787392:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 2849us (3320us total) trans 8589938294 rc 0/0 00000100:00100000:2.0:1746127007.983565:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6622 00000100:00100000:1.0:1746127007.984883:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991786112:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9720us (10551us total) trans 17179875639 rc 0/0 00000100:00100000:1.0:1746127007.984894:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1950 00002000:00100000:1.0:1746127007.984903:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (2023424->2097151) req@ffff880094f14380 x1830945991786112/t17179875639(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/448 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.984911:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14380 with x1830945991786112 ext(2023424->2097151) 00010000:00010000:1.0:1746127007.984921:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 49 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127007.984932:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 49 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127007.984939:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f14380 00000100:00100000:1.0:1746127007.993833:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991786368:12345-192.168.203.42@tcp:3:cat.0 Request processed in 25286us (25955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127007.993845:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8776 00002000:00100000:1.0:1746127007.993856:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012cc9ce00 x1830945991786368/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127007.993864:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9ce00 with x1830945991786368 ext(0->1048575) 00002000:00010000:1.0:1746127007.993869:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9ce00 00000100:00100000:2.0:1746127008.004964:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2028:x1830945991786880:12345-192.168.203.42@tcp:3:cat.0 Request processed in 30396us (30696us total) trans 0 rc 974848/974848 00000100:00100000:2.0:1746127008.004988:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1948 00002000:00100000:2.0:1746127008.004999:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2023423) req@ffff880094a62a00 x1830945991786880/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 974848/974848 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.005007:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a62a00 with x1830945991786880 ext(1048576->2023423) 00010000:00010000:2.0:1746127008.005016:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 47 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.005036:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 47 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746127008.005042:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a62a00 00000100:00100000:3.0:1746127008.012878:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991787136:12345-192.168.203.42@tcp:3:cat.0 Request processed in 38258us (38583us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127008.012892:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1949 00002000:00100000:3.0:1746127008.012903:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094f14700 x1830945991787136/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.012912:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f14700 with x1830945991787136 ext(1048576->2097151) 00010000:00010000:3.0:1746127008.012922:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746127008.012936:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 1003 lvb_type: 1 00002000:00010000:3.0:1746127008.012942:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f14700 00000100:00100000:0.0:1746127008.015763:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.015994:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991786624:12345-192.168.203.42@tcp:3:cat.0 Request processed in 40765us (42538us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127008.016004:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8777 00002000:00100000:1.0:1746127008.016014:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880094a63800 x1830945991786624/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:13/0 lens 488/440 e 0 to 0 dl 1746127018 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.016038:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a63800 with x1830945991786624 ext(1048576->2097151) 00002000:00010000:1.0:1746127008.016043:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a63800 00000100:00100000:2.0:1746127008.016404:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991787520 00000100:00100000:2.0:1746127008.016412:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991787520 00010000:00010000:2.0:1746127008.016467:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00080000:3.0:1746127008.016799:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746127008.016982:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10303 00000100:00100000:2.0:1746127008.016990:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991787520:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.017004:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.017031:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.017042:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.017068:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d1afa00/0x34dc807b6efa92a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5392c expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.017085:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.017087:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.017093:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.017101:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.017238:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.017251:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994306048:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127008.017345:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.021175:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994306048:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.021199:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.021241:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991787520:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4251us (5486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.021251:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10303 00000100:00100000:0.0:1746127008.026481:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.026773:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991787776 00000100:00100000:1.0:1746127008.026783:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991787776 00000100:00100000:0.0:1746127008.026791:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:1.0:1746127008.026832:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88011dc63100 x1830945991787776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.026843:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63100 with x1830945991787776 ext(1048576->2097151) 00002000:00010000:1.0:1746127008.026852:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc63100 00000100:00100000:2.0:1746127008.026881:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991787904 00000100:00100000:2.0:1746127008.026885:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991787904 00000100:00100000:1.0:1746127008.026938:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8778 00010000:00010000:2.0:1746127008.026945:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746127008.026946:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991787776:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127008.026972:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10304 00000100:00100000:2.0:1746127008.026979:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991787904:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.026988:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.027006:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.027017:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.027050:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099159c00/0x34dc807b6efa94d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5394f expref: 36 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.027109:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.027111:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.027117:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.027126:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.027183:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.027195:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994306176:192.168.203.42@tcp:105: 00000100:00080000:3.0:1746127008.027236:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746127008.027549:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.030491:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.030601:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991788032 00000100:00100000:3.0:1746127008.030609:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991788032 00000100:00100000:3.0:1746127008.030651:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21903 00000100:00100000:3.0:1746127008.030658:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4471:x1830945991788032:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127008.030677:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.030695:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53972 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.030720:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.030721:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.030728:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.030743:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.030753:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e97400, rc 0) 00000100:00100000:3.0:1746127008.030795:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4471:x1830945991788032:12345-192.168.203.42@tcp:101:cat.0 Request processed in 137us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.030801:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21903 00000100:00100000:2.0:1746127008.040701:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994306176:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.040726:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.040792:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991787904:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 13813us (14000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.040802:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10304 00000100:00100000:0.0:1746127008.041578:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.041682:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991788288 00000100:00100000:3.0:1746127008.041690:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991788288 00002000:00100000:3.0:1746127008.041732:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88011dc62680 x1830945991788288/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.041741:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc62680 with x1830945991788288 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.041746:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc62680 00000100:00100000:3.0:1746127008.042009:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8779 00000100:00100000:3.0:1746127008.042016:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991788288:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.052420:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.052821:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991788544 00000100:00100000:2.0:1746127008.052830:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991788544 00002000:00100000:2.0:1746127008.052872:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1564672->1568767) req@ffff88011dc61c00 x1830945991788544/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.052882:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc61c00 with x1830945991788544 ext(1564672->1568767) 00002000:00010000:2.0:1746127008.052887:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc61c00 00000100:00100000:1.0:1746127008.053043:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991787776:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 26095us (26571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127008.053049:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8780 00000100:00100000:1.0:1746127008.053059:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8778 00002000:00100000:1.0:1746127008.053065:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88011dc63100 x1830945991787776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.053072:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63100 with x1830945991787776 ext(1048576->2097151) 00002000:00010000:1.0:1746127008.053075:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc63100 00000100:00100000:2.0:1746127008.053166:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991788544:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127008.053264:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991788544:12345-192.168.203.42@tcp:3:cat.0 Request processed in 208us (855us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127008.053269:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8780 00002000:00100000:2.0:1746127008.053274:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1564672->1568767) req@ffff88011dc61c00 x1830945991788544/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.053281:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc61c00 with x1830945991788544 ext(1564672->1568767) 00002000:00010000:2.0:1746127008.053283:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc61c00 00000100:00100000:3.0:1746127008.059265:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991788288:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17239us (17678us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127008.059281:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8779 00002000:00100000:3.0:1746127008.059291:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88011dc62680 x1830945991788288/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.059301:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc62680 with x1830945991788288 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.059306:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dc62680 00000100:00100000:0.0:1746127008.063508:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.063564:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991788672 00000100:00100000:2.0:1746127008.063572:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991788672 00000100:00100000:2.0:1746127008.063624:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21904 00000100:00100000:2.0:1746127008.063633:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4468:x1830945991788672:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.063653:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.063672:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53979 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.063703:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 34 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.063710:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.063712:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.063715:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.063747:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 34 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.063759:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 34 pid: 11152 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.063771:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994306304:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.063868:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.066250:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.066509:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991788928 00000100:00100000:2.0:1746127008.066518:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991788928 00000100:00100000:2.0:1746127008.066562:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6623 00000100:00100000:2.0:1746127008.066569:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4466:x1830945991788928:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127008.069353:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4466:x1830945991788928:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 2776us (3102us total) trans 8589938295 rc 0/0 00000100:00100000:2.0:1746127008.069369:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6623 00000100:00100000:1.0:1746127008.071636:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.073974:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991789184 00000100:00100000:3.0:1746127008.073987:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991789184 00002000:00100000:3.0:1746127008.074054:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1568768->2097151) req@ffff880094f15180 x1830945991789184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.074065:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f15180 with x1830945991789184 ext(1568768->2097151) 00010000:00010000:3.0:1746127008.074074:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 35 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.074090:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 35 pid: 11152 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.074098:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f15180 00000100:00100000:1.0:1746127008.074534:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.075006:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991789312 00000100:00100000:2.0:1746127008.075010:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991789312 00002000:00100000:2.0:1746127008.075040:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1568767) req@ffff880094f17800 x1830945991789312/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.075048:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f17800 with x1830945991789312 ext(1048576->1568767) 00010000:00010000:2.0:1746127008.075053:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 36 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.075063:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 36 pid: 11152 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746127008.075068:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f17800 00000100:00100000:2.0:1746127008.075090:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1951 00000100:00100000:2.0:1746127008.075097:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991789184:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127008.075577:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1952 00000100:00100000:3.0:1746127008.075584:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991789312:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127008.076833:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994306304:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127008.076863:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 18 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.076885:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9c600, rc 0) 00000100:00100000:1.0:1746127008.079643:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4468:x1830945991788672:12345-192.168.203.42@tcp:101:cat.0 Request processed in 16000us (16136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.079655:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21904 00000100:00100000:0.0:1746127008.080723:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.080891:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991789440 00000100:00100000:1.0:1746127008.080898:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991789440 00000100:00100000:1.0:1746127008.080942:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21905 00000100:00100000:1.0:1746127008.080949:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4471:x1830945991789440:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127008.080967:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.080984:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53980 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.081008:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127008.081014:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.081036:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 40 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.081046:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099191800, rc 0) 00000100:00100000:1.0:1746127008.081091:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4471:x1830945991789440:12345-192.168.203.42@tcp:101:cat.0 Request processed in 142us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.081096:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21905 00000100:00100000:3.0:1746127008.090508:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991789184:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15400us (18867us total) trans 0 rc 528384/528384 00000100:00100000:3.0:1746127008.090520:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1951 00002000:00100000:3.0:1746127008.090533:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1568768->2097151) req@ffff880094f15180 x1830945991789184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.090548:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f15180 with x1830945991789184 ext(1568768->2097151) 00010000:00010000:3.0:1746127008.090559:0:29585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.090574:0:29585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.090581:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f15180 00000100:00100000:3.0:1746127008.094347:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991789312:12345-192.168.203.42@tcp:4:cat.0 Request processed in 18756us (19806us total) trans 21474842908 rc 0/0 00000100:00100000:3.0:1746127008.094358:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1952 00002000:00100000:3.0:1746127008.094368:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1568767) req@ffff880094f17800 x1830945991789312/t21474842908(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.094377:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f17800 with x1830945991789312 ext(1048576->1568767) 00010000:00010000:3.0:1746127008.094385:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.094397:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.094403:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f17800 00000100:00100000:0.0:1746127008.096660:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.097575:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991789568 00000100:00100000:2.0:1746127008.097587:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991789568 00010000:00010000:2.0:1746127008.097633:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.098483:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10305 00000100:00100000:2.0:1746127008.098565:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991789568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.098582:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746127008.098601:0:10641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127005 -> 1746127006 00002000:00010000:2.0:1746127008.098603:0:10641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127005 -> 1746127006 00010000:00010000:2.0:1746127008.098610:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.098623:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.098647:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9a00/0x34dc807b6efa962 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53964 expref: 38 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.100243:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.100250:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.100264:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.100275:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.100286:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.100287:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.100290:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 37 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.100296:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 37 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.100341:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 37 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.100354:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994306432:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.100483:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 17 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.100491:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994306560:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127008.100512:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.108344:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994306432:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127008.108601:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.109155:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994306560:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.109185:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.109244:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991789568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10682us (12588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.109263:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10305 00000100:00100000:3.0:1746127008.109395:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991789824 00000100:00100000:3.0:1746127008.109402:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991789824 00002000:00100000:3.0:1746127008.109443:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cd66680 x1830945991789824/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.109458:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd66680 with x1830945991789824 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.109463:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd66680 00000100:00100000:3.0:1746127008.109480:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8781 00000100:00100000:3.0:1746127008.109486:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991789824:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.117158:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.117325:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991790080 00000100:00100000:2.0:1746127008.117336:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991790080 00002000:00100000:2.0:1746127008.117383:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cd64a80 x1830945991790080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.117397:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64a80 with x1830945991790080 ext(1048576->2097151) 00002000:00010000:2.0:1746127008.117403:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64a80 00000100:00100000:2.0:1746127008.117426:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8782 00000100:00100000:2.0:1746127008.117433:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991790080:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127008.117602:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.120987:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991790336 00000100:00100000:3.0:1746127008.121000:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991790336 00000100:00100000:3.0:1746127008.121065:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17340 00000100:00100000:3.0:1746127008.121074:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4475:x1830945991790336:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127008.121101:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.121120:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ba00/0x34dc807b6efa985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53987 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.121219:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121232:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121245:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121258:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121264:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121269:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121370:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121379:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121384:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:3.0:1746127008.121393:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127008.121465:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121471:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121477:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121482:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2a800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127008.121486:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121492:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121503:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127008.121506:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127008.121510:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121515:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efa98c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121543:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121549:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121553:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121556:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2ac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127008.121559:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121562:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121568:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829500) 00010000:00010000:3.0:1746127008.121569:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127008.121571:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121575:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efa993 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.121607:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ba00/0x34dc807b6efa985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 14 pid: 13466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.121616:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991789824:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12128us (13015us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746127008.121617:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 13 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.121623:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127008.121625:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1746127008.121626:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8781 00010000:00010000:3.0:1746127008.121628:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2aa00, rc 0) 00002000:00100000:2.0:1746127008.121635:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cd66680 x1830945991789824/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.121650:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd66680 with x1830945991789824 ext(1048576->2097151) 00000100:00100000:3.0:1746127008.121652:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4475:x1830945991790336:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 580us (4050us total) trans 8589938296 rc 0/0 00002000:00010000:2.0:1746127008.121654:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd66680 00000100:00100000:3.0:1746127008.121662:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17340 00000100:00100000:0.0:1746127008.132126:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.133290:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991790592 00000100:00100000:3.0:1746127008.133302:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991790592 00000100:00100000:2.0:1746127008.133317:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991790080:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 15880us (16165us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127008.133330:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8782 00002000:00100000:2.0:1746127008.133341:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009cd64a80 x1830945991790080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.133343:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009c5e1c00 x1830945991790592/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.133351:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1c00 with x1830945991790592 ext(2097152->3145727) 00002000:00100000:2.0:1746127008.133351:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd64a80 with x1830945991790080 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.133356:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e1c00 00002000:00010000:2.0:1746127008.133356:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd64a80 00000100:00100000:2.0:1746127008.133376:0:29585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8783 00000100:00100000:2.0:1746127008.133384:0:29585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991790592:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.146566:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.146600:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.146694:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991790848 00000100:00100000:1.0:1746127008.146707:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991790848 00000100:00100000:3.0:1746127008.146733:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991791104 00000100:00100000:3.0:1746127008.146741:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991791104 00002000:00100000:1.0:1746127008.146759:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009c5e1f80 x1830945991790848/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.146770:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1f80 with x1830945991790848 ext(2097152->4194303) 00002000:00100000:3.0:1746127008.146773:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c5e2d80 x1830945991791104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 504/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746127008.146775:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e1f80 00002000:00100000:3.0:1746127008.146782:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2d80 with x1830945991791104 ext(2097152->4194303) 00002000:00010000:3.0:1746127008.146786:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5e2d80 00000100:00100000:1.0:1746127008.146806:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8784 00000100:00100000:1.0:1746127008.146814:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991790848:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127008.146815:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8785 00000100:00100000:3.0:1746127008.146821:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991791104:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127008.148466:0:29585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991790592:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15080us (16343us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127008.148475:0:29585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8783 00002000:00100000:2.0:1746127008.148482:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009c5e1c00 x1830945991790592/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.148490:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1c00 with x1830945991790592 ext(2097152->3145727) 00002000:00010000:2.0:1746127008.148494:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e1c00 00000100:00100000:0.0:1746127008.156399:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.156572:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991791232 00000100:00100000:3.0:1746127008.156579:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991791232 00000100:00100000:3.0:1746127008.156630:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21906 00000100:00100000:3.0:1746127008.156638:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4471:x1830945991791232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127008.156653:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.156667:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5398e expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.156696:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 21 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.156702:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.156704:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.156706:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.156730:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 21 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.156740:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 21 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.156751:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994306688:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.157781:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.160961:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.161428:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991791360 00000100:00100000:1.0:1746127008.161436:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991791360 00000100:00100000:1.0:1746127008.161488:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17341 00000100:00100000:1.0:1746127008.161496:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4476:x1830945991791360:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127008.161875:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.161889:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efa9af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53995 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.162048:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162058:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162066:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162076:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162081:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162086:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162158:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162166:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162800:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746127008.162832:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127008.162836:0:11634:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127008.162849:0:11634:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162857:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162865:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162869:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162874:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162879:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162884:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a4c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.162886:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162892:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162900:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127008.162902:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.162905:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162910:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4c00/0x34dc807b6efa9b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162923:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162928:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162932:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162936:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944a5600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.162938:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162942:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162946:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a500) 00010000:00010000:1.0:1746127008.162948:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.162950:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162953:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5600/0x34dc807b6efa9bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.162977:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efa9af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.162987:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 7 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.162992:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.162994:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127008.162995:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a4000, rc 0) 00000100:00100000:1.0:1746127008.163053:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4476:x1830945991791360:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1557us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.163060:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17341 00000100:00100000:3.0:1746127008.165106:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994306688:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.165166:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.165180:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2ba00, rc 0) 00000100:00100000:3.0:1746127008.165221:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4471:x1830945991791232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8580us (8825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.165228:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21906 00000100:00100000:0.0:1746127008.166511:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.166699:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991790848:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19885us (20137us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127008.166709:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8784 00002000:00100000:1.0:1746127008.166718:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009c5e1f80 x1830945991790848/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.166727:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1f80 with x1830945991790848 ext(2097152->4194303) 00002000:00010000:1.0:1746127008.166731:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5e1f80 00000100:00100000:1.0:1746127008.166747:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991791488 00000100:00100000:1.0:1746127008.166752:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991791488 00002000:00100000:1.0:1746127008.166772:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3579904->3903487) req@ffff88009c5e1880 x1830945991791488/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.166778:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1880 with x1830945991791488 ext(3579904->3903487) 00010000:00010000:1.0:1746127008.166783:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 22 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.166795:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 22 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.166801:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1880 00000100:00100000:1.0:1746127008.166815:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1953 00000100:00100000:1.0:1746127008.166821:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991791488:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127008.173362:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991791104:12345-192.168.203.42@tcp:3:cat.0 Request processed in 26532us (26751us total) trans 0 rc 1773568/1773568 00000100:00100000:3.0:1746127008.173372:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8785 00002000:00100000:3.0:1746127008.173383:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c5e2d80 x1830945991791104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 504/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1773568/1773568 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.173392:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e2d80 with x1830945991791104 ext(2097152->4194303) 00010000:00010000:3.0:1746127008.173400:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 22 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.173412:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 22 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.173419:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e2d80 00000100:00100000:2.0:1746127008.175222:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.175467:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991791616 00000100:00100000:3.0:1746127008.175474:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991791616 00000100:00080000:2.0:1746127008.175519:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746127008.175522:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21907 00000100:00100000:3.0:1746127008.175528:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991791616:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127008.175543:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.175555:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5399c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.175573:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.175575:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.175581:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.175592:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.175605:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2b000, rc 0) 00000100:00100000:3.0:1746127008.175643:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991791616:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 114us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.175648:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21907 00000100:00100000:1.0:1746127008.176217:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.176257:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.176288:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.176302:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.176315:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.176360:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991791744 00000100:00100000:2.0:1746127008.176364:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991791744 00000100:00100000:1.0:1746127008.176364:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.176381:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991791872 00000100:00100000:2.0:1746127008.176383:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991791872 00000100:00100000:1.0:1746127008.176386:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991792000 00000100:00100000:2.0:1746127008.176389:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991792128 00000100:00100000:2.0:1746127008.176390:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991792128 00000100:00100000:1.0:1746127008.176390:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991792000 00000100:00100000:2.0:1746127008.176395:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991792256 00000100:00100000:2.0:1746127008.176396:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991792256 00000100:00100000:1.0:1746127008.176413:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991792384 00000100:00100000:1.0:1746127008.176415:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991792384 00000100:00100000:2.0:1746127008.176484:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21908 00000100:00100000:2.0:1746127008.176491:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991791744:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127008.176498:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127008.176501:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21909 00000100:00100000:1.0:1746127008.176509:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991791872:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127008.176512:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539a3 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.176521:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.176522:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.176526:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.176533:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.176537:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b83600, rc 0) 00000100:00100000:2.0:1746127008.176553:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991791744:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 63us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.176557:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21908 00000100:00100000:2.0:1746127008.176563:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21910 00000100:00100000:2.0:1746127008.176566:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991792128:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127008.176570:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.176574:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539b8 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.176582:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.176583:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.176585:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.176591:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.176595:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82e00, rc 0) 00000100:00100000:2.0:1746127008.176602:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991792128:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.176605:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21910 00000100:00100000:2.0:1746127008.176609:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21911 00000100:00100000:2.0:1746127008.176612:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991792000:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127008.176614:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.176617:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539b1 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.176623:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.176624:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.176627:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.176631:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.176638:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82800, rc 0) 00000100:00100000:2.0:1746127008.176645:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991792000:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.176648:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21911 00000100:00100000:2.0:1746127008.176653:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21912 00000100:00100000:2.0:1746127008.176656:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991792256:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127008.176659:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.176662:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82600/0x34dc807b6efa9e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539bf expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.176686:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994306816:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127008.176715:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.176726:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21913 00000100:00100000:2.0:1746127008.176729:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4468:x1830945991792384:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.176733:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.176736:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539c6 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.176744:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.176746:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.176751:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.176758:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82a00, rc 0) 00000100:00100000:2.0:1746127008.176765:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4468:x1830945991792384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 36us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.176768:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21913 00010000:00010000:1.0:1746127008.176870:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.176879:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539aa expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.176891:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127008.176892:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127008.176898:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127008.176908:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127008.176920:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5400, rc 0) 00000100:00100000:1.0:1746127008.176949:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991791872:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 437us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.176955:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21909 00000100:00100000:1.0:1746127008.180209:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991791488:12345-192.168.203.42@tcp:4:cat.0 Request processed in 13379us (13694us total) trans 17179875640 rc 0/0 00000100:00100000:1.0:1746127008.180221:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1953 00002000:00100000:1.0:1746127008.180233:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3579904->3903487) req@ffff88009c5e1880 x1830945991791488/t17179875640(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.180242:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5e1880 with x1830945991791488 ext(3579904->3903487) 00010000:00010000:1.0:1746127008.180250:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.180264:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.180271:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5e1880 00000100:00100000:2.0:1746127008.181984:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994306816:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127008.182009:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82600/0x34dc807b6efa9e7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539bf expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.182033:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82600/0x34dc807b6efa9e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539bf expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.182056:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82600, rc 0) 00000100:00100000:2.0:1746127008.182086:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991792256:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5427us (5769us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127008.182094:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21912 00000100:00100000:0.0:1746127008.185982:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.186202:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991792512 00000100:00100000:3.0:1746127008.186211:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991792512 00010000:00010000:3.0:1746127008.186242:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.186277:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10306 00000100:00100000:3.0:1746127008.186285:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991792512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.186297:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.186311:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.186321:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.186339:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099159800/0x34dc807b6efa931 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3579904->3903487) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53933 expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.186361:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.186363:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.186368:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.186380:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.186387:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.186388:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.186390:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 22 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.186395:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 22 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.186419:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 22 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.186430:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994306944:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127008.186492:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.186500:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994307072:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127008.186580:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.186942:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.187001:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991792768 00000100:00100000:1.0:1746127008.187005:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991792768 00000100:00100000:1.0:1746127008.187090:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17342 00000100:00100000:1.0:1746127008.187097:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4476:x1830945991792768:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127008.187111:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.187123:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa9fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539cd expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.187542:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.187554:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 29 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.187561:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 12 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.187567:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.187574:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.187592:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.187602:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 8 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.187610:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307200:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127008.187722:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 12 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.187731:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 12 pid: 13466 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.187743:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307328:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127008.187770:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 29 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.187777:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 29 pid: 13466 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.187784:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307456:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127008.187800:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127008.192626:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994307072:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127008.192806:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.192829:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991792896 00000100:00100000:1.0:1746127008.192838:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991792896 00010000:00010000:1.0:1746127008.192875:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.192886:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994306944:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127008.192902:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127008.192916:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10307 00000100:00100000:1.0:1746127008.192922:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991792896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127008.192933:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991792512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6648us (6957us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127008.192938:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127008.192940:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10306 00010000:00010000:1.0:1746127008.192943:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.192951:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.192973:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.192977:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.192985:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.192990:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.192993:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.193011:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991793152 00000100:00100000:2.0:1746127008.193025:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991793152 00010000:00010000:2.0:1746127008.193040:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 30 pid: 13466 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746127008.193055:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4000/0x34dc807b6efa9c4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53995 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.193058:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10308 00000100:00100000:2.0:1746127008.193064:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991793152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127008.193065:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127008.193071:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.193076:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 30 pid: 13466 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.193079:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.193079:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307200:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.193084:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 30 pid: 13466 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746127008.193088:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307328:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.193093:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127008.193094:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.193097:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.193102:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967bf400/0x34dc807b6efa915 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53917 expref: 30 pid: 13466 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.193103:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.193107:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127008.193110:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307456:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.193122:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.193143:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991793152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 63us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.193149:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10308 00010000:00010000:0.0:1746127008.193150:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000100:00100000:2.0:1746127008.193159:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991793024 00000100:00100000:2.0:1746127008.193161:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991793024 00010000:00010000:2.0:1746127008.193170:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 13 pid: 13466 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.193174:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991793664 00000100:00100000:3.0:1746127008.193177:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991793664 00000100:00100000:2.0:1746127008.193190:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10309 00000100:00100000:2.0:1746127008.193195:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991793024:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.193201:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127008.193203:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991793792 00010000:00010000:2.0:1746127008.193205:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 13 pid: 13466 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746127008.193206:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991793792 00010000:00010000:2.0:1746127008.193212:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 13 pid: 13466 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.193226:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efa99a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53987 expref: 13 pid: 13466 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.193236:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.193239:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00002000:00100000:0.0:1746127008.193242:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a5b98e00 x1830945991793792/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127008.193245:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.193250:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 11634 initiator: MDT0 00002000:00100000:0.0:1746127008.193256:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98e00 with x1830945991793792 ext(2097152->4194303) 00002000:00010000:0.0:1746127008.193260:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b98e00 00010000:00010000:2.0:1746127008.193264:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127008.193271:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991793920 00000100:00100000:0.0:1746127008.193274:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991793920 00002000:00100000:3.0:1746127008.193394:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a5b99880 x1830945991793664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.193401:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99880 with x1830945991793664 ext(2097152->4194303) 00002000:00010000:3.0:1746127008.193404:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b99880 00002000:00100000:0.0:1746127008.193528:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800a5b98700 x1830945991793920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127008.193535:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98700 with x1830945991793920 ext(3145728->4194303) 00002000:00010000:0.0:1746127008.193538:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b98700 00000100:00100000:0.0:1746127008.193552:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8786 00000100:00100000:0.0:1746127008.193558:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991793792:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127008.193733:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8787 00000100:00100000:3.0:1746127008.193739:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991793664:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127008.193956:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991793024:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 759us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.193962:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10309 00000100:00100000:2.0:1746127008.193982:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8788 00000100:00100000:2.0:1746127008.193988:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991793920:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127008.194116:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991792896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1191us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.194122:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10307 00010000:00010000:0.0:1746127008.194820:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.194828:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:0.0:1746127008.194843:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127008.194938:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a5a00/0x34dc807b6efa9fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.194951:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.194958:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127008.194960:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746127008.194963:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a4600, rc 0) 00000100:00100000:0.0:1746127008.194983:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4476:x1830945991792768:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7887us (8042us total) trans 8589938297 rc 0/0 00000100:00100000:0.0:1746127008.194989:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17342 00000100:00100000:3.0:1746127008.203106:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991793920:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9110us (9976us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127008.203116:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8788 00002000:00100000:3.0:1746127008.203125:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff8800a5b98700 x1830945991793920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.203152:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98700 with x1830945991793920 ext(3145728->4194303) 00002000:00010000:3.0:1746127008.203157:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b98700 00000100:00100000:0.0:1746127008.209971:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.210159:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991794048 00000100:00100000:2.0:1746127008.210183:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991793792:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16623us (17100us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127008.210192:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8786 00002000:00100000:2.0:1746127008.210202:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a5b98e00 x1830945991793792/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.210210:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98e00 with x1830945991793792 ext(2097152->4194303) 00002000:00010000:2.0:1746127008.210215:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b98e00 00000100:00100000:1.0:1746127008.210259:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991794048 00000100:00100000:1.0:1746127008.210308:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17343 00000100:00100000:1.0:1746127008.210315:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4476:x1830945991794048:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127008.210337:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.210351:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea000/0x34dc807b6efaa11 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539d4 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.210415:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.210427:0:11634:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.210433:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.210455:0:11634:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.210464:0:11634:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.210478:0:11634:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307584:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127008.210525:0:11634:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.215249:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.215322:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991794176 00000100:00100000:2.0:1746127008.215334:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991794176 00010000:00010000:2.0:1746127008.215371:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 10 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.215417:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10310 00000100:00100000:2.0:1746127008.215422:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991794176:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.215433:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.215436:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 10 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.215444:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 10 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.215459:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.215465:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.215471:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.215475:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.215486:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.215519:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991794176:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.215523:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10310 00010000:00010000:1.0:1746127008.215574:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944a4600/0x34dc807b6efaa03 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539cd expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.215598:0:11634:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11634:1830945994307584:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127008.215619:0:11634:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.215629:0:11634:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.215634:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746127008.215684:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127008.215688:0:11634:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127008.215704:0:11634:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.215737:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea000/0x34dc807b6efaa11 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 9 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.215750:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.215758:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.215761:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127008.215764:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb800, rc 0) 00000100:00100000:1.0:1746127008.215811:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4476:x1830945991794048:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5496us (5846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.215818:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17343 00000100:00100000:3.0:1746127008.216982:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991793664:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23238us (23912us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127008.216991:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8787 00002000:00100000:3.0:1746127008.217001:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a5b99880 x1830945991793664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.217009:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b99880 with x1830945991793664 ext(2097152->4194303) 00002000:00010000:3.0:1746127008.217013:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b99880 00000100:00100000:0.0:1746127008.218225:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.218472:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991794304 00000100:00100000:2.0:1746127008.218480:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991794304 00000100:00100000:2.0:1746127008.218529:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21914 00000100:00100000:2.0:1746127008.218535:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991794304:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127008.218552:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.218571:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539db expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.218592:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.218594:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.218604:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.218618:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.218627:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc000, rc 0) 00000100:00100000:2.0:1746127008.218658:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991794304:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 123us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.218663:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21914 00000100:00100000:0.0:1746127008.220012:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.220081:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991794560 00000100:00100000:1.0:1746127008.220087:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991794560 00000100:00100000:3.0:1746127008.220288:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17344 00000100:00100000:3.0:1746127008.220297:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4476:x1830945991794560:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127008.220322:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.220337:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efaa26 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539e2 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.220432:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220445:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220455:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220466:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220471:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220488:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220493:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2ac00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127008.220497:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220506:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220515:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127008.220518:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127008.220520:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220524:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2ac00/0x34dc807b6efaa2d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.220560:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efaa26 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e2 expref: 9 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.220566:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efaa26 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e2 expref: 9 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.220573:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2b200, rc 0) 00000100:00100000:3.0:1746127008.220608:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4476:x1830945991794560:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 312us (598us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127008.220612:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17344 00000100:00100000:0.0:1746127008.223221:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.223414:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991794816 00000100:00100000:3.0:1746127008.223422:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991794816 00002000:00100000:3.0:1746127008.223561:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801303d2680 x1830945991794816/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.223570:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d2680 with x1830945991794816 ext(4194304->4829183) 00002000:00010000:3.0:1746127008.223575:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d2680 00000100:00100000:3.0:1746127008.223604:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8789 00000100:00100000:3.0:1746127008.223612:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991794816:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.225718:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.225920:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991795072 00000100:00100000:2.0:1746127008.225929:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991795072 00002000:00100000:2.0:1746127008.225969:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801303d1500 x1830945991795072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.225979:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d1500 with x1830945991795072 ext(4194304->4829183) 00002000:00010000:2.0:1746127008.225986:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d1500 00000100:00100000:2.0:1746127008.226026:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8790 00000100:00100000:2.0:1746127008.226033:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991795072:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.226092:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.226146:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991795328 00000100:00100000:3.0:1746127008.226150:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991795328 00000100:00100000:3.0:1746127008.226192:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6624 00000100:00100000:3.0:1746127008.226197:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4476:x1830945991795328:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1746127008.226669:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4476:x1830945991795328:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 470us (575us total) trans 8589938298 rc 0/0 00000100:00100000:3.0:1746127008.226676:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6624 00000100:00100000:3.0:1746127008.227899:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991794816:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4284us (4682us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127008.227907:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8789 00002000:00100000:3.0:1746127008.227915:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801303d2680 x1830945991794816/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.227924:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d2680 with x1830945991794816 ext(4194304->4829183) 00002000:00010000:3.0:1746127008.227929:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d2680 00000100:00100000:2.0:1746127008.231066:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991795072:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5022us (5346us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127008.231078:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8790 00002000:00100000:2.0:1746127008.231089:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801303d1500 x1830945991795072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.231098:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d1500 with x1830945991795072 ext(4194304->4829183) 00002000:00010000:2.0:1746127008.231104:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d1500 00000100:00100000:0.0:1746127008.250362:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.251294:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991795456 00000100:00100000:2.0:1746127008.251306:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991795456 00000100:00100000:2.0:1746127008.251443:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21915 00000100:00100000:2.0:1746127008.251452:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4475:x1830945991795456:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127008.251472:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.251490:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539e9 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.251519:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.251527:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 9 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.251535:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.251541:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.251543:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.251546:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1277952->2097151] (req 1277952->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.251580:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.251591:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.251604:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994307712:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.251758:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 9 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.251767:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 9 pid: 1964 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.251775:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994307840:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.251803:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.251810:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.251818:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994307968:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.251836:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.253631:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994307712:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.253783:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994307840:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.253791:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994307968:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.253817:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1277952->2097151] (req 1277952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.253832:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc800, rc 0) 00000100:00100000:2.0:1746127008.253867:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4475:x1830945991795456:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2416us (3517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.253875:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21915 00000100:00100000:0.0:1746127008.254575:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.254880:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991795584 00000100:00100000:3.0:1746127008.255355:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991795584 00010000:00010000:3.0:1746127008.255385:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 10 pid: 1964 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746127008.255422:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10311 00000100:00100000:3.0:1746127008.255429:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991795584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.255442:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.255461:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 10 pid: 1964 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746127008.255477:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 10 pid: 1964 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746127008.255500:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944a5400/0x34dc807b6efa9f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539aa expref: 10 pid: 1964 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746127008.255519:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.255561:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991795584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 132us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.255567:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10311 00000100:00100000:0.0:1746127008.256447:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.256484:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991795712 00000100:00100000:2.0:1746127008.256488:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991795712 00010000:00010000:2.0:1746127008.256507:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.256536:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10312 00000100:00100000:2.0:1746127008.256543:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991795712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.256551:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.256562:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.256570:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.256584:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97400/0x34dc807b6efa970 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53972 expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.256614:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.256647:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991795712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.256653:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10312 00000100:00100000:0.0:1746127008.257913:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.257982:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991795840 00000100:00100000:3.0:1746127008.257987:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991795840 00010000:00010000:3.0:1746127008.258008:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.258252:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10313 00000100:00100000:3.0:1746127008.258259:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991795840:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.258269:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.258281:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.258291:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.258307:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efa969 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5396b expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.258318:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.258320:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.258327:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 22 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.258335:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 22 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.258365:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 22 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.258377:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994308096:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127008.259056:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1746127008.260400:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994308096:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127008.260419:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.260472:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991795840:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2211us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.260482:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10313 00000100:00100000:0.0:1746127008.260882:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.261003:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991796096 00000100:00100000:2.0:1746127008.261010:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991796096 00002000:00100000:2.0:1746127008.261064:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1277952->1282047) req@ffff8801303d1f80 x1830945991796096/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.261073:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d1f80 with x1830945991796096 ext(1277952->1282047) 00002000:00010000:2.0:1746127008.261078:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801303d1f80 00000100:00100000:2.0:1746127008.261101:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8791 00000100:00100000:2.0:1746127008.261108:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991796096:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127008.261270:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991796096:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 161us (388us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127008.261276:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8791 00002000:00100000:2.0:1746127008.261281:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1277952->1282047) req@ffff8801303d1f80 x1830945991796096/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.261289:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d1f80 with x1830945991796096 ext(1277952->1282047) 00002000:00010000:2.0:1746127008.261291:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801303d1f80 00000100:00100000:0.0:1746127008.272089:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.273179:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991796224 00000100:00100000:2.0:1746127008.273190:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991796224 00000100:00100000:3.0:1746127008.273364:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21916 00000100:00100000:3.0:1746127008.273373:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4475:x1830945991796224:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127008.273392:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.273412:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539f0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.273442:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.273452:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.273459:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 36 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.273465:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.273467:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.273471:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->1134591] (req 1048576->1134591) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 19 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.273504:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 36 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.273516:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 36 pid: 11152 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.273529:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308224:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.273844:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.273853:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 10 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746127008.273861:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308352:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.273908:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 19 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.273915:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 19 pid: 11152 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.273923:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308480:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.273941:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.276034:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.276098:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991796352 00000100:00100000:2.0:1746127008.276106:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991796352 00010000:00010000:2.0:1746127008.276171:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 11 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746127008.276176:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308224:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.276185:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308352:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.276192:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308480:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.276197:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10314 00000100:00100000:2.0:1746127008.276204:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991796352:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.276213:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.276219:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [1048576->1134591] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 19 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.276232:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2a800, rc 0) 00010000:00010000:2.0:1746127008.276236:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 11 pid: 3148 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.276244:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 11 pid: 3148 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.276264:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efa9e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b1 expref: 11 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746127008.276284:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4475:x1830945991796224:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2911us (4716us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127008.276289:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.276290:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21916 00000100:00100000:2.0:1746127008.276308:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991796352:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.276313:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10314 00000100:00100000:0.0:1746127008.277094:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.277351:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.277368:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991796480 00000100:00100000:2.0:1746127008.277372:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991796480 00010000:00010000:2.0:1746127008.277389:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 37 pid: 11152 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.277389:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991796608 00000100:00100000:1.0:1746127008.277394:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991796608 00010000:00010000:1.0:1746127008.277410:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 19 pid: 11152 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.277425:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10315 00000100:00100000:2.0:1746127008.277431:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991796480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.277439:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127008.277439:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10316 00000100:00100000:1.0:1746127008.277445:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991796608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.277448:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 37 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.277453:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.277457:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 37 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.277472:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 19 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.277482:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 19 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.277497:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9c600/0x34dc807b6efa977 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53979 expref: 19 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.277520:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127008.277548:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991796608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 102us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.277554:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10316 00010000:00010000:2.0:1746127008.277657:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099191800/0x34dc807b6efa97e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53980 expref: 37 pid: 11152 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.277667:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.277669:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.277675:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.277683:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.277712:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.277725:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994308608:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127008.277789:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.280493:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994308608:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.280511:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.280547:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991796480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3115us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.280557:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10315 00000100:00100000:0.0:1746127008.280724:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.280838:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991796864 00000100:00100000:3.0:1746127008.280845:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991796864 00002000:00100000:3.0:1746127008.280880:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1130496->1134591) req@ffff8801303d0380 x1830945991796864/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.280889:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0380 with x1830945991796864 ext(1130496->1134591) 00002000:00010000:3.0:1746127008.280894:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0380 00000100:00100000:3.0:1746127008.280908:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8792 00000100:00100000:3.0:1746127008.280913:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991796864:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127008.281034:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991796864:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 120us (310us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127008.281040:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8792 00002000:00100000:3.0:1746127008.281045:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1130496->1134591) req@ffff8801303d0380 x1830945991796864/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.281053:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d0380 with x1830945991796864 ext(1130496->1134591) 00002000:00010000:3.0:1746127008.281056:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801303d0380 00000100:00100000:0.0:1746127008.282532:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.282610:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991797120 00000100:00100000:3.0:1746127008.282617:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991797120 00000100:00100000:3.0:1746127008.282649:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6625 00000100:00100000:3.0:1746127008.282655:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4475:x1830945991797120:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127008.282955:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4475:x1830945991797120:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 298us (426us total) trans 8589938299 rc 0/0 00000100:00100000:3.0:1746127008.282962:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6625 00000100:00100000:0.0:1746127008.294973:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.295179:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991797376 00000100:00100000:1.0:1746127008.295189:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991797376 00000100:00100000:1.0:1746127008.295959:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17345 00000100:00100000:1.0:1746127008.295970:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4482:x1830945991797376:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127008.295998:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.296032:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6efaa42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539f7 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.296110:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296206:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296218:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296231:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296236:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296241:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296332:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296339:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296343:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746127008.296354:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127008.296601:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296607:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296612:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296616:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296621:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995ea800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.296624:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296629:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296638:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127008.296641:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.296644:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296648:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea800/0x34dc807b6efaa49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296674:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296679:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296687:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296691:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995ea200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.296693:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296698:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296703:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a500) 00010000:00010000:1.0:1746127008.296705:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.296707:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296711:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea200/0x34dc807b6efaa50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.296745:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eae00/0x34dc807b6efaa42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 32 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.296757:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 31 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.297000:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.297002:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127008.297005:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ebe00, rc 0) 00000100:00100000:1.0:1746127008.297422:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4482:x1830945991797376:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1453us (2455us total) trans 8589938300 rc 0/0 00000100:00100000:1.0:1746127008.297429:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17345 00000100:00100000:0.0:1746127008.304197:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.304316:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991797504 00000100:00100000:3.0:1746127008.304325:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991797504 00000100:00100000:3.0:1746127008.304379:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21917 00000100:00100000:3.0:1746127008.304386:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4482:x1830945991797504:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127008.304404:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.304423:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e539fe expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.304459:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.304467:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.304469:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.304473:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1421312->1490943] (req 1421312->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 37 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.304759:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.304772:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 17 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.304785:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308736:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.306101:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.307643:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.307692:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991797632 00000100:00100000:1.0:1746127008.307700:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991797632 00002000:00100000:1.0:1746127008.307748:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1134591) req@ffff880122387800 x1830945991797632/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.307757:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387800 with x1830945991797632 ext(1048576->1134591) 00010000:00010000:1.0:1746127008.307766:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 18 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.307775:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994308736:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127008.307780:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 18 pid: 3148 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.307786:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122387800 00010000:00010000:3.0:1746127008.307799:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1421312->1490943] (req 1421312->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 37 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.307814:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6ce00, rc 0) 00000100:00100000:1.0:1746127008.307828:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1954 00000100:00100000:1.0:1746127008.307835:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991797632:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127008.307864:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4482:x1830945991797504:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3477us (3678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.307871:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21917 00000100:00100000:1.0:1746127008.310597:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991797632:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 2754us (2951us total) trans 21474842909 rc 0/0 00000100:00100000:1.0:1746127008.310608:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1954 00002000:00100000:1.0:1746127008.310618:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1134591) req@ffff880122387800 x1830945991797632/t21474842909(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.310627:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387800 with x1830945991797632 ext(1048576->1134591) 00010000:00010000:1.0:1746127008.310637:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 20 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.310650:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 20 pid: 3148 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.310662:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122387800 00000100:00100000:0.0:1746127008.312308:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.312395:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991797760 00000100:00100000:2.0:1746127008.312404:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991797760 00010000:00010000:2.0:1746127008.312437:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 20 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.312474:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10317 00000100:00100000:2.0:1746127008.312481:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991797760:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.312495:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.312514:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 20 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.312525:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 20 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.312575:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2a800/0x34dc807b6efaa3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f0 expref: 20 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.312602:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.312604:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.312611:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.312620:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.312651:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.312666:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994308864:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127008.312819:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.314485:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994308864:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.314504:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.314539:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991797760:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2058us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.314549:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10317 00000100:00100000:0.0:1746127008.314734:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.315174:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991798016 00000100:00100000:1.0:1746127008.315181:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991798016 00002000:00100000:1.0:1746127008.315221:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1486848->1490943) req@ffff880122385880 x1830945991798016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.315231:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385880 with x1830945991798016 ext(1486848->1490943) 00002000:00010000:1.0:1746127008.315236:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122385880 00000100:00100000:1.0:1746127008.315265:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8793 00000100:00100000:1.0:1746127008.315272:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991798016:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127008.315397:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991798016:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 122us (659us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127008.315403:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8793 00002000:00100000:1.0:1746127008.315409:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1486848->1490943) req@ffff880122385880 x1830945991798016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.315416:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385880 with x1830945991798016 ext(1486848->1490943) 00002000:00010000:1.0:1746127008.315419:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122385880 00000100:00100000:0.0:1746127008.316814:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.317429:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991798272 00000100:00100000:3.0:1746127008.317436:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991798272 00000100:00100000:3.0:1746127008.317470:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6626 00000100:00100000:3.0:1746127008.317476:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4482:x1830945991798272:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127008.317659:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4482:x1830945991798272:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 182us (848us total) trans 8589938301 rc 0/0 00000100:00100000:3.0:1746127008.317666:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6626 00000100:00100000:0.0:1746127008.458103:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.458177:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991798528 00000100:00100000:1.0:1746127008.458187:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991798528 00000100:00100000:1.0:1746127008.458248:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17346 00000100:00100000:1.0:1746127008.458256:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4488:x1830945991798528:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127008.458282:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.458301:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eac00/0x34dc807b6efaa6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a05 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.458377:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458390:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458400:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458411:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458417:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458422:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458511:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458519:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458524:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:1.0:1746127008.458532:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127008.458652:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458659:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458668:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458673:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458679:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995ea600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.458682:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458688:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458699:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127008.458701:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.458705:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458710:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ea600/0x34dc807b6efaa73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458736:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458740:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458745:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458749:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995eaa00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.458751:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458760:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458765:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a400) 00010000:00010000:1.0:1746127008.458767:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.458769:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458774:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eaa00/0x34dc807b6efaa7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:1.0:1746127008.458807:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eac00/0x34dc807b6efaa6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 16 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.458818:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 15 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.458823:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.458825:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127008.458827:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb400, rc 0) 00000100:00100000:1.0:1746127008.458873:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4488:x1830945991798528:12345-192.168.203.42@tcp:101:cat.0 Request processed in 618us (780us total) trans 8589938302 rc 0/0 00000100:00100000:1.0:1746127008.458879:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17346 00000100:00100000:1.0:1746127008.459223:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.459247:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991798656 00000100:00100000:1.0:1746127008.459250:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991798656 00000100:00100000:1.0:1746127008.459278:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21918 00000100:00100000:1.0:1746127008.459283:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991798656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127008.459295:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.459307:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efaa8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a0c expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127008.459351:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994308992:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127008.459417:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127008.460213:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.460337:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991798912 00000100:00100000:0.0:1746127008.460341:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991798912 00000100:00100000:0.0:1746127008.460365:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6627 00000100:00100000:0.0:1746127008.460371:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4488:x1830945991798912:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746127008.460509:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4488:x1830945991798912:12345-192.168.203.42@tcp:35:cat.0 Request processed in 137us (296us total) trans 8589938303 rc 0/0 00000100:00100000:0.0:1746127008.460515:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6627 00000100:00100000:1.0:1746127008.461731:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994308992:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127008.461763:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efaa8f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a0c expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127008.461775:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efaa8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a0c expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127008.461784:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995ea800, rc 0) 00000100:00100000:1.0:1746127008.461973:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991798656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2688us (2749us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127008.461980:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21918 00000100:00100000:0.0:1746127008.464770:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.465187:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991799040 00000100:00100000:1.0:1746127008.465197:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991799040 00000100:00100000:1.0:1746127008.465267:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21919 00000100:00100000:1.0:1746127008.465275:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991799040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127008.465358:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.465377:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efaa96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a13 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127008.465477:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994309120:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127008.465572:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.469535:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.469595:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991799168 00000100:00100000:2.0:1746127008.469605:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991799168 00000100:00100000:2.0:1746127008.469654:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21920 00000100:00100000:2.0:1746127008.469661:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4489:x1830945991799168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.469679:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.469697:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a1a expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.469727:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.469735:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.469736:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.469740:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.469767:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.469783:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 21 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.469794:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994309248:192.168.203.42@tcp:104: 00002000:00010000:1.0:1746127008.469864:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127003 -> 1746127007 00000100:00100000:1.0:1746127008.469883:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994309120:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127008.470299:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efaa96 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a13 expref: 20 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127008.470314:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efaa96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a13 expref: 20 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127008.470326:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a17e9c00, rc 0) 00000100:00100000:2.0:1746127008.470462:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127008.470657:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991799040:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5381us (5892us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127008.470664:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21919 00000100:00100000:2.0:1746127008.474064:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994309248:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.474096:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.474112:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bce00, rc 0) 00000100:00100000:2.0:1746127008.474779:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4489:x1830945991799168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5116us (5252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.474788:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21920 00000100:00100000:1.0:1746127008.474859:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.475305:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991799552 00000100:00100000:2.0:1746127008.475312:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991799552 00002000:00100000:2.0:1746127008.475350:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880094b7bb80 x1830945991799552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.475359:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b7bb80 with x1830945991799552 ext(0->1048575) 00002000:00010000:2.0:1746127008.475364:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b7bb80 00000100:00100000:2.0:1746127008.475378:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8794 00000100:00100000:2.0:1746127008.475384:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991799552:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.475648:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.475689:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991799296 00000100:00100000:1.0:1746127008.475692:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991799296 00002000:00100000:1.0:1746127008.475710:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1277952->2097151) req@ffff880122384a80 x1830945991799296/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.475718:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384a80 with x1830945991799296 ext(1277952->2097151) 00010000:00010000:1.0:1746127008.475724:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 22 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.475736:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 22 pid: 3148 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.475743:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880122384a80 00000100:00100000:1.0:1746127008.475903:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1955 00000100:00100000:1.0:1746127008.475910:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991799296:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127008.487125:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991799552:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11727us (12254us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127008.487172:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8794 00002000:00100000:2.0:1746127008.487185:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880094b7bb80 x1830945991799552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.487194:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b7bb80 with x1830945991799552 ext(0->1048575) 00002000:00010000:2.0:1746127008.487199:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b7bb80 00000100:00100000:2.0:1746127008.491595:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991799296:12345-192.168.203.42@tcp:4:cat.0 Request processed in 15672us (15934us total) trans 17179875641 rc 0/0 00000100:00100000:2.0:1746127008.491707:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1955 00002000:00100000:2.0:1746127008.491721:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1277952->2097151) req@ffff880122384a80 x1830945991799296/t17179875641(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.491730:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384a80 with x1830945991799296 ext(1277952->2097151) 00010000:00010000:2.0:1746127008.491741:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 24 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.491758:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 24 pid: 3148 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746127008.491765:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880122384a80 00000100:00100000:2.0:1746127008.497427:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.497479:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991799680 00000100:00100000:0.0:1746127008.497489:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991799680 00000100:00100000:0.0:1746127008.497544:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21921 00000100:00100000:0.0:1746127008.497553:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4488:x1830945991799680:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127008.497571:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127008.497590:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a21 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.497620:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127008.497625:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.497636:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.497647:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012158d000, rc 0) 00000100:00100000:0.0:1746127008.497705:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4488:x1830945991799680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 152us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127008.497711:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21921 00000100:00100000:2.0:1746127008.498486:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.499657:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991799808 00000100:00100000:3.0:1746127008.499664:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991799808 00010000:00010000:3.0:1746127008.499691:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 25 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.499714:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10318 00000100:00100000:3.0:1746127008.499719:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991799808:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.499729:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.499748:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 25 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.499759:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 25 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.499784:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc800/0x34dc807b6efaa34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1277952->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539e9 expref: 25 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.499802:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.499803:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.499810:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.499821:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.499829:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.499830:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.499833:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.499840:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.499870:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.499882:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994309376:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127008.499968:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.499976:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994309504:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127008.500534:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746127008.501288:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994309376:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127008.501298:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994309504:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127008.501312:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.501349:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991799808:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1628us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.501356:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10318 00000100:00100000:0.0:1746127008.505575:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.505703:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991800064 00000100:00100000:3.0:1746127008.505713:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991800064 00000100:00100000:1.0:1746127008.505729:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.505761:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17347 00000100:00100000:3.0:1746127008.505769:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4491:x1830945991800064:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127008.505797:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.505815:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efaaab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a28 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.505861:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991800320 00000100:00100000:2.0:1746127008.505866:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991800320 00002000:00100000:2.0:1746127008.505899:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880094b78e00 x1830945991800320/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746127008.505914:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00002000:00100000:2.0:1746127008.505914:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78e00 with x1830945991800320 ext(1048576->2097151) 00002000:00010000:2.0:1746127008.505919:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094b78e00 00010000:00010000:3.0:1746127008.505930:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.505947:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8795 00000100:00100000:2.0:1746127008.505953:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991800320:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:3.0:1746127008.505996:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 31 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.506004:0:13466:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 17 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.506011:0:13466:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127008.506054:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 17 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.506064:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 17 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.506075:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994309632:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.506167:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 31 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.506175:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 31 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.506182:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994309760:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.506205:0:13466:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.506213:0:13466:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 8 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.506219:0:13466:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994309888:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.506235:0:13466:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.508624:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.508672:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.508764:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994309632:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.508774:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994309760:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.508782:0:13466:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13466:1830945994309888:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.508807:0:13466:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000100:00100000:1.0:1746127008.509262:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991800448 00000100:00100000:1.0:1746127008.509269:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991800448 00010000:00010000:1.0:1746127008.509301:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 18 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.509333:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991800576 00000100:00100000:1.0:1746127008.509335:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991800576 00010000:00010000:1.0:1746127008.509343:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 32 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.509356:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10319 00000100:00100000:1.0:1746127008.509362:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991800448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127008.509373:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127008.509379:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 18 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.509381:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10320 00010000:00010000:1.0:1746127008.509388:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 18 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.509390:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991800576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.509399:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.509404:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 32 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.509409:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb400/0x34dc807b6efaa81 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a05 expref: 18 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.509413:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 32 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.509426:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995ebe00/0x34dc807b6efaa57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539f7 expref: 32 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.509430:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.509434:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127008.509442:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:1.0:1746127008.509447:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127008.509449:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.509453:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.509458:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.509462:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.509480:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991800576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 93us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.509480:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991800448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 117us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.509485:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10319 00000100:00100000:2.0:1746127008.509490:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10320 00000100:00100000:0.0:1746127008.510699:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.510732:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.510758:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.510779:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991800704 00000100:00100000:2.0:1746127008.510785:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991800704 00010000:00010000:2.0:1746127008.510805:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.510816:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991800960 00000100:00100000:1.0:1746127008.510820:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991800960 00000100:00100000:2.0:1746127008.510824:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10321 00000100:00100000:2.0:1746127008.510829:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991800704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.510836:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.510840:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00002000:00100000:1.0:1746127008.510846:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880122387b80 x1830945991800960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746127008.510848:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991801216 00010000:00010000:2.0:1746127008.510849:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.510852:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991801216 00002000:00100000:1.0:1746127008.510855:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387b80 with x1830945991800960 ext(1048576->2097151) 00002000:00010000:1.0:1746127008.510859:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122387b80 00010000:00010000:2.0:1746127008.510862:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995eb800/0x34dc807b6efaa18 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539d4 expref: 9 pid: 11634 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.510871:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00002000:00100000:3.0:1746127008.510875:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880122384000 x1830945991801216/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 504/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127008.510875:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.510882:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00002000:00100000:3.0:1746127008.510883:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384000 with x1830945991801216 ext(1048576->2097151) 00000100:00100000:1.0:1746127008.510883:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8796 00002000:00010000:3.0:1746127008.510886:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122384000 00000100:00100000:1.0:1746127008.510887:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991800960:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127008.510889:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127008.510905:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8797 00010000:00010000:2.0:1746127008.510905:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.510910:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991801216:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127008.510926:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991800704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.510932:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10321 00010000:00010000:2.0:1746127008.510954:0:13466:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.510959:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:2.0:1746127008.510974:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127008.511109:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efaaab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 18 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.511121:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 17 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.511146:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.511148:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127008.511150:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6c400, rc 0) 00000100:00100000:2.0:1746127008.511172:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4491:x1830945991800064:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5404us (5609us total) trans 8589938304 rc 0/0 00000100:00100000:2.0:1746127008.511178:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17347 00000100:00100000:2.0:1746127008.512693:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991800320:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6734us (6959us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127008.512701:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8795 00002000:00100000:2.0:1746127008.512709:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880094b78e00 x1830945991800320/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.512717:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78e00 with x1830945991800320 ext(1048576->2097151) 00002000:00010000:2.0:1746127008.512722:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094b78e00 00000100:00100000:1.0:1746127008.523396:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991800960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12497us (12653us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127008.523408:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8796 00002000:00100000:1.0:1746127008.523418:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880122387b80 x1830945991800960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.523427:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387b80 with x1830945991800960 ext(1048576->2097151) 00002000:00010000:1.0:1746127008.523434:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122387b80 00000100:00100000:3.0:1746127008.526903:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991801216:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15981us (16132us total) trans 0 rc 978944/978944 00000100:00100000:3.0:1746127008.526916:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8797 00002000:00100000:3.0:1746127008.526928:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880122384000 x1830945991801216/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 504/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.526937:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384000 with x1830945991801216 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.526943:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122384000 00000100:00100000:1.0:1746127008.527288:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.527341:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991801344 00000100:00100000:2.0:1746127008.527349:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991801344 00000100:00100000:2.0:1746127008.527392:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21922 00000100:00100000:2.0:1746127008.527398:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4488:x1830945991801344:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.527413:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.527429:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a2f expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.527458:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.527465:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.527467:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.527470:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 20 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.527498:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.527507:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 36 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.527519:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994310016:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.527596:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.530561:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994310016:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.530590:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 20 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.530610:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd600, rc 0) 00000100:00100000:2.0:1746127008.530666:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4488:x1830945991801344:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3266us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.530675:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21922 00000100:00100000:0.0:1746127008.532647:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.532781:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991801472 00000100:00100000:3.0:1746127008.532791:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991801472 00002000:00100000:3.0:1746127008.532836:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1421312->1490943) req@ffff880122385180 x1830945991801472/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.532846:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385180 with x1830945991801472 ext(1421312->1490943) 00010000:00010000:3.0:1746127008.532854:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 37 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.532868:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 37 pid: 3148 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.532876:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122385180 00000100:00100000:3.0:1746127008.532906:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1956 00000100:00100000:3.0:1746127008.532913:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991801472:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127008.536054:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991801472:12345-192.168.203.42@tcp:4:cat.0 Request processed in 3130us (3403us total) trans 21474842910 rc 0/0 00000100:00100000:3.0:1746127008.536070:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1956 00002000:00100000:3.0:1746127008.536081:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1421312->1490943) req@ffff880122385180 x1830945991801472/t21474842910(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.536091:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385180 with x1830945991801472 ext(1421312->1490943) 00010000:00010000:3.0:1746127008.536100:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 39 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.536114:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 39 pid: 3148 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.536121:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880122385180 00000100:00100000:0.0:1746127008.536478:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.536605:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991801600 00000100:00100000:2.0:1746127008.536612:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991801600 00000100:00100000:2.0:1746127008.536650:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21923 00000100:00100000:2.0:1746127008.536656:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991801600:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.536669:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.536682:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efaac7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a36 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.536725:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994310144:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127008.536795:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.541089:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.541162:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991801728 00000100:00100000:2.0:1746127008.541170:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991801728 00010000:00010000:2.0:1746127008.541208:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 41 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.541246:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10322 00000100:00100000:2.0:1746127008.541325:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991801728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.541338:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.541358:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 41 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.541377:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 41 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.541402:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.541404:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.541411:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 19 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.541420:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 19 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.541449:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 19 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.541461:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994310272:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127008.541561:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbce40 going to sleep for 11 seconds 00010000:00010000:2.0:1746127008.543528:0:3148:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff88012cc9e680 x1830945994310144) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 41 pid: 3148 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.543558:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efaa65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1421312->1490943) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539fe expref: 41 pid: 3148 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.543840:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994310144:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127008.543870:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efaac7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a36 expref: 40 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.543888:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efaac7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a36 expref: 40 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.543896:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc400, rc 0) 00000100:00100000:2.0:1746127008.543936:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991801600:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7280us (7459us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127008.543944:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21923 00000100:00100000:2.0:1746127008.544663:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994310272:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.544673:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.544706:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991801728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3384us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.544715:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10322 00000100:00100000:0.0:1746127008.545236:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.546157:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.546170:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.546226:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991802368 00000100:00100000:2.0:1746127008.546234:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991802368 00000100:00100000:2.0:1746127008.546269:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21924 00000100:00100000:2.0:1746127008.546276:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991802368:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.546294:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.546311:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a44 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.546333:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.546336:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.546343:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 39 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.546363:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 39 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.546372:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8df800, rc 0) 00000100:00100000:2.0:1746127008.546403:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991802368:12345-192.168.203.42@tcp:101:cat.0 Request processed in 127us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.546416:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21924 00000100:00100000:2.0:1746127008.546436:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991802240 00000100:00100000:2.0:1746127008.546438:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991802240 00000100:00100000:2.0:1746127008.546462:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17348 00000100:00100000:2.0:1746127008.546467:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4493:x1830945991802240:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127008.546482:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.546494:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efaad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a3d expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.546559:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546570:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546578:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546589:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546595:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546601:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546696:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546705:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546711:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000004:00200000:2.0:1746127008.546719:0:13466:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:3.0:1746127008.546779:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991801984 00000100:00100000:3.0:1746127008.546783:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991801984 00010000:00010000:2.0:1746127008.546788:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546795:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546801:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546807:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8df600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127008.546809:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00002000:00100000:3.0:1746127008.546812:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880095c04a80 x1830945991801984/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127008.546815:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00002000:00100000:3.0:1746127008.546821:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04a80 with x1830945991801984 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.546824:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c04a80 00010000:00010000:2.0:1746127008.546824:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127008.546826:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127008.546830:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546838:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df600/0x34dc807b6efaadc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546846:0:13466:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127008.546849:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8798 00010000:00010000:2.0:1746127008.546850:0:13466:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00000100:00100000:3.0:1746127008.546854:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991801984:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127008.546854:0:13466:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546858:0:13466:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8de400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127008.546860:0:13466:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546864:0:13466:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546939:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880122059d00) 00010000:00010000:2.0:1746127008.546941:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127008.546944:0:13466:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546949:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de400/0x34dc807b6efaae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127008.546979:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efaad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 34 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.546987:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 33 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.546996:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.546998:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127008.547000:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de200, rc 0) 00000100:00100000:2.0:1746127008.547036:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4493:x1830945991802240:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 569us (868us total) trans 8589938305 rc 0/0 00000100:00100000:2.0:1746127008.547041:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17348 00000100:00100000:3.0:1746127008.554046:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991801984:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7180us (8800us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127008.554057:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8798 00002000:00100000:3.0:1746127008.554069:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880095c04a80 x1830945991801984/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.554085:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04a80 with x1830945991801984 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.554090:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c04a80 00000100:00100000:1.0:1746127008.559219:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.559261:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.559290:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.559322:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991802624 00000100:00100000:2.0:1746127008.559331:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991802624 00000100:00100000:1.0:1746127008.559332:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:2.0:1746127008.559354:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746127008.559393:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991802880 00000100:00100000:2.0:1746127008.559396:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991802880 00000100:00100000:2.0:1746127008.559413:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991802752 00000100:00100000:2.0:1746127008.559414:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991802752 00000100:00100000:2.0:1746127008.559430:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1166 00000100:00100000:2.0:1746127008.559438:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2028:x1830945991802624:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1746127008.559504:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2028:x1830945991802624:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 67us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.559509:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1166 00000100:00100000:2.0:1746127008.559524:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1167 00000100:00100000:2.0:1746127008.559528:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2028:x1830945991802880:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1746127008.559548:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2028:x1830945991802880:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 21us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.559553:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1167 00000100:00100000:2.0:1746127008.559561:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1168 00000100:00100000:2.0:1746127008.559565:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2029:x1830945991802752:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1746127008.559586:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2029:x1830945991802752:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 21us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.559590:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1168 00000100:00080000:2.0:1746127008.559599:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746127008.559690:0:8223:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991802496 00000100:00100000:3.0:1746127008.559694:0:8223:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991802496 00000100:00100000:2.0:1746127008.559699:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.559769:0:8223:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 236 00000100:00100000:3.0:1746127008.559775:0:8223:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee06c75c-5a89-45a6-932b-08fb02e0019d+15:2029:x1830945991802496:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1746127008.559797:0:8223:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee06c75c-5a89-45a6-932b-08fb02e0019d+15:2029:x1830945991802496:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.559803:0:8223:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 236 00000100:00100000:2.0:1746127008.559923:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991803008 00000100:00100000:2.0:1746127008.559927:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991803008 00000100:00100000:2.0:1746127008.559950:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21925 00000100:00100000:2.0:1746127008.559954:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4493:x1830945991803008:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127008.559965:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.559981:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a4b expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.560007:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.560026:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.560032:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 40 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.560037:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.560039:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.560042:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [303104->499711] (req 303104->499711) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 40 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.560077:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 40 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.560088:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 40 pid: 12333 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.560100:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310400:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.560243:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 9 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.560253:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 9 pid: 12340 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.560261:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310528:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.560288:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 19 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.560295:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 19 pid: 1964 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.560302:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310656:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.560318:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.565180:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.565218:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.565254:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.565262:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991803264 00000100:00100000:1.0:1746127008.565270:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991803264 00000100:00100000:0.0:1746127008.565286:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991803136 00000100:00100000:0.0:1746127008.565288:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991803136 00010000:00010000:1.0:1746127008.565308:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 10 pid: 12340 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746127008.565308:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 41 pid: 12333 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746127008.565572:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991803392 00000100:00100000:1.0:1746127008.565575:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991803392 00000100:00100000:2.0:1746127008.565587:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310400:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127008.565587:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 20 pid: 1964 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.565597:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310528:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127008.565602:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10323 00000100:00100000:2.0:1746127008.565605:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310656:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127008.565608:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991803136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127008.565620:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.565634:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [303104->499711] (req 303104->499711) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 41 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.565641:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 41 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.565647:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de400, rc 0) 00010000:00010000:1.0:1746127008.565649:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 41 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565670:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099158a00/0x34dc807b6efa938 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5393a expref: 41 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565690:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.565692:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4493:x1830945991803008:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5736us (5992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.565698:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21925 00000100:00100000:1.0:1746127008.565702:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991803136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 95us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.565707:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10323 00000100:00100000:1.0:1746127008.565716:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10324 00000100:00100000:1.0:1746127008.565721:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991803264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127008.565726:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127008.565731:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 10 pid: 12340 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565738:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 10 pid: 12340 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565748:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efa9cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5399c expref: 10 pid: 12340 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565755:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127008.565768:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991803264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 48us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.565773:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10324 00000100:00100000:1.0:1746127008.565781:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10325 00000100:00100000:1.0:1746127008.565786:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991803392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127008.565791:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127008.565797:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 20 pid: 1964 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565806:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 20 pid: 1964 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565818:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880076179400/0x34dc807b6efa889 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538ca expref: 20 pid: 1964 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.565827:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127008.565828:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127008.565835:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.565844:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.565871:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127008.565883:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994310784:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127008.565932:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.569199:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.570185:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994310784:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127008.570210:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127008.570277:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991803392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4487us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.570288:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10325 00000100:00100000:2.0:1746127008.570603:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991803520 00000100:00100000:2.0:1746127008.570610:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991803520 00000100:00100000:2.0:1746127008.570647:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21926 00000100:00100000:2.0:1746127008.570654:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991803520:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.570670:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.570686:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bdc00/0x34dc807b6efaaff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a52 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.570733:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310912:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127008.570843:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.571895:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127008.572035:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991803776 00000100:00100000:1.0:1746127008.572039:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991803776 00002000:00100000:1.0:1746127008.572070:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (303104->307199) req@ffff880094b78a80 x1830945991803776/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.572080:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78a80 with x1830945991803776 ext(303104->307199) 00002000:00010000:1.0:1746127008.572085:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b78a80 00000100:00100000:1.0:1746127008.572112:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8799 00000100:00100000:1.0:1746127008.572144:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991803776:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127008.572262:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991803776:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 134us (1419us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127008.572268:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8799 00002000:00100000:1.0:1746127008.572274:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (303104->307199) req@ffff880094b78a80 x1830945991803776/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.572281:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78a80 with x1830945991803776 ext(303104->307199) 00002000:00010000:1.0:1746127008.572284:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b78a80 00000100:00100000:0.0:1746127008.577874:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:2.0:1746127008.578474:0:12340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746127004 -> 1746127007 00002000:00010000:2.0:1746127008.578479:0:12340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127004 -> 1746127007 00002000:00010000:2.0:1746127008.578481:0:12340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746127004 -> 1746127007 00000100:00100000:2.0:1746127008.578509:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994310912:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127008.578549:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bdc00/0x34dc807b6efaaff lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a52 expref: 20 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.578569:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bdc00/0x34dc807b6efaaff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a52 expref: 20 pid: 12340 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127008.578741:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991804032 00000100:00100000:1.0:1746127008.578748:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991804032 00002000:00100000:1.0:1746127008.578787:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (495616->499711) req@ffff880095c04700 x1830945991804032/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.578795:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04700 with x1830945991804032 ext(495616->499711) 00002000:00010000:1.0:1746127008.578800:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c04700 00000100:00100000:1.0:1746127008.578833:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8800 00000100:00100000:1.0:1746127008.578841:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991804032:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:2.0:1746127008.579517:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bdc00, rc 0) 00000100:00100000:1.0:1746127008.579763:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991804032:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 921us (1897us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127008.579771:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8800 00000100:00100000:2.0:1746127008.579777:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991803520:12345-192.168.203.42@tcp:101:cat.0 Request processed in 9122us (10587us total) trans 0 rc 301/301 00002000:00100000:1.0:1746127008.579777:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (495616->499711) req@ffff880095c04700 x1830945991804032/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.579784:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04700 with x1830945991804032 ext(495616->499711) 00000100:00100000:2.0:1746127008.579786:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21926 00002000:00010000:1.0:1746127008.579787:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c04700 00000100:00100000:0.0:1746127008.582798:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.582870:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991804288 00000100:00100000:3.0:1746127008.582880:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991804288 00000100:00100000:3.0:1746127008.582923:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6628 00000100:00100000:3.0:1746127008.582930:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4493:x1830945991804288:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127008.583711:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4493:x1830945991804288:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 778us (919us total) trans 8589938306 rc 0/0 00000100:00100000:3.0:1746127008.583718:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6628 00000100:00100000:0.0:1746127008.584037:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.584086:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991804416 00000100:00100000:2.0:1746127008.584091:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991804416 00000100:00100000:2.0:1746127008.584512:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21927 00000100:00100000:2.0:1746127008.584521:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991804416:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.584535:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.584552:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bc200/0x34dc807b6efab06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a59 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.584602:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311040:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127008.584690:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.587248:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311040:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127008.587287:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bc200/0x34dc807b6efab06 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a59 expref: 20 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.587301:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bc200/0x34dc807b6efab06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a59 expref: 20 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.587337:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc200, rc 0) 00000100:00100000:2.0:1746127008.587390:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991804416:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2870us (3352us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127008.587398:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21927 00000100:00100000:0.0:1746127008.590080:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.590167:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991804544 00000100:00100000:2.0:1746127008.590176:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991804544 00000100:00100000:2.0:1746127008.590466:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21928 00000100:00100000:2.0:1746127008.590474:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991804544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.590492:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.590508:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6efab0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a60 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.590563:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311168:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127008.590659:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.592753:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311168:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127008.592783:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6efab0d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a60 expref: 20 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.592859:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6efab0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a60 expref: 20 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.592870:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd200, rc 0) 00000100:00100000:2.0:1746127008.593276:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991804544:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2802us (3204us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127008.593284:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21928 00000100:00100000:0.0:1746127008.639557:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.639841:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991804672 00000100:00100000:2.0:1746127008.639851:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991804672 00000100:00100000:2.0:1746127008.639898:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21929 00000100:00100000:2.0:1746127008.639906:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4491:x1830945991804672:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127008.639926:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.639945:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a67 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.639975:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.639983:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.639990:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.639995:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.639997:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.640000:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2998272->3145727] (req 2998272->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.640043:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.640054:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.640066:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994311296:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.640216:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.640226:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 8 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.640233:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994311424:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.640260:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.640268:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.640274:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994311552:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.640291:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.646191:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994311296:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.646205:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994311424:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.646214:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994311552:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.646252:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2998272->3145727] (req 2998272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.646269:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bdc00, rc 0) 00000100:00100000:2.0:1746127008.646332:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4491:x1830945991804672:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6426us (6784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.646345:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21929 00000100:00100000:0.0:1746127008.649787:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.649832:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.649878:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.650908:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991804800 00000100:00100000:2.0:1746127008.650918:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991804800 00010000:00010000:2.0:1746127008.650960:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.650994:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991805056 00000100:00100000:2.0:1746127008.650997:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991805056 00010000:00010000:2.0:1746127008.651009:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.651036:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991804928 00000100:00100000:2.0:1746127008.651039:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991804928 00010000:00010000:2.0:1746127008.651049:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.651071:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10326 00000100:00100000:2.0:1746127008.651077:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991804800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.651091:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.651111:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.651123:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.651164:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bc000/0x34dc807b6efaa1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539db expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.651187:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127008.651211:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10327 00000100:00100000:0.0:1746127008.651218:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991805056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127008.651227:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127008.651229:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991804800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 151us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.651235:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10326 00010000:00010000:0.0:1746127008.651237:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746127008.651246:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.651252:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10328 00000100:00100000:2.0:1746127008.651257:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991804928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127008.651259:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efa9a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5398e expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.651264:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.651270:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746127008.651273:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127008.651279:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746127008.651289:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991805056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (1457us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127008.651291:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efa9ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539c6 expref: 25 pid: 16295 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746127008.651295:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10327 00010000:00010000:2.0:1746127008.651299:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.651301:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.651307:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.651314:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.651346:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.651358:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994311680:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127008.651404:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.653331:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994311680:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.653352:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.653397:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991804928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2139us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.653406:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10328 00000100:00100000:0.0:1746127008.654204:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.654361:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991805312 00000100:00100000:1.0:1746127008.654368:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991805312 00002000:00100000:1.0:1746127008.654407:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2998272->3002367) req@ffff88007ede3480 x1830945991805312/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.654418:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3480 with x1830945991805312 ext(2998272->3002367) 00002000:00010000:1.0:1746127008.654423:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede3480 00000100:00100000:1.0:1746127008.654448:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8801 00000100:00100000:1.0:1746127008.654455:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991805312:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127008.654574:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991805312:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 120us (372us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127008.654580:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8801 00002000:00100000:1.0:1746127008.654586:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2998272->3002367) req@ffff88007ede3480 x1830945991805312/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.654594:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3480 with x1830945991805312 ext(2998272->3002367) 00002000:00010000:1.0:1746127008.654597:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede3480 00000100:00100000:0.0:1746127008.660086:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.660488:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991805440 00000100:00100000:2.0:1746127008.660497:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991805440 00000100:00100000:2.0:1746127008.660549:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21930 00000100:00100000:2.0:1746127008.660557:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4491:x1830945991805440:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127008.660577:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.660595:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a6e expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.660625:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 20 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.660634:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.660641:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 38 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.660651:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.660653:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.660656:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->3837951] (req 3145728->3837951) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 20 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.660686:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 38 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.660697:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 38 pid: 12333 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.660709:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311808:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.660808:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.660816:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 8 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.660823:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311936:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.660842:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 20 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.660848:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 20 pid: 9612 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.660859:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312064:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.660871:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.664530:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311808:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.664611:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994311936:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.664620:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312064:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.664660:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->3837951] (req 3145728->3837951) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 20 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.664678:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dfe00, rc 0) 00000100:00100000:2.0:1746127008.664738:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4491:x1830945991805440:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4180us (4663us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.664746:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21930 00000100:00100000:0.0:1746127008.665352:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.665449:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.665583:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991805568 00000100:00100000:2.0:1746127008.665589:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991805568 00010000:00010000:2.0:1746127008.665618:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.665657:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10329 00000100:00100000:2.0:1746127008.665664:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991805568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127008.665674:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991805696 00010000:00010000:2.0:1746127008.665675:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127008.665679:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991805696 00010000:00010000:2.0:1746127008.665695:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.665696:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 20 pid: 9612 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.665709:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746127008.665721:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10330 00000100:00100000:1.0:1746127008.665726:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991805696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.665731:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efa9d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539b8 expref: 9 pid: 3148 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.665734:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127008.665741:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 20 pid: 9612 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746127008.665746:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127008.665749:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 20 pid: 9612 timeout: 1003 lvb_type: 1 00010000:00010000:1.0:1746127008.665763:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efa8a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538e6 expref: 20 pid: 9612 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746127008.665770:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991805568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 107us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.665775:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10329 00010000:00010000:1.0:1746127008.665776:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127008.665798:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991805696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 66us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.665804:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10330 00000100:00100000:0.0:1746127008.668606:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.668706:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991805824 00000100:00100000:3.0:1746127008.668714:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991805824 00010000:00010000:3.0:1746127008.668745:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 39 pid: 12333 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746127008.668781:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10331 00000100:00100000:3.0:1746127008.668788:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2027:x1830945991805824:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.668799:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.668819:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 39 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746127008.668830:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 39 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746127008.668850:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efa954 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53956 expref: 39 pid: 12333 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746127008.668872:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.668874:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.668882:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 18 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.668891:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 18 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.668929:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 18 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.668942:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994312192:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127008.669032:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746127008.671900:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994312192:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127008.671920:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.671963:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991805824:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3175us (3365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.671973:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10331 00000100:00100000:0.0:1746127008.677376:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.677434:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991806080 00000100:00100000:2.0:1746127008.677444:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991806080 00002000:00100000:2.0:1746127008.677493:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3833856->3837951) req@ffff88007ede3b80 x1830945991806080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.677503:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3b80 with x1830945991806080 ext(3833856->3837951) 00002000:00010000:2.0:1746127008.677508:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede3b80 00000100:00100000:2.0:1746127008.677540:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8802 00000100:00100000:2.0:1746127008.677547:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991806080:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127008.677690:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991806080:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 142us (323us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127008.677696:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8802 00002000:00100000:2.0:1746127008.677702:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3833856->3837951) req@ffff88007ede3b80 x1830945991806080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.677708:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3b80 with x1830945991806080 ext(3833856->3837951) 00002000:00010000:2.0:1746127008.677711:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede3b80 00000100:00100000:0.0:1746127008.698639:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.698734:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991806336 00000100:00100000:1.0:1746127008.698743:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991806336 00000100:00100000:1.0:1746127008.698791:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17349 00000100:00100000:1.0:1746127008.698799:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4499:x1830945991806336:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127008.698824:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.698841:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efab22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a75 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.698922:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.698936:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.698948:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.698961:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.698967:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.698972:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699090:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab37 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699100:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699106:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127008.699116:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127008.699219:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699226:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699231:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699236:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699243:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7d29a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.699247:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699253:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699265:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127008.699268:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.699273:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699279:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699305:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699309:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699313:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699317:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7d28e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.699319:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699324:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699330:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a400) 00010000:00010000:1.0:1746127008.699332:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.699334:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699339:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.699373:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28c00/0x34dc807b6efab22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a75 expref: 37 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.699384:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a75 expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.699390:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.699392:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127008.699394:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d28a00, rc 0) 00000100:00100000:1.0:1746127008.700227:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4499:x1830945991806336:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1426us (1595us total) trans 8589938307 rc 0/0 00000100:00100000:1.0:1746127008.700650:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17349 00000100:00100000:0.0:1746127008.702828:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.702907:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991806464 00000100:00100000:3.0:1746127008.702915:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991806464 00000100:00100000:3.0:1746127008.703009:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1030 00000100:00100000:3.0:1746127008.703028:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991806464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.703042:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.703066:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a75 expref: 36 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.703092:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127008.703097:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.703164:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991806464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 147us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.703170:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1030 00000100:00100000:0.0:1746127008.705357:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.705397:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991806592 00000100:00100000:2.0:1746127008.705404:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991806592 00000100:00100000:2.0:1746127008.705446:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21931 00000100:00100000:2.0:1746127008.705453:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4499:x1830945991806592:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127008.705469:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.705485:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a7c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.705510:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.705518:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.705519:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.705523:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2408448->2576383] (req 2408448->2576383) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.705550:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.705561:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 23 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.705575:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994312320:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.705838:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.706867:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994312320:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.706891:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2408448->2576383] (req 2408448->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.706905:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd000, rc 0) 00000100:00100000:2.0:1746127008.706943:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4499:x1830945991806592:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1490us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.706950:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21931 00000100:00100000:0.0:1746127008.707461:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.707528:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991806720 00000100:00100000:2.0:1746127008.707534:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991806720 00002000:00100000:2.0:1746127008.707567:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2998272->3145727) req@ffff880095c07800 x1830945991806720/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.707578:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07800 with x1830945991806720 ext(2998272->3145727) 00010000:00010000:2.0:1746127008.707587:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 24 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.707599:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 24 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746127008.707605:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c07800 00000100:00100000:2.0:1746127008.707628:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1957 00000100:00100000:2.0:1746127008.707635:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991806720:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127008.710265:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991806720:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 2619us (2793us total) trans 17179875642 rc 0/0 00000100:00100000:0.0:1746127008.710277:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1957 00002000:00100000:0.0:1746127008.710287:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2998272->3145727) req@ffff880095c07800 x1830945991806720/t17179875642(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127008.710301:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07800 with x1830945991806720 ext(2998272->3145727) 00010000:00010000:0.0:1746127008.710311:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 26 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746127008.710327:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 26 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:0.0:1746127008.710334:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c07800 00000100:00100000:0.0:1746127008.711625:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.711722:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991806848 00000100:00100000:3.0:1746127008.711730:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991806848 00010000:00010000:3.0:1746127008.711759:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 26 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.711792:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10332 00000100:00100000:3.0:1746127008.711799:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991806848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.711813:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746127008.711830:0:7247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127006 -> 1746127007 00002000:00010000:3.0:1746127008.711833:0:7247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127006 -> 1746127007 00010000:00010000:3.0:1746127008.711837:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 26 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.711847:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 26 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.711871:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bdc00/0x34dc807b6efab14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a67 expref: 26 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.711956:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.711958:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.711966:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.711975:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.712007:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.712031:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994312448:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127008.712110:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012960d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.714858:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.714903:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991807104 00000100:00100000:1.0:1746127008.714911:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991807104 00000100:00100000:3.0:1746127008.714946:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994312448:192.168.203.42@tcp:105: 00002000:00100000:1.0:1746127008.714951:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2408448->2412543) req@ffff880095c06d80 x1830945991807104/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.714959:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06d80 with x1830945991807104 ext(2408448->2412543) 00010000:00010000:3.0:1746127008.714963:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746127008.714963:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c06d80 00000100:00100000:1.0:1746127008.714991:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8803 00000100:00100000:1.0:1746127008.714998:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991807104:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127008.715001:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991806848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3203us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.715008:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10332 00000100:00100000:1.0:1746127008.715149:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991807104:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 130us (276us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127008.715159:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8803 00002000:00100000:1.0:1746127008.715165:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2408448->2412543) req@ffff880095c06d80 x1830945991807104/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.715172:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06d80 with x1830945991807104 ext(2408448->2412543) 00002000:00010000:1.0:1746127008.715174:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c06d80 00000100:00100000:0.0:1746127008.717900:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.718012:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991807360 00000100:00100000:1.0:1746127008.718035:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991807360 00002000:00100000:1.0:1746127008.718085:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2572288->2576383) req@ffff880094825180 x1830945991807360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.718094:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825180 with x1830945991807360 ext(2572288->2576383) 00002000:00010000:1.0:1746127008.718100:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094825180 00000100:00100000:1.0:1746127008.718173:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8804 00000100:00100000:1.0:1746127008.718180:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991807360:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127008.718322:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991807360:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 142us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127008.718327:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8804 00002000:00100000:1.0:1746127008.718332:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2572288->2576383) req@ffff880094825180 x1830945991807360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/4536 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.718339:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094825180 with x1830945991807360 ext(2572288->2576383) 00002000:00010000:1.0:1746127008.718341:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094825180 00000100:00100000:0.0:1746127008.723812:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.724050:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991807616 00000100:00100000:3.0:1746127008.724060:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991807616 00000100:00100000:3.0:1746127008.724121:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6629 00000100:00100000:3.0:1746127008.724162:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b185c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4499:x1830945991807616:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127008.724523:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b185c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4499:x1830945991807616:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 390us (717us total) trans 8589938308 rc 0/0 00000100:00100000:3.0:1746127008.724530:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6629 00000100:00100000:0.0:1746127008.768804:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.769066:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991807872 00000100:00100000:1.0:1746127008.769075:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991807872 00000100:00100000:1.0:1746127008.769124:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17350 00000100:00100000:1.0:1746127008.769163:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4503:x1830945991807872:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127008.769192:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.769212:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a83 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.769293:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769306:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769317:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769330:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769335:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769340:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769439:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab61 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769448:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769453:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127008.769461:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127008.769532:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769542:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769547:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769552:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769558:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7d29c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.769561:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769567:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769578:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127008.769581:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.769584:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769589:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29c00/0x34dc807b6efab53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769619:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769624:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769628:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769631:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7d28e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.769634:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769638:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769645:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c69a000) 00010000:00010000:1.0:1746127008.769647:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.769649:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769652:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28e00/0x34dc807b6efab5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.769686:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d29a00/0x34dc807b6efab4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a83 expref: 39 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.769696:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a83 expref: 38 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.769701:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.769703:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127008.769705:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7d28a00, rc 0) 00000100:00100000:1.0:1746127008.769755:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4503:x1830945991807872:12345-192.168.203.42@tcp:101:cat.0 Request processed in 594us (961us total) trans 8589938309 rc 0/0 00000100:00100000:1.0:1746127008.769761:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17350 00000100:00100000:0.0:1746127008.772208:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.772298:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.772359:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991808256 00000100:00100000:2.0:1746127008.772368:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991808256 00000100:00100000:3.0:1746127008.772510:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991808128 00000100:00100000:3.0:1746127008.772515:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991808128 00000100:00100000:3.0:1746127008.772541:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6630 00000100:00100000:3.0:1746127008.772548:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4503:x1830945991808128:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127008.772716:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1031 00000100:00100000:2.0:1746127008.772723:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991808256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.772828:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.772852:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7d28a00/0x34dc807b6efab61 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a83 expref: 40 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.772870:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.772874:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.772915:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4503:x1830945991808128:12345-192.168.203.42@tcp:35:cat.0 Request processed in 367us (715us total) trans 8589938310 rc 0/0 00000100:00100000:3.0:1746127008.772922:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6630 00000100:00100000:2.0:1746127008.773266:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991808256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 543us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.773273:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1031 00000100:00100000:0.0:1746127008.775438:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.775578:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991808384 00000100:00100000:2.0:1746127008.775587:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991808384 00000100:00100000:2.0:1746127008.775629:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21932 00000100:00100000:2.0:1746127008.775637:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991808384:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.775654:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.775670:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6efab6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a8a expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.775727:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312576:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127008.776086:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbce40 going to sleep for 11 seconds 00002000:00010000:2.0:1746127008.777349:0:12340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127006 -> 1746127007 00002000:00010000:2.0:1746127008.777354:0:12340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127006 -> 1746127007 00002000:00010000:2.0:1746127008.777356:0:12340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127006 -> 1746127007 00000100:00100000:2.0:1746127008.777378:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312576:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127008.777405:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6efab6f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a8a expref: 39 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.777417:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bd200/0x34dc807b6efab6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a8a expref: 39 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.777432:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd200, rc 0) 00000100:00100000:2.0:1746127008.777466:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991808384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1829us (2036us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127008.777473:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21932 00000100:00100000:1.0:1746127008.782542:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.782590:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.782648:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991808640 00000100:00100000:2.0:1746127008.782658:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991808640 00002000:00100000:2.0:1746127008.782706:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880094b7aa00 x1830945991808640/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 504/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.782715:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b7aa00 with x1830945991808640 ext(0->1048575) 00002000:00010000:2.0:1746127008.782720:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b7aa00 00000100:00100000:2.0:1746127008.782756:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991808896 00000100:00100000:2.0:1746127008.782758:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991808896 00002000:00100000:2.0:1746127008.782770:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094b7b800 x1830945991808896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.782776:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b7b800 with x1830945991808896 ext(1048576->2097151) 00002000:00010000:2.0:1746127008.782779:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b7b800 00000100:00100000:2.0:1746127008.782790:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8805 00000100:00100000:2.0:1746127008.782797:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991808640:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127008.784060:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8806 00000100:00100000:3.0:1746127008.784070:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991808896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127008.793083:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991808640:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10273us (10537us total) trans 0 rc 851968/851968 00000100:00100000:2.0:1746127008.793097:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8805 00002000:00100000:2.0:1746127008.793110:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880094b7aa00 x1830945991808640/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 504/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 851968/851968 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.793126:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b7aa00 with x1830945991808640 ext(0->1048575) 00002000:00010000:2.0:1746127008.793160:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b7aa00 00000100:00100000:3.0:1746127008.795868:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991808896:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11789us (13266us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127008.795882:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8806 00002000:00100000:3.0:1746127008.795894:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880094b7b800 x1830945991808896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.795903:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b7b800 with x1830945991808896 ext(1048576->2097151) 00002000:00010000:3.0:1746127008.795908:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094b7b800 00000100:00100000:0.0:1746127008.803092:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.803154:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991809024 00000100:00100000:2.0:1746127008.803164:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991809024 00000100:00100000:2.0:1746127008.803242:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21933 00000100:00100000:2.0:1746127008.803250:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4503:x1830945991809024:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.803269:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.803289:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a91 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.803323:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 18 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.803330:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.803332:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127008.803336:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.803366:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 18 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.803378:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 18 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.803391:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312704:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.804120:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.804951:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312704:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.804975:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 39 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.804988:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfe800, rc 0) 00000100:00100000:2.0:1746127008.805041:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4503:x1830945991809024:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1790us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.805048:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21933 00000100:00100000:0.0:1746127008.806508:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.806569:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991809152 00000100:00100000:3.0:1746127008.806576:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991809152 00002000:00100000:3.0:1746127008.806625:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3837951) req@ffff880094824700 x1830945991809152/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.806635:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824700 with x1830945991809152 ext(3145728->3837951) 00010000:00010000:3.0:1746127008.806643:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 19 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.806657:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 19 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.806664:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094824700 00000100:00100000:3.0:1746127008.806695:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1958 00000100:00100000:3.0:1746127008.806702:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991809152:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127008.814638:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991809152:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 7925us (8124us total) trans 21474842911 rc 0/0 00000100:00100000:3.0:1746127008.814651:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1958 00002000:00100000:3.0:1746127008.814663:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3837951) req@ffff880094824700 x1830945991809152/t21474842911(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.814673:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094824700 with x1830945991809152 ext(3145728->3837951) 00010000:00010000:3.0:1746127008.814683:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 21 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.814699:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 21 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746127008.814706:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094824700 00000100:00100000:0.0:1746127008.816220:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.816314:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991809280 00000100:00100000:2.0:1746127008.816324:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991809280 00010000:00010000:2.0:1746127008.816360:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 21 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746127008.816397:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10333 00000100:00100000:2.0:1746127008.816403:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2028:x1830945991809280:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.816419:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.816444:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 21 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.816455:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 21 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.816478:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dfe00/0x34dc807b6efab1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3837951) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a6e expref: 21 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746127008.816514:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.816517:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127008.816524:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.816533:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.816567:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.816578:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994312832:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127008.816665:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.818758:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994312832:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127008.818781:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.818818:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991809280:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2414us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.818829:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10333 00000100:00100000:0.0:1746127008.825291:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.825394:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991809536 00000100:00100000:2.0:1746127008.825405:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991809536 00000100:00100000:2.0:1746127008.826900:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17351 00000100:00100000:2.0:1746127008.826914:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4506:x1830945991809536:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.826940:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.826959:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bff200/0x34dc807b6efab7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a98 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127008.827037:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127008.827044:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00000100:00100000:0.0:1746127008.827082:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.827096:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991809792 00000100:00100000:3.0:1746127008.827101:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991809792 00000100:00100000:0.0:1746127008.827108:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991810048 00000100:00100000:0.0:1746127008.827110:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991810048 00002000:00100000:3.0:1746127008.827146:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007edd7b80 x1830945991809792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127008.827146:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007edd5880 x1830945991810048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 504/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127008.827155:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5880 with x1830945991810048 ext(2097152->4194303) 00002000:00100000:3.0:1746127008.827159:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7b80 with x1830945991809792 ext(2097152->4194303) 00002000:00010000:0.0:1746127008.827160:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5880 00002000:00010000:3.0:1746127008.827162:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd7b80 00010000:00010000:2.0:1746127008.827196:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00000100:00100000:0.0:1746127008.827216:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8807 00000100:00100000:0.0:1746127008.827222:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991810048:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127008.827256:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827268:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827273:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827277:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827363:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827370:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827375:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:2.0:1746127008.827382:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127008.827445:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827450:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827455:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827460:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827466:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135bfee00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127008.827470:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827476:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827486:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127008.827489:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127008.827492:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827497:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfee00/0x34dc807b6efab84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827520:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827524:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827528:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827531:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135bfe200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127008.827533:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827537:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827543:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7a00) 00010000:00010000:2.0:1746127008.827545:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127008.827547:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827551:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfe200/0x34dc807b6efab8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:2.0:1746127008.827584:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bff200/0x34dc807b6efab7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 20 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.827594:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 19 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.827599:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.827601:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127008.827603:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfec00, rc 0) 00000100:00100000:2.0:1746127008.827648:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4506:x1830945991809536:12345-192.168.203.42@tcp:101:cat.0 Request processed in 739us (2368us total) trans 8589938311 rc 0/0 00000100:00100000:2.0:1746127008.827653:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17351 00000100:00100000:3.0:1746127008.827869:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8808 00000100:00100000:3.0:1746127008.827875:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991809792:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127008.834530:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.834723:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991810304 00000100:00100000:3.0:1746127008.834731:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991810304 00000100:00100000:3.0:1746127008.834768:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6631 00000100:00100000:3.0:1746127008.834775:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4506:x1830945991810304:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127008.835006:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4506:x1830945991810304:12345-192.168.203.42@tcp:35:cat.0 Request processed in 230us (481us total) trans 8589938312 rc 0/0 00000100:00100000:3.0:1746127008.835024:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6631 00000100:00100000:0.0:1746127008.840255:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.841008:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991810432 00000100:00100000:2.0:1746127008.841030:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991810432 00000100:00100000:2.0:1746127008.841079:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21934 00000100:00100000:2.0:1746127008.841086:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991810432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127008.841106:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.841124:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd00400/0x34dc807b6efaba0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53a9f expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127008.841218:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312960:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127008.841320:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.843411:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.843454:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.844605:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991810560 00000100:00100000:1.0:1746127008.844615:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991810560 00000100:00100000:1.0:1746127008.844663:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991810688 00000100:00100000:1.0:1746127008.844665:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991810688 00000100:00100000:1.0:1746127008.844681:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21935 00000100:00100000:1.0:1746127008.844688:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991810560:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127008.844706:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.844724:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53aa6 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.844726:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21936 00000100:00100000:3.0:1746127008.844740:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991810688:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127008.844748:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127008.844750:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.844754:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127008.844758:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 23 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.844767:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6efabae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53aad expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.844772:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 23 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127008.844783:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dc600, rc 0) 00000100:00100000:3.0:1746127008.844815:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994313088:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127008.844832:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991810560:12345-192.168.203.42@tcp:101:cat.0 Request processed in 144us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.844838:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21935 00000100:00100000:3.0:1746127008.844883:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127008.845624:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991810048:12345-192.168.203.42@tcp:3:cat.0 Request processed in 18400us (18539us total) trans 0 rc 1929216/1929216 00000100:00100000:2.0:1746127008.845634:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8807 00002000:00100000:2.0:1746127008.845643:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007edd5880 x1830945991810048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 504/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1929216/1929216 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.845652:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5880 with x1830945991810048 ext(2097152->4194303) 00002000:00010000:2.0:1746127008.845656:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd5880 00000100:00100000:2.0:1746127008.846823:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994312960:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127008.846855:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd00400/0x34dc807b6efaba0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a9f expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.846868:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd00400/0x34dc807b6efaba0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a9f expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127008.847574:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd00400, rc 0) 00000100:00100000:2.0:1746127008.847611:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2028:x1830945991810432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6524us (7365us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127008.847618:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21934 00000100:00100000:2.0:1746127008.849975:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991809792:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22089us (22927us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127008.849987:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8808 00002000:00100000:2.0:1746127008.850000:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007edd7b80 x1830945991809792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.850010:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7b80 with x1830945991809792 ext(2097152->4194303) 00002000:00010000:2.0:1746127008.850030:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd7b80 00002000:00010000:3.0:1746127008.850165:0:3542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127006 -> 1746127007 00000100:00100000:3.0:1746127008.850185:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994313088:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127008.850218:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6efabae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aad expref: 26 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.850239:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ca00/0x34dc807b6efabae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aad expref: 26 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.850266:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6ca00, rc 0) 00000100:00100000:3.0:1746127008.850288:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991810688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5552us (6833us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127008.850295:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21936 00000100:00100000:0.0:1746127008.855186:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.855295:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991810816 00000100:00100000:3.0:1746127008.855304:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991810816 00000100:00100000:3.0:1746127008.855362:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21937 00000100:00100000:3.0:1746127008.855371:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4506:x1830945991810816:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127008.855388:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.855406:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ab4 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.855437:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.855444:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.855447:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.855450:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 22 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.855482:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 38 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.855498:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 38 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.855510:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994313216:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.855590:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.860177:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.860306:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991811072 00000100:00100000:2.0:1746127008.860316:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991811072 00002000:00100000:2.0:1746127008.860362:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007edd4700 x1830945991811072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127008.860372:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4700 with x1830945991811072 ext(4194304->4829183) 00002000:00010000:2.0:1746127008.860377:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd4700 00000100:00100000:2.0:1746127008.860400:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8809 00000100:00100000:2.0:1746127008.860408:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991811072:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.862404:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.862472:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991811200 00000100:00100000:1.0:1746127008.862479:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991811200 00002000:00100000:1.0:1746127008.862514:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (303104->499711) req@ffff88009cc3d180 x1830945991811200/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.862523:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3d180 with x1830945991811200 ext(303104->499711) 00010000:00010000:1.0:1746127008.862532:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 41 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.862550:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 41 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.862557:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cc3d180 00000100:00100000:1.0:1746127008.862584:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1959 00000100:00100000:1.0:1746127008.862591:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991811200:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127008.862854:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994313216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.862877:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 22 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.862891:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2b000, rc 0) 00000100:00100000:3.0:1746127008.862916:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4506:x1830945991810816:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7546us (7739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.862923:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21937 00000100:00100000:3.0:1746127008.866647:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991811072:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6230us (6508us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127008.866658:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8809 00002000:00100000:3.0:1746127008.866668:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007edd4700 x1830945991811072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127008.866677:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4700 with x1830945991811072 ext(4194304->4829183) 00002000:00010000:3.0:1746127008.866683:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd4700 00000100:00100000:1.0:1746127008.869401:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991811200:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6799us (6995us total) trans 21474842912 rc 0/0 00000100:00100000:1.0:1746127008.869414:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1959 00002000:00100000:1.0:1746127008.869426:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (303104->499711) req@ffff88009cc3d180 x1830945991811200/t21474842912(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.869435:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3d180 with x1830945991811200 ext(303104->499711) 00010000:00010000:1.0:1746127008.869447:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 41 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.869463:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 41 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.869469:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cc3d180 00000100:00100000:0.0:1746127008.871302:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.871398:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991811328 00000100:00100000:3.0:1746127008.871407:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991811328 00000100:00100000:3.0:1746127008.871456:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21938 00000100:00100000:3.0:1746127008.871464:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991811328:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127008.871483:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.871501:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2b600/0x34dc807b6efabbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53abb expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.871557:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994313344:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127008.871886:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.872455:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.872697:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991811456 00000100:00100000:3.0:1746127008.872702:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991811456 00010000:00010000:3.0:1746127008.872725:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 43 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.872780:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10334 00000100:00100000:3.0:1746127008.872786:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991811456:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127008.872795:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127008.872814:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 43 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.872824:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 43 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.872844:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.872845:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.872857:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.872864:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.872894:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127008.872902:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994313472:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127008.873058:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00010000:00010000:3.0:1746127008.873808:0:3542:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff8800a5b99180 x1830945994313344) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 43 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746127008.873829:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8de400/0x34dc807b6efaaf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 303104->499711) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a4b expref: 43 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.873900:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994313344:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127008.873921:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c2b600/0x34dc807b6efabbc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53abb expref: 42 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.873931:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b600/0x34dc807b6efabbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53abb expref: 42 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.873939:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2b600, rc 0) 00000100:00100000:3.0:1746127008.873975:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991811328:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2512us (2684us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127008.873982:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21938 00000100:00100000:3.0:1746127008.874870:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994313472:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127008.874884:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127008.874906:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991811456:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2120us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.874913:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10334 00000100:00100000:0.0:1746127008.877613:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.877666:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.877734:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991811840 00000100:00100000:1.0:1746127008.877742:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991811840 00002000:00100000:1.0:1746127008.877792:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009cc3f480 x1830945991811840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.877801:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3f480 with x1830945991811840 ext(0->1048575) 00002000:00010000:1.0:1746127008.877807:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3f480 00000100:00100000:1.0:1746127008.877837:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8810 00000100:00100000:1.0:1746127008.877844:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991811840:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127008.878673:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991811584 00000100:00100000:3.0:1746127008.878678:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991811584 00000100:00100000:3.0:1746127008.878716:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21939 00000100:00100000:3.0:1746127008.878722:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991811584:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127008.878732:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.878748:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ac2 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.878767:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.878769:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127008.878777:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.878791:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127008.878801:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098672600, rc 0) 00000100:00100000:3.0:1746127008.878831:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991811584:12345-192.168.203.42@tcp:101:cat.0 Request processed in 108us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.878836:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21939 00000100:00100000:1.0:1746127008.884501:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991811840:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6645us (6890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127008.884514:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8810 00002000:00100000:1.0:1746127008.884527:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009cc3f480 x1830945991811840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.884536:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3f480 with x1830945991811840 ext(0->1048575) 00002000:00010000:1.0:1746127008.884542:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3f480 00010000:00010000:2.0:1746127008.902881:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127008.904272:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.904407:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991812096 00000100:00100000:1.0:1746127008.904417:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991812096 00002000:00100000:1.0:1746127008.904466:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009cc3c380 x1830945991812096/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.904476:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3c380 with x1830945991812096 ext(2097152->3145727) 00002000:00010000:1.0:1746127008.904482:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3c380 00000100:00100000:1.0:1746127008.904516:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8811 00000100:00100000:1.0:1746127008.904524:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991812096:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.913801:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.914205:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991812352 00000100:00100000:2.0:1746127008.914214:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991812352 00000100:00100000:2.0:1746127008.914261:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17352 00000100:00100000:2.0:1746127008.914268:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4509:x1830945991812352:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127008.914292:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.914308:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efabca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ac9 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.914388:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914402:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914413:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914426:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914431:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914440:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914632:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efabdf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914642:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efabdf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914648:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efabdf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127008.914658:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127008.914732:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914739:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914744:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914750:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914756:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127008.914760:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914766:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914778:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127008.914781:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127008.914786:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914791:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6200/0x34dc807b6efabd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914820:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914825:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914830:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914834:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb7200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127008.914836:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914841:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914847:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7400) 00010000:00010000:2.0:1746127008.914849:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127008.914851:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914855:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efabd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.914891:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efabca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac9 expref: 23 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.914901:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efabdf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac9 expref: 22 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.914907:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.914908:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127008.914910:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6400, rc 0) 00000100:00100000:2.0:1746127008.914975:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4509:x1830945991812352:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 707us (1182us total) trans 8589938313 rc 0/0 00000100:00100000:2.0:1746127008.914981:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17352 00000100:00100000:1.0:1746127008.918965:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991812096:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14431us (14689us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127008.918977:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8811 00002000:00100000:1.0:1746127008.918988:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009cc3c380 x1830945991812096/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.918997:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3c380 with x1830945991812096 ext(2097152->3145727) 00002000:00010000:1.0:1746127008.919004:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3c380 00000100:00100000:0.0:1746127008.921043:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.921093:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.921110:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991812608 00000100:00100000:3.0:1746127008.921152:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991812608 00000100:00100000:2.0:1746127008.921158:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991812736 00000100:00100000:2.0:1746127008.921163:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991812736 00000100:00100000:3.0:1746127008.921207:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6632 00000100:00100000:2.0:1746127008.921209:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1032 00000100:00100000:3.0:1746127008.921215:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4509:x1830945991812608:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127008.921215:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991812736:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127008.921228:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127008.921253:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efabdf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac9 expref: 23 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.921271:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127008.921274:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127008.921309:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991812736:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127008.921315:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1032 00000100:00100000:3.0:1746127008.921385:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4509:x1830945991812608:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 171us (349us total) trans 8589938314 rc 0/0 00000100:00100000:3.0:1746127008.921391:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6632 00000100:00100000:2.0:1746127008.925775:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.925957:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991812864 00000100:00100000:3.0:1746127008.925967:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991812864 00000100:00100000:3.0:1746127008.926032:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21940 00000100:00100000:3.0:1746127008.926041:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4506:x1830945991812864:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127008.926059:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127008.926078:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ad0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.926111:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.926119:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.926121:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127008.926124:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.926191:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.926204:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 45 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746127008.926216:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994313600:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127008.926464:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.931747:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127008.931898:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994313600:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127008.931929:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 26 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127008.931947:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673800, rc 0) 00000100:00100000:3.0:1746127008.932008:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4506:x1830945991812864:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5968us (6242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127008.932027:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21940 00000100:00100000:1.0:1746127008.932571:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991812992 00000100:00100000:1.0:1746127008.932579:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991812992 00002000:00100000:1.0:1746127008.932617:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2408448->2576383) req@ffff88009c74aa00 x1830945991812992/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.932627:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74aa00 with x1830945991812992 ext(2408448->2576383) 00010000:00010000:1.0:1746127008.932633:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.932644:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 46 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.932650:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c74aa00 00000100:00100000:1.0:1746127008.932672:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1960 00000100:00100000:1.0:1746127008.932678:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991812992:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127008.939384:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2028:x1830945991812992:12345-192.168.203.42@tcp:4:cat.0 Request processed in 6695us (7637us total) trans 17179875643 rc 0/0 00000100:00100000:1.0:1746127008.939395:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1960 00002000:00100000:1.0:1746127008.939406:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2408448->2576383) req@ffff88009c74aa00 x1830945991812992/t17179875643(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:14/0 lens 488/448 e 0 to 0 dl 1746127019 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.939416:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74aa00 with x1830945991812992 ext(2408448->2576383) 00010000:00010000:1.0:1746127008.939425:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 48 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.939439:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 48 pid: 12340 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746127008.939447:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c74aa00 00000100:00100000:0.0:1746127008.942550:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.942652:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991813120 00000100:00100000:1.0:1746127008.942662:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991813120 00010000:00010000:1.0:1746127008.942703:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 48 pid: 12340 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746127008.942744:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10335 00000100:00100000:1.0:1746127008.942751:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991813120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127008.942765:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127008.942786:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 48 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.942798:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 48 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.942821:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd000/0x34dc807b6efab45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->2576383) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a7c expref: 48 pid: 12340 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746127008.942853:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127008.942855:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127008.942865:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.942874:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.942913:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127008.942925:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994313728:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127008.943002:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746127008.951585:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c429880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994313728:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127008.951612:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127008.951661:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991813120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8909us (9118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.951671:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10335 00000100:00100000:0.0:1746127008.964826:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.964870:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.964892:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991813504 00000100:00100000:2.0:1746127008.964902:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991813504 00000100:00100000:0.0:1746127008.964910:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127008.965239:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991813760 00000100:00100000:1.0:1746127008.965244:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991813760 00002000:00100000:1.0:1746127008.965282:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c749f80 x1830945991813760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.965292:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749f80 with x1830945991813760 ext(2097152->4194303) 00002000:00010000:1.0:1746127008.965297:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c749f80 00000100:00100000:1.0:1746127008.965316:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814016 00000100:00100000:1.0:1746127008.965318:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814016 00002000:00100000:1.0:1746127008.965331:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c74b800 x1830945991814016/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/0 e 0 to 0 dl 1746127019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127008.965337:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74b800 with x1830945991814016 ext(3145728->4194303) 00002000:00010000:1.0:1746127008.965340:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c74b800 00000100:00100000:1.0:1746127008.965360:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8812 00000100:00100000:1.0:1746127008.965367:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991813760:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127008.965516:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127008.965533:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991813376 00000100:00100000:0.0:1746127008.965536:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991813376 00000100:00100000:3.0:1746127008.965748:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8813 00000100:00100000:3.0:1746127008.965757:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991814016:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127008.966364:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17353 00000100:00100000:2.0:1746127008.966372:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4510:x1830945991813504:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127008.966389:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127008.966408:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6efabf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ade expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.966524:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966539:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966553:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966567:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966572:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966577:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966639:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966650:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 21 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.966661:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127008.966692:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 21 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127008.966705:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 21 pid: 13466 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127008.966718:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994313856:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127008.966796:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127008.967511:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17354 00000100:00100000:0.0:1746127008.967520:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4512:x1830945991813376:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127008.967532:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127008.967541:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369200/0x34dc807b6efac10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ad7 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.967698:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967708:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967716:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967723:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967729:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967734:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967802:0:11634:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369e00/0x34dc807b6efac25 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967811:0:11634:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369e00/0x34dc807b6efac25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967817:0:11634:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369e00/0x34dc807b6efac25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00000004:00200000:0.0:1746127008.967826:0:11634:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127008.967891:0:11634:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967897:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967903:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967908:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967913:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e369000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127008.967916:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967922:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967931:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127008.967934:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127008.967937:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.967942:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369000/0x34dc807b6efac17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968180:0:11634:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968190:0:11634:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968195:0:11634:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968199:0:11634:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e368a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127008.968201:0:11634:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968205:0:11634:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968212:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7d00) 00010000:00010000:0.0:1746127008.968214:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127008.968216:0:11634:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968221:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e368a00/0x34dc807b6efac1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11634 initiator: MDT0 00010000:00010000:0.0:1746127008.968453:0:11634:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369200/0x34dc807b6efac10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad7 expref: 41 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.968464:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369e00/0x34dc807b6efac25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad7 expref: 40 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127008.968471:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127008.968473:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746127008.968475:0:11634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127008.968485:0:11634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127008.968490:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e369e00, rc 0) 00000100:00100000:0.0:1746127008.968516:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4512:x1830945991813376:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 998us (2999us total) trans 8589938315 rc 0/0 00000100:00100000:0.0:1746127008.968522:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17354 00000100:00100000:0.0:1746127008.993297:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127008.997400:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994313856:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127008.997432:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127008.999174:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814144 00000100:00100000:1.0:1746127008.999186:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814144 00010000:00010000:1.0:1746127008.999228:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 22 pid: 13466 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127008.999271:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10336 00000100:00100000:1.0:1746127008.999278:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991814144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127008.999295:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127008.999300:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 22 pid: 13466 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127008.999310:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 22 pid: 13466 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127008.999333:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efaab2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a28 expref: 22 pid: 13466 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127008.999367:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.999371:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999381:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999388:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999410:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127008.999472:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991814144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 193us (6184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.999481:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10336 00010000:00010000:1.0:1746127008.999518:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999524:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:1.0:1746127008.999579:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127008.999584:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127008.999601:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999611:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999622:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999628:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999634:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999640:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999646:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.999650:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999656:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999667:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127008.999670:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.999673:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999678:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efabfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999687:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999692:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999695:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999699:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb7000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127008.999701:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999705:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999711:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7d00) 00010000:00010000:1.0:1746127008.999714:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127008.999716:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999720:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efac02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127008.999750:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6800/0x34dc807b6efabf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.999761:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 9 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127008.999767:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127008.999769:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127008.999771:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6400, rc 0) 00000100:00100000:1.0:1746127008.999798:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4510:x1830945991813504:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 33428us (34983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127008.999804:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17353 00000100:00100000:0.0:1746127009.011264:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.012169:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814272 00000100:00100000:3.0:1746127009.012178:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814272 00000100:00100000:3.0:1746127009.012241:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21941 00000100:00100000:3.0:1746127009.012248:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4509:x1830945991814272:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127009.012266:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.012281:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ae5 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.012310:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 25 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.012318:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 40 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.012328:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.012330:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.012333:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1380352->2015231] (req 1380352->2015231) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.012362:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 40 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.012372:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 40 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.012383:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994313984:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.012476:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 25 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.012483:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 25 pid: 3148 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.012490:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994314112:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.012503:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00080000:2.0:1746127009.012560:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746127009.019043:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991813760:12345-192.168.203.42@tcp:3:cat.0 Request processed in 53663us (54159us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127009.019055:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8812 00002000:00100000:2.0:1746127009.019066:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c749f80 x1830945991813760/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.019077:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c749f80 with x1830945991813760 ext(2097152->4194303) 00002000:00010000:2.0:1746127009.019082:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c749f80 00000100:00100000:1.0:1746127009.019842:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.019942:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994313984:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.019953:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994314112:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.019983:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1380352->2015231] (req 1380352->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.020005:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673000, rc 0) 00000100:00100000:3.0:1746127009.020041:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4509:x1830945991814272:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7794us (8786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.020047:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21941 00000100:00100000:2.0:1746127009.020475:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814400 00000100:00100000:2.0:1746127009.020482:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814400 00010000:00010000:2.0:1746127009.020509:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 25 pid: 3148 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.020532:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10337 00000100:00100000:2.0:1746127009.020538:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991814400:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.020550:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.020571:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 25 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.020586:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 25 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.020611:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bd600/0x34dc807b6efaac0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a2f expref: 25 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.020625:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.020643:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991814400:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 106us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.020649:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10337 00000100:00100000:0.0:1746127009.034038:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.034113:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.034175:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.034195:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.034212:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.034223:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.034252:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.034275:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814784 00000100:00100000:0.0:1746127009.034283:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814784 00000100:00100000:0.0:1746127009.034326:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814912 00000100:00100000:0.0:1746127009.034328:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814912 00000100:00100000:0.0:1746127009.034348:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991815168 00000100:00100000:0.0:1746127009.034350:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991815168 00000100:00100000:0.0:1746127009.034359:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991815040 00000100:00100000:0.0:1746127009.034361:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991815040 00000100:00100000:0.0:1746127009.034369:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991815296 00000100:00100000:0.0:1746127009.034370:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991815296 00000100:00100000:0.0:1746127009.034382:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21942 00000100:00100000:0.0:1746127009.034388:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991814784:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.034409:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.034425:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53aec expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.034447:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.034449:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.034458:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.034472:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.034484:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e368e00, rc 0) 00000100:00100000:0.0:1746127009.034527:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991814784:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 138us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.034532:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21942 00000100:00100000:0.0:1746127009.034548:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21943 00000100:00100000:0.0:1746127009.034552:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991814912:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.034557:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.034566:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53af3 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.034576:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.034577:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.034582:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.034592:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.034598:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e368a00, rc 0) 00000100:00100000:0.0:1746127009.034609:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991814912:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 57us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.034613:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21943 00000100:00100000:0.0:1746127009.037850:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21944 00000100:00100000:0.0:1746127009.037866:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991815168:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.037895:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.037913:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b01 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.037937:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.037939:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.037948:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.037961:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.037971:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e369000, rc 0) 00000100:00100000:0.0:1746127009.038088:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991815168:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 226us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.038094:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21944 00000100:00100000:0.0:1746127009.038117:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21945 00000100:00100000:0.0:1746127009.038123:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991815040:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.038163:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.038170:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e368c00/0x34dc807b6efac4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53afa expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.038180:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.038190:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e368c00/0x34dc807b6efac4f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53afa expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.038197:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e368c00/0x34dc807b6efac4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53afa expref: 11 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.038214:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e368c00, rc 0) 00000100:00100000:0.0:1746127009.038230:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991815040:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 107us (4005us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127009.038235:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21945 00000100:00100000:0.0:1746127009.038245:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21946 00000100:00100000:0.0:1746127009.038251:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991815296:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.038316:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.038327:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b08 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.038338:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.038339:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.038343:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 10 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.038352:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 10 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.038358:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e369400, rc 0) 00000100:00100000:0.0:1746127009.038402:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991815296:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 150us (4149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.038406:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21946 00000100:00080000:0.0:1746127009.039555:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746127009.040264:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814528 00000100:00100000:1.0:1746127009.040273:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814528 00010000:00010000:1.0:1746127009.040305:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 41 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.040331:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991814656 00000100:00100000:1.0:1746127009.040333:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991814656 00000100:00100000:0.0:1746127009.040355:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10338 00000100:00100000:0.0:1746127009.040363:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991814528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.040373:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.040394:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 41 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.040406:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 41 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.040426:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8df800/0x34dc807b6efaace lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a44 expref: 41 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.040437:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.040438:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.040443:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 23 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.040450:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 23 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.040484:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 22 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.040496:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994314240:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127009.040499:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991814016:12345-192.168.203.42@tcp:3:cat.0 Request processed in 74743us (75587us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127009.040617:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4b40 going to sleep for 11 seconds 00000100:00080000:0.0:1746127009.040637:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746127009.041452:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1033 00000100:00100000:1.0:1746127009.041567:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991814656:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.041577:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.041595:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369e00/0x34dc807b6efac25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad7 expref: 40 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.041614:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127009.041619:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.041637:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991814656:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 74us (7524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.041645:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1033 00000100:00100000:3.0:1746127009.042661:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8813 00002000:00100000:3.0:1746127009.042676:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c74b800 x1830945991814016/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:14/0 lens 488/440 e 0 to 0 dl 1746127019 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.042685:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c74b800 with x1830945991814016 ext(3145728->4194303) 00002000:00010000:3.0:1746127009.042689:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c74b800 00000100:00100000:2.0:1746127009.046888:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.046957:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991815424 00000100:00100000:3.0:1746127009.046966:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991815424 00000100:00100000:1.0:1746127009.047028:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994314240:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127009.047029:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21947 00000100:00100000:3.0:1746127009.047037:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4512:x1830945991815424:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127009.047051:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127009.047056:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.047075:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b0f expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.047104:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.047110:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991814528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6747us (13082us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127009.047113:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127009.047119:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10338 00010000:00010000:3.0:1746127009.047125:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 21 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.047152:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.047154:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.047158:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3436544->3850239] (req 3436544->3850239) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 41 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.047187:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 21 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.047199:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 21 pid: 1964 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.047212:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994314368:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.047275:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 9 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.047283:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 9 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.047292:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994314496:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.047317:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 41 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.047328:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 41 pid: 12340 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.047335:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994314624:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.047349:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.047857:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.047968:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991815680 00000100:00100000:1.0:1746127009.047972:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991815680 00000100:00100000:1.0:1746127009.048018:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17355 00000100:00100000:1.0:1746127009.048024:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4510:x1830945991815680:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127009.048034:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.048045:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32000/0x34dc807b6efac64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b16 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746127009.048153:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746127009.048500:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127009.048513:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.048520:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127009.048691:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.048699:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 10 pid: 7258 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.048713:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994314752:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.048773:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.048908:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.050005:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991815936 00000100:00100000:3.0:1746127009.050021:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991815936 00002000:00100000:3.0:1746127009.050060:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1380352->1384447) req@ffff88008c5bed80 x1830945991815936/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.050069:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bed80 with x1830945991815936 ext(1380352->1384447) 00002000:00010000:3.0:1746127009.050074:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bed80 00000100:00100000:3.0:1746127009.050102:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8814 00000100:00100000:3.0:1746127009.050108:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991815936:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127009.050733:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991815936:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 621us (1820us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127009.050740:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8814 00002000:00100000:3.0:1746127009.050746:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1380352->1384447) req@ffff88008c5bed80 x1830945991815936/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.050753:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bed80 with x1830945991815936 ext(1380352->1384447) 00002000:00010000:3.0:1746127009.050756:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bed80 00000100:00100000:0.0:1746127009.054436:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.054467:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.054495:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991816064 00000100:00100000:0.0:1746127009.054497:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.054503:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991816064 00000100:00100000:0.0:1746127009.054526:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.054529:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994314368:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.054539:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994314496:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.054539:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 10 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.054547:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994314624:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.054561:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991816320 00000100:00100000:1.0:1746127009.054563:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991816320 00010000:00010000:1.0:1746127009.054572:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 22 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.054575:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3436544->3850239] (req 3436544->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 41 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.054580:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991816448 00000100:00100000:0.0:1746127009.054583:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991816448 00000100:00100000:1.0:1746127009.054586:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10339 00010000:00010000:3.0:1746127009.054589:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2ba00, rc 0) 00000100:00100000:1.0:1746127009.054592:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991816064:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.054596:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 42 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.054602:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127009.054614:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10340 00000100:00100000:0.0:1746127009.054619:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991816320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.054621:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 10 pid: 9612 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.054626:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.054629:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 10 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.054632:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4512:x1830945991815424:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7596us (7756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.054638:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21947 00010000:00010000:0.0:1746127009.054638:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 22 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.054650:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e369000/0x34dc807b6efac48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b01 expref: 10 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.054655:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991816192 00000100:00100000:3.0:1746127009.054657:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991816192 00000100:00100000:3.0:1746127009.054670:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21948 00000100:00100000:3.0:1746127009.054674:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991816192:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.054687:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.054696:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efac72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b1d expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.054699:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10341 00000100:00100000:2.0:1746127009.054706:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991816448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.054714:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.054768:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 24 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.054782:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dc600/0x34dc807b6efaba7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aa6 expref: 24 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.054795:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.054813:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991816320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 194us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.054819:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10340 00000100:00100000:0.0:1746127009.054850:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c429880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994314752:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.054869:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127009.055244:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127009.055245:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.055253:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efac72 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b1d expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.055262:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efac72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b1d expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127009.055263:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991816064:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 671us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.055269:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10339 00010000:00010000:3.0:1746127009.055280:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45a00, rc 0) 00000100:00100000:3.0:1746127009.055295:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991816192:12345-192.168.203.42@tcp:101:cat.0 Request processed in 620us (828us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127009.055303:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21948 00010000:00010000:2.0:1746127009.055519:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 41 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.055529:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 41 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.055542:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bfe800/0x34dc807b6efab76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a91 expref: 41 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.055565:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.055567:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.055574:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.055582:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.055610:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.055621:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994314880:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127009.055678:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7fbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.055823:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.055883:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991816576 00000100:00100000:1.0:1746127009.055886:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991816576 00010000:00010000:1.0:1746127009.055902:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 11 pid: 7258 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.055928:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10342 00000100:00100000:1.0:1746127009.055933:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991816576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.055941:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.055946:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 11 pid: 7258 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.055954:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 11 pid: 7258 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.055966:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6efac09 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ade expref: 11 pid: 7258 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.056112:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127009.056117:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127009.056125:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127009.056151:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127009.056168:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.056198:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991816576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 264us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.056204:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10342 00010000:00010000:0.0:1746127009.057597:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127009.057608:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:0.0:1746127009.057634:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127009.057764:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32000/0x34dc807b6efac64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.057780:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.057787:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.057789:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746127009.057793:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32e00, rc 0) 00000100:00100000:1.0:1746127009.058179:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.058203:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991816704 00000100:00100000:3.0:1746127009.058210:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991816704 00000100:00100000:1.0:1746127009.058219:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.058240:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21949 00000100:00100000:3.0:1746127009.058245:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4506:x1830945991816704:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.058258:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.058271:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b24 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.058277:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994314880:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127009.058292:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.058294:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127009.058299:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127009.058301:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127009.058305:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 22 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.058314:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991816448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3608us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.058321:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10341 00010000:00010000:3.0:1746127009.058327:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.058338:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 39 pid: 3148 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.058349:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994315008:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.058385:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.058401:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991816960 00000100:00100000:3.0:1746127009.058404:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991816960 00002000:00100000:3.0:1746127009.058425:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3436544->3440639) req@ffff88009c428000 x1830945991816960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.058434:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428000 with x1830945991816960 ext(3436544->3440639) 00010000:00010000:3.0:1746127009.058439:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.058448:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.058454:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c428000 00000100:00100000:3.0:1746127009.058472:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1961 00000100:00100000:3.0:1746127009.058477:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991816960:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127009.058500:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4510:x1830945991815680:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 10083us (10250us total) trans 8589938316 rc 0/0 00000100:00100000:0.0:1746127009.058576:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17355 00000100:00100000:3.0:1746127009.059251:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991816960:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 771us (1029us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127009.059257:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1961 00002000:00100000:3.0:1746127009.059263:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3436544->3440639) req@ffff88009c428000 x1830945991816960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.059271:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428000 with x1830945991816960 ext(3436544->3440639) 00010000:00010000:3.0:1746127009.059277:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.059287:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.059294:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c428000 00000100:00100000:1.0:1746127009.061023:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.061123:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991817088 00000100:00100000:0.0:1746127009.061145:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991817088 00000100:00100000:0.0:1746127009.061188:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17356 00000100:00100000:0.0:1746127009.061196:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4510:x1830945991817088:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.061216:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.061233:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369200/0x34dc807b6efac87 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b2b expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.061314:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127009.061328:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.061335:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127009.061361:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.061370:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 11 pid: 7258 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.061380:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994315136:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.061503:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.061674:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.061793:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994315008:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.061813:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 22 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.061830:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45600, rc 0) 00000100:00100000:3.0:1746127009.061858:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4506:x1830945991816704:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3612us (3679us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.061865:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21949 00000100:00100000:3.0:1746127009.061998:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991817344 00000100:00100000:3.0:1746127009.062001:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991817344 00002000:00100000:3.0:1746127009.062031:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (2011136->2015231) req@ffff88009c42b480 x1830945991817344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.062040:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b480 with x1830945991817344 ext(2011136->2015231) 00002000:00010000:3.0:1746127009.062044:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42b480 00000100:00100000:3.0:1746127009.062067:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8815 00000100:00100000:3.0:1746127009.062073:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991817344:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127009.062333:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991817344:12345-192.168.203.42@tcp:3:cat.0 Request processed in 260us (659us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127009.062338:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8815 00002000:00100000:3.0:1746127009.062343:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (2011136->2015231) req@ffff88009c42b480 x1830945991817344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.062350:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b480 with x1830945991817344 ext(2011136->2015231) 00002000:00010000:3.0:1746127009.062353:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42b480 00000100:00100000:2.0:1746127009.062755:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994315136:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.062772:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127009.063218:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.064747:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991817472 00000100:00100000:2.0:1746127009.064755:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991817472 00010000:00010000:2.0:1746127009.064790:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 12 pid: 7258 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.064818:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10343 00000100:00100000:2.0:1746127009.064825:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991817472:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.064840:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.064845:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 12 pid: 7258 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.064855:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 12 pid: 7258 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.064878:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32e00/0x34dc807b6efac6b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b16 expref: 12 pid: 7258 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.064893:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.064897:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.064906:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.064912:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.064932:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.064970:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991817472:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 145us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.064976:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10343 00010000:00010000:2.0:1746127009.065004:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.065010:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127009.065071:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127009.065076:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127009.065090:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.065117:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369200/0x34dc807b6efac87 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b2b expref: 11 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.065142:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b2b expref: 10 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.065148:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.065150:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127009.065152:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e369a00, rc 0) 00000100:00100000:2.0:1746127009.065173:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4510:x1830945991817088:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3979us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.065178:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17356 00000100:00100000:2.0:1746127009.065226:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.065351:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991817728 00000100:00100000:3.0:1746127009.065355:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991817728 00002000:00100000:3.0:1746127009.065377:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3846144->3850239) req@ffff8801303d3800 x1830945991817728/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.065385:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d3800 with x1830945991817728 ext(3846144->3850239) 00010000:00010000:3.0:1746127009.065391:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.065401:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.065407:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801303d3800 00000100:00100000:3.0:1746127009.065423:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1962 00000100:00100000:3.0:1746127009.065428:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991817728:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127009.065515:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991817728:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 87us (289us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127009.065520:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1962 00002000:00100000:3.0:1746127009.065524:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3846144->3850239) req@ffff8801303d3800 x1830945991817728/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.065530:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801303d3800 with x1830945991817728 ext(3846144->3850239) 00010000:00010000:3.0:1746127009.065534:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.065542:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.065547:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801303d3800 00000100:00100000:3.0:1746127009.065956:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.066559:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991817984 00000100:00100000:0.0:1746127009.066563:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991817984 00000100:00100000:0.0:1746127009.066593:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6633 00000100:00100000:0.0:1746127009.066598:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4509:x1830945991817984:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746127009.066729:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4509:x1830945991817984:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 131us (774us total) trans 8589938317 rc 0/0 00000100:00100000:0.0:1746127009.066734:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6633 00000100:00080000:0.0:1746127009.066747:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746127009.067731:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.067770:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.067832:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991818112 00000100:00100000:3.0:1746127009.067836:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991818112 00000100:00100000:3.0:1746127009.067859:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991818240 00000100:00100000:3.0:1746127009.067861:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991818240 00000100:00100000:3.0:1746127009.069116:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21950 00000100:00100000:3.0:1746127009.069141:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991818112:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127009.069159:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.069177:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f44e00/0x34dc807b6efac95 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b32 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.069229:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994315264:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127009.069305:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.069607:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21951 00000100:00100000:0.0:1746127009.069615:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991818240:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.069622:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.069629:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc32600/0x34dc807b6efac9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b39 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.069655:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994315392:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127009.069678:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.069709:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.069785:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.070294:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991818752 00000100:00100000:3.0:1746127009.070300:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991818752 00002000:00100000:3.0:1746127009.070335:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (3436544->3850239) req@ffff880094b78380 x1830945991818752/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.070343:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78380 with x1830945991818752 ext(3436544->3850239) 00010000:00010000:3.0:1746127009.070349:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.070360:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 40 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.070366:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78380 00000100:00100000:3.0:1746127009.070395:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1963 00000100:00100000:3.0:1746127009.070401:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991818752:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127009.070675:0:24187:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991818624 00000100:00100000:3.0:1746127009.070678:0:24187:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991818624 00002000:00010000:2.0:1746127009.071124:0:3542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746127006 -> 1746127007 00002000:00010000:2.0:1746127009.071148:0:3542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746127006 -> 1746127007 00000100:00100000:2.0:1746127009.071161:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994315264:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127009.071185:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f44e00/0x34dc807b6efac95 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b32 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.071196:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f44e00/0x34dc807b6efac95 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b32 expref: 12 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.071205:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44e00, rc 0) 00000100:00100000:2.0:1746127009.071233:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991818112:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2108us (3503us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127009.071241:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21950 00000100:00100000:3.0:1746127009.071643:0:24187:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6634 00000100:00100000:3.0:1746127009.071651:0:24187:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4512:x1830945991818624:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127009.071811:0:24187:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4512:x1830945991818624:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 162us (2101us total) trans 8589938318 rc 0/0 00000100:00100000:3.0:1746127009.071817:0:24187:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6634 00000100:00100000:0.0:1746127009.072079:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994315392:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127009.072098:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc32600/0x34dc807b6efac9c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b39 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.072106:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc32600/0x34dc807b6efac9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b39 expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.072115:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32600, rc 0) 00000100:00100000:0.0:1746127009.072152:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991818240:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2537us (4380us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127009.072157:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21951 00000100:00100000:0.0:1746127009.077887:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.078210:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819008 00000100:00100000:2.0:1746127009.078219:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819008 00000100:00100000:2.0:1746127009.078269:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17357 00000100:00100000:2.0:1746127009.078277:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4510:x1830945991819008:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127009.078296:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.078313:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efaca3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b40 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.078403:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.078418:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.078428:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127009.078441:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127009.078512:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6efaca3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 13 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.078526:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 12 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.078532:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.078535:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127009.078537:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6e00, rc 0) 00000100:00100000:2.0:1746127009.078593:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4510:x1830945991819008:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 316us (716us total) trans 8589938319 rc 0/0 00000100:00100000:2.0:1746127009.078599:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17357 00000100:00100000:3.0:1746127009.079108:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991818752:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8706us (9321us total) trans 21474842913 rc 0/0 00000100:00100000:3.0:1746127009.079285:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1963 00002000:00100000:3.0:1746127009.079295:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (3436544->3850239) req@ffff880094b78380 x1830945991818752/t21474842913(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.079304:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78380 with x1830945991818752 ext(3436544->3850239) 00010000:00010000:3.0:1746127009.079311:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 42 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.079323:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 42 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.079328:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78380 00000100:00100000:0.0:1746127009.081294:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.081332:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.081360:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.081376:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.081392:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.081417:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819136 00000100:00100000:0.0:1746127009.081424:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819136 00000100:00100000:0.0:1746127009.081458:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819392 00000100:00100000:0.0:1746127009.081459:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819392 00000100:00100000:0.0:1746127009.081470:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819648 00000100:00100000:0.0:1746127009.081472:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819648 00000100:00100000:0.0:1746127009.081482:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819264 00000100:00100000:0.0:1746127009.081484:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819264 00000100:00100000:0.0:1746127009.081492:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819520 00000100:00100000:0.0:1746127009.081493:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819520 00000100:00100000:0.0:1746127009.081505:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21952 00000100:00100000:0.0:1746127009.081511:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991819136:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127009.081605:0:12333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081622:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081633:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.081640:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.081646:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.081648:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.081651:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081682:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.081692:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.081706:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994315520:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.081786:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.081793:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 11 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.081800:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994315648:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.081823:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081831:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 21 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.081837:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994315776:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.081848:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.081868:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21953 00000100:00100000:0.0:1746127009.081873:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991819392:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127009.081890:0:1964:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081900:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081907:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.081913:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081917:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.081918:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.081920:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081936:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.081943:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 25 pid: 12340 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.081950:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994315904:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.081968:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.081975:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 11 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.081981:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994316032:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.082002:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082009:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.082028:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994316160:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.082043:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.082064:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21954 00000100:00100000:0.0:1746127009.082069:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991819648:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127009.082085:0:11152:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082093:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127009.082097:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082101:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746127009.082103:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082124:0:11152:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082153:0:11152:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.082174:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21955 00000100:00100000:0.0:1746127009.082179:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991819264:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127009.082194:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082203:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 25 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082209:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082221:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 46 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082226:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.082228:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.082229:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082242:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 46 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082249:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 46 pid: 12333 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.082257:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994316416:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.082295:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082303:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 11 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.082310:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994316544:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.082333:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 25 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082345:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 25 pid: 1964 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.082352:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994316672:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.082364:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.082383:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21956 00000100:00100000:0.0:1746127009.082388:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991819520:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127009.082404:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082414:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082419:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127009.082420:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127009.082422:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082437:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082445:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 21 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.082452:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c74a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994316800:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.082467:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009da4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.082540:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.082556:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819776 00000100:00100000:0.0:1746127009.082559:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819776 00000100:00100000:0.0:1746127009.082585:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21957 00000100:00100000:0.0:1746127009.082589:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991819776:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127009.082603:0:9611:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082613:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082619:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082624:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.082625:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.082627:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082640:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.082647:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 12 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.082654:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994316928:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.082676:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 25 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082683:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 25 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.082690:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994317056:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.082702:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011dd64900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.082766:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.082783:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991819904 00000100:00100000:0.0:1746127009.082786:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991819904 00010000:00010000:0.0:1746127009.082801:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 42 pid: 3148 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.082817:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10344 00000100:00100000:0.0:1746127009.082821:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991819904:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.082828:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.082844:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 42 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.082853:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 42 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.082869:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ba00/0x34dc807b6efac5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3436544->3850239) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b0f expref: 42 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.082882:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.082884:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.082888:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082895:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082916:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 21 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.082924:0:11948:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 21 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.082931:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994317184:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127009.082945:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.096380:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994315520:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.096393:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994315648:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.096400:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994315776:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.096425:0:12333:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.096660:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.097393:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991820160 00000100:00100000:3.0:1746127009.097401:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991820160 00000100:00100000:1.0:1746127009.097485:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.097538:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.097553:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991820288 00000100:00100000:1.0:1746127009.097556:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991820288 00010000:00010000:1.0:1746127009.097584:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 12 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.097606:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991820416 00000100:00100000:1.0:1746127009.097608:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991820416 00010000:00010000:1.0:1746127009.097617:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 22 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.097630:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10345 00000100:00100000:1.0:1746127009.097636:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991820288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.097649:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.097669:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 12 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.097679:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 12 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.097702:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e368e00/0x34dc807b6efac3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53aec expref: 12 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.097724:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.097766:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991820288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 129us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.097772:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10345 00000100:00100000:1.0:1746127009.097785:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10346 00000100:00100000:1.0:1746127009.097789:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991820416:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.097795:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.097801:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 22 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.097809:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 22 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.097820:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efabb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ab4 expref: 22 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.097827:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.097839:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2029:x1830945991820416:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 50us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.097844:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10346 00000100:00100000:1.0:1746127009.097867:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.097879:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991820544 00000100:00100000:1.0:1746127009.097881:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991820544 00010000:00010000:1.0:1746127009.097892:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 13 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.097904:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10347 00000100:00100000:1.0:1746127009.097908:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991820544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.097915:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.097926:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 13 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.097934:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 13 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.097946:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.097958:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991820544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.097963:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10347 00000100:00100000:1.0:1746127009.098035:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098044:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991820672 00000100:00100000:1.0:1746127009.098046:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991820672 00010000:00010000:1.0:1746127009.098062:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 26 pid: 12340 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.098073:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10348 00000100:00100000:1.0:1746127009.098077:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991820672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.098082:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.098088:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 26 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.098097:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 26 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.098107:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.098118:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991820672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 40us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.098122:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10348 00000100:00080000:1.0:1746127009.098152:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746127009.098200:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994316416:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.098279:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994316544:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.098294:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098301:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991820800 00000100:00100000:1.0:1746127009.098303:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991820800 00010000:00010000:1.0:1746127009.098311:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.098322:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10349 00000100:00100000:1.0:1746127009.098327:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991820800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.098333:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.098340:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098348:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098363:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b83600/0x34dc807b6efa9d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e539a3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098373:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.098385:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991820800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 58us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.098390:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10349 00000100:00100000:1.0:1746127009.098418:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994316672:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.098440:0:1507:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.098497:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098529:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098536:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991820928 00000100:00100000:1.0:1746127009.098538:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991820928 00010000:00010000:1.0:1746127009.098548:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 47 pid: 12333 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.098559:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10350 00000100:00100000:1.0:1746127009.098562:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991820928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.098568:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.098573:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 47 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098581:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 47 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098592:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efa93f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53941 expref: 47 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098600:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.098611:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991820928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 48us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.098615:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10350 00000100:00100000:1.0:1746127009.098634:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098641:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991821184 00000100:00100000:1.0:1746127009.098643:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991821184 00010000:00010000:1.0:1746127009.098651:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 12 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.098661:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10351 00000100:00100000:1.0:1746127009.098665:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991821184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.098670:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.098677:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 12 pid: 9612 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098684:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 12 pid: 9612 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.098693:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.098703:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991821184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 37us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.098710:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10351 00000100:00100000:1.0:1746127009.098733:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098740:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991821312 00000100:00100000:1.0:1746127009.098742:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991821312 00010000:00010000:1.0:1746127009.098749:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.098758:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10352 00000100:00100000:1.0:1746127009.098762:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991821312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.098767:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.098772:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.098779:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 46 pid: 12340 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.098788:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.098789:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.098794:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.098801:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.098817:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.098826:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991821312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.098834:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10352 00000100:00100000:1.0:1746127009.098877:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098884:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991821440 00000100:00100000:1.0:1746127009.098886:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991821440 00010000:00010000:1.0:1746127009.098893:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 26 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.098903:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10353 00000100:00100000:1.0:1746127009.098906:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991821440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.098911:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.098916:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 26 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.098924:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 26 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.098932:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.098934:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.098936:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.098942:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.098950:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.098960:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991821440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 53us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.098967:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10353 00000100:00100000:1.0:1746127009.098989:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.098998:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991821568 00000100:00100000:1.0:1746127009.099000:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991821568 00010000:00010000:1.0:1746127009.099007:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 26 pid: 1964 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.099029:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10354 00000100:00100000:1.0:1746127009.099034:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991821568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.099039:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.099045:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 26 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.099050:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 26 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.099060:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880076178e00/0x34dc807b6efa897 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e538d1 expref: 26 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.099067:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.099068:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.099070:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099076:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099091:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.099104:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2029:x1830945991821568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.099108:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10354 00010000:00010000:1.0:1746127009.099121:0:1507:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099148:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099162:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099169:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099175:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099180:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be42600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127009.099183:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099189:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099203:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099209:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be42600/0x34dc807b6efaccd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.099245:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991819264:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 17065us (17867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.099252:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21955 00000100:00100000:1.0:1746127009.099327:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994317184:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127009.099336:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127009.099349:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 42 pid: 3542 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.099351:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991819904:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 16529us (16585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.099357:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10344 00000100:00100000:3.0:1746127009.099375:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10355 00000100:00100000:3.0:1746127009.099380:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991820160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127009.099388:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127009.099397:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.099405:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.099416:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098672600/0x34dc807b6efabc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ac2 expref: 41 pid: 3542 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.099428:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.099429:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.099432:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099438:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099450:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.099451:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c74a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994316800:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.099461:0:9612:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.099471:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991820160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 91us (2813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.099477:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10355 00010000:00010000:1.0:1746127009.099477:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e369400/0x34dc807b6efac56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b08 expref: 10 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.099487:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c748700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994316928:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.099494:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098673800/0x34dc807b6efabed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ad0 expref: 24 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.099505:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c749180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994317056:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.099514:0:9611:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099520:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099524:0:12333:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099525:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099535:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099536:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099542:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099547:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099548:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099553:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099554:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013084e200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127009.099556:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099559:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099562:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099564:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098ac6c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127009.099567:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099573:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099574:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.099580:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efacdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099582:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.099588:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efacb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.099602:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991819776:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 17013us (17062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.099607:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21957 00000100:00100000:3.0:1746127009.099632:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991819136:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 18117us (18340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.099640:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21952 00010000:00010000:0.0:1746127009.099731:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012158d000/0x34dc807b6efaaa4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a21 expref: 23 pid: 12340 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.099752:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994315904:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.099760:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e368a00/0x34dc807b6efac41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53af3 expref: 8 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.099768:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994316032:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.099776:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bce00/0x34dc807b6efaa9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a1a expref: 45 pid: 12340 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.099783:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994316160:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.099798:0:1964:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099804:0:1964:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099810:0:1964:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099820:0:1964:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099826:0:1964:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099832:0:1964:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099836:0:1964:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098ac6200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127009.099839:0:1964:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099844:0:1964:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099854:0:1964:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.099865:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efacbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.099896:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2026:x1830945991819392:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 18022us (18564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.099901:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21953 00000100:00100000:2.0:1746127009.100199:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991821056 00000100:00100000:2.0:1746127009.100203:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991821056 00002000:00100000:2.0:1746127009.100232:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1380352->2015231) req@ffff88009cc3ce00 x1830945991821056/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.100240:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3ce00 with x1830945991821056 ext(1380352->2015231) 00010000:00010000:2.0:1746127009.100246:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 21 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.100255:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 21 pid: 3542 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746127009.100261:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cc3ce00 00000100:00100000:2.0:1746127009.100272:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1964 00000100:00100000:2.0:1746127009.100276:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991821056:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127009.102028:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.102110:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991821952 00000100:00100000:2.0:1746127009.102117:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991821952 00000100:00100000:2.0:1746127009.102184:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17358 00000100:00100000:2.0:1746127009.102191:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4518:x1830945991821952:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.102213:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.102230:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6eface2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b47 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.102296:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102307:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102315:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102327:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102332:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102337:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102439:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102449:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102454:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127009.102463:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127009.102539:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102545:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102550:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102555:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb7200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.102559:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102564:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102573:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.102576:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127009.102579:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.102583:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7200/0x34dc807b6efacf7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103084:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103090:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103095:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103100:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103103:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.103106:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103110:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103116:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127009.103118:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.103120:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103125:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6400/0x34dc807b6eface9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127009.103392:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.103536:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991822080 00000100:00100000:1.0:1746127009.103541:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991822080 00002000:00100000:1.0:1746127009.103567:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801220f0a80 x1830945991822080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.103576:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0a80 with x1830945991822080 ext(4194304->4829183) 00010000:00010000:1.0:1746127009.103583:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 23 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.103593:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 23 pid: 3542 timeout: 1004 lvb_type: 0 00002000:00010000:1.0:1746127009.103600:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f0a80 00000100:00100000:1.0:1746127009.103629:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1965 00000100:00100000:1.0:1746127009.103634:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991822080:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127009.103678:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103683:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103688:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103692:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb7400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.103694:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103698:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103705:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7e00) 00010000:00010000:2.0:1746127009.103707:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.103709:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103717:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7400/0x34dc807b6efacf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127009.103750:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6eface2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b47 expref: 42 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.103757:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb7000/0x34dc807b6eface2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b47 expref: 42 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.103764:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb7000, rc 0) 00000100:00100000:2.0:1746127009.104829:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4518:x1830945991821952:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2633us (2812us total) trans 8589938320 rc 301/301 00000100:00100000:2.0:1746127009.104836:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17358 00000100:00100000:0.0:1746127009.111403:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.111745:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991822336 00000100:00100000:2.0:1746127009.111755:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991822336 00000100:00100000:2.0:1746127009.111808:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6635 00000100:00100000:2.0:1746127009.111815:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4518:x1830945991822336:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127009.111841:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991822080:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8206us (8449us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127009.111852:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1965 00002000:00100000:1.0:1746127009.111860:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801220f0a80 x1830945991822080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.111869:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0a80 with x1830945991822080 ext(4194304->4829183) 00010000:00010000:1.0:1746127009.111878:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 23 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.111890:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 23 pid: 3542 timeout: 1004 lvb_type: 0 00002000:00010000:1.0:1746127009.111897:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f0a80 00000100:00100000:2.0:1746127009.111969:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4518:x1830945991822336:12345-192.168.203.42@tcp:35:cat.0 Request processed in 154us (577us total) trans 8589938321 rc 0/0 00000100:00100000:2.0:1746127009.111975:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6635 00000100:00100000:3.0:1746127009.113334:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991821056:12345-192.168.203.42@tcp:4:cat.0 Request processed in 13052us (14831us total) trans 21474842914 rc 0/0 00000100:00100000:3.0:1746127009.113342:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1964 00002000:00100000:3.0:1746127009.113350:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9e:0x0] (1380352->2015231) req@ffff88009cc3ce00 x1830945991821056/t21474842914(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.113356:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3ce00 with x1830945991821056 ext(1380352->2015231) 00010000:00010000:3.0:1746127009.113363:0:20411:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 23 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.113372:0:20411:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 23 pid: 3542 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.113377:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cc3ce00 00000100:00100000:0.0:1746127009.117470:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.117506:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.117530:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.117575:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.117589:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.117596:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991822464 00000100:00100000:0.0:1746127009.117602:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.117606:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991822464 00000100:00100000:0.0:1746127009.117614:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.117643:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991822592 00000100:00100000:2.0:1746127009.117645:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991822592 00000100:00100000:2.0:1746127009.117664:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991822848 00000100:00100000:2.0:1746127009.117666:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991822848 00000100:00100000:2.0:1746127009.117673:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991823104 00000100:00100000:2.0:1746127009.117674:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991823104 00000100:00100000:2.0:1746127009.117682:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991822720 00000100:00100000:2.0:1746127009.117683:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991822720 00000100:00100000:2.0:1746127009.117689:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991822976 00000100:00100000:2.0:1746127009.117690:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991822976 00000100:00100000:2.0:1746127009.117695:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991823232 00000100:00100000:2.0:1746127009.117697:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991823232 00000100:00100000:0.0:1746127009.117697:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.117707:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21958 00000100:00100000:2.0:1746127009.117714:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991822464:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127009.117716:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21959 00000100:00100000:0.0:1746127009.117724:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991822592:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127009.117733:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.117752:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b55 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746127009.117780:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c89f, atime: 0x6813c89f, ctime: 0x6813c89f, blocks: 0x7f8 00010000:00010000:0.0:1746127009.117798:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.117800:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.117809:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 26 pid: 12340 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127009.117821:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21960 00010000:00010000:0.0:1746127009.117824:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 26 pid: 12340 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127009.117830:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991822848:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127009.117835:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911df600, rc 0) 00000100:00100000:3.0:1746127009.117839:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21961 00010000:00010000:1.0:1746127009.117839:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127009.117846:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991823104:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.117851:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.117851:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b63 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.117857:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f44800/0x34dc807b6efad13 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b71 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.117867:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746127009.117867:0:9611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c89e, atime: 0x6813c89e, ctime: 0x6813c89e, blocks: 0x808 00010000:00010000:1.0:1746127009.117874:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.117875:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f44800/0x34dc807b6efad13 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b71 expref: 27 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.117875:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127009.117877:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991822592:12345-192.168.203.42@tcp:101:cat.0 Request processed in 155us (370us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127009.117879:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 26 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.117883:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f44800/0x34dc807b6efad13 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b71 expref: 27 pid: 12333 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127009.117883:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21959 00010000:00010000:1.0:1746127009.117889:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 26 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.117897:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44800, rc 0) 00000100:00100000:0.0:1746127009.117898:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21962 00010000:00010000:1.0:1746127009.117900:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643800, rc 0) 00000100:00100000:0.0:1746127009.117902:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991822720:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127009.117908:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127009.117915:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991823104:12345-192.168.203.42@tcp:101:cat.0 Request processed in 70us (340us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127009.117915:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991822848:12345-192.168.203.42@tcp:101:cat.0 Request processed in 88us (385us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127009.117916:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b5c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.117920:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21960 00000100:00100000:3.0:1746127009.117923:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21961 00002000:00010000:0.0:1746127009.117925:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c89e, atime: 0x6813c89b, ctime: 0x6813c89e, blocks: 0x800 00000100:00100000:3.0:1746127009.117931:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21963 00010000:00010000:0.0:1746127009.117933:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127009.117935:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991822976:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127009.117935:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.117938:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 26 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.117945:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.117947:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 26 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.117954:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6efad21 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b6a expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.117955:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911df200, rc 0) 00000100:00100000:0.0:1746127009.117970:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991822720:12345-192.168.203.42@tcp:101:cat.0 Request processed in 67us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.117996:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994317312:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127009.118063:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746127009.118093:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.118099:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b4e expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.118110:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.118111:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.118116:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 41 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.118123:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 41 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.118155:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7e00, rc 0) 00000100:00100000:2.0:1746127009.118171:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991822464:12345-192.168.203.42@tcp:101:cat.0 Request processed in 459us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.118460:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21964 00000100:00100000:1.0:1746127009.118467:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991823232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127009.118474:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.118482:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b78 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127009.118491:0:9611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c89f, atime: 0x6813c89f, ctime: 0x6813c89f, blocks: 0x1008 00010000:00010000:1.0:1746127009.118500:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.118501:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.118505:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 27 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.118513:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 27 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.118519:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096642c00, rc 0) 00000100:00100000:1.0:1746127009.118535:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991823232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 70us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.118540:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21964 00000100:00100000:0.0:1746127009.119454:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21962 00000100:00100000:0.0:1746127009.119476:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991823360 00000100:00100000:1.0:1746127009.119477:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.119480:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991823360 00000100:00100000:1.0:1746127009.119495:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991823488 00000100:00100000:1.0:1746127009.119499:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991823488 00010000:00010000:0.0:1746127009.119499:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 26 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.119513:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 27 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.119516:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10356 00000100:00100000:0.0:1746127009.119520:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991823360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.119527:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127009.119532:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10357 00000100:00100000:1.0:1746127009.119537:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991823488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.119538:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 27 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.119543:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.119547:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 27 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.119552:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 27 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.119560:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.119561:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 27 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.119562:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.119565:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119571:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f45600/0x34dc807b6efac80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b24 expref: 27 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.119571:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119582:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.119583:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.119586:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119592:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119592:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127009.119604:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.119608:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991823360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 88us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.119613:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10356 00000100:00100000:1.0:1746127009.119617:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991823488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 81us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.119622:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10357 00010000:00010000:0.0:1746127009.119628:0:11152:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119635:0:11152:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119638:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119643:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119648:0:11152:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119653:0:11152:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119654:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119659:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119660:0:11152:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119665:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119665:0:11152:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be43800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127009.119669:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009664c600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127009.119669:0:11152:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119671:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119675:0:11152:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119676:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119683:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.119687:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664c600/0x34dc807b6efacd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119687:0:11152:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.119692:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be43800/0x34dc807b6efacc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.119713:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991819520:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 37326us (38321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.119719:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21956 00000100:00100000:0.0:1746127009.119721:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991819648:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 37652us (38360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.119727:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21954 00000100:00100000:1.0:1746127009.119754:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.119775:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991823616 00000100:00100000:0.0:1746127009.119778:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991823616 00000100:00100000:3.0:1746127009.119798:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21965 00000100:00100000:3.0:1746127009.119806:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991823616:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.119815:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.119822:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b7f expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.119833:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.119834:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.119838:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.119847:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.119858:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44e00, rc 0) 00000100:00100000:3.0:1746127009.119878:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991823616:12345-192.168.203.42@tcp:101:cat.0 Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.119883:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21965 00000100:00100000:2.0:1746127009.119940:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21958 00000100:00100000:1.0:1746127009.119991:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.120030:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.120434:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991823744 00000100:00100000:2.0:1746127009.120438:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991823744 00000100:00100000:1.0:1746127009.120447:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.120827:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.121489:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991823872 00000100:00100000:2.0:1746127009.121493:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991823872 00000100:00100000:3.0:1746127009.121706:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991824000 00000100:00100000:3.0:1746127009.121710:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991824000 00000100:00100000:3.0:1746127009.121718:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991824128 00000100:00100000:3.0:1746127009.121720:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991824128 00000100:00100000:0.0:1746127009.121736:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21966 00000100:00100000:0.0:1746127009.121744:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991823744:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127009.121750:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127009.121754:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.121767:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b86 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.121785:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.121787:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.121792:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 48 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.121804:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 48 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.121812:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911df800, rc 0) 00000100:00100000:2.0:1746127009.121843:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21967 00000100:00100000:2.0:1746127009.121849:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991823872:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127009.121855:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991823744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 112us (1864us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127009.121857:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127009.121861:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21966 00010000:00010000:2.0:1746127009.121865:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b8d expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.121873:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21968 00010000:00010000:2.0:1746127009.121875:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.121877:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127009.121877:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991824128:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.121881:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 43 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.121883:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.121889:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b9b expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.121890:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 43 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.121897:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7000, rc 0) 00010000:00010000:0.0:1746127009.121898:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.121899:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.121902:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 48 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.121909:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 48 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127009.121914:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991823872:12345-192.168.203.42@tcp:101:cat.0 Request processed in 66us (1884us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127009.121916:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911de600, rc 0) 00000100:00100000:2.0:1746127009.121919:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21967 00000100:00100000:0.0:1746127009.121931:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991824128:12345-192.168.203.42@tcp:101:cat.0 Request processed in 53us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.121999:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21968 00000100:00100000:2.0:1746127009.122187:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991824384 00000100:00100000:2.0:1746127009.122190:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991824384 00000100:00100000:2.0:1746127009.122217:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17359 00000100:00100000:2.0:1746127009.122221:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4510:x1830945991824384:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1746127009.122255:0:10958:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.122271:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e369a00/0x34dc807b6efac8e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b2b expref: 12 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122284:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.122287:0:10958:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127009.122306:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.122315:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 41 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122321:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 21 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122327:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 21 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122331:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 21 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122336:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 41 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122341:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.122363:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 41 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122371:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 41 pid: 7260 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.122381:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317440:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.122422:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 21 pid: 7260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122432:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 21 pid: 7260 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.122437:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317568:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.122452:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 21 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122457:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 21 pid: 11634 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.122462:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317696:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.122476:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 21 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122482:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 21 pid: 11634 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.122487:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317824:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.122501:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 41 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.122505:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 41 pid: 13466 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.122510:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317952:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.122525:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00010000:00010000:3.0:1746127009.122594:0:12333:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff8800a5b99180 x1830945994317312) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 24 pid: 3542 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.122612:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efac33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->2015231) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ae5 expref: 24 pid: 3542 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.122620:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994317312:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127009.122640:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6efad21 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b6a expref: 23 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.122648:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f44a00/0x34dc807b6efad21 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b6a expref: 23 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.122655:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f44a00, rc 0) 00000100:00100000:3.0:1746127009.122669:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991822976:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4733us (5065us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127009.122674:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21963 00000100:00100000:3.0:1746127009.122707:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21969 00000100:00100000:3.0:1746127009.122712:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2029:x1830945991824000:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.122718:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.122725:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53b94 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127009.122736:0:3542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c89f, atime: 0x6813c89f, ctime: 0x6813c89f, blocks: 0x14e0 00010000:00010000:3.0:1746127009.122743:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.122744:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.122748:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 43 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.122756:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 43 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.122805:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45a00, rc 0) 00000100:00100000:3.0:1746127009.122840:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991824000:12345-192.168.203.42@tcp:101:cat.0 Request processed in 127us (2392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.122845:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21969 00000100:00100000:0.0:1746127009.125080:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.125107:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.125122:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.125161:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.125180:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991824512 00000100:00100000:0.0:1746127009.125187:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991824512 00010000:00010000:0.0:1746127009.125215:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 42 pid: 7260 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.125631:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317440:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.125640:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317568:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.125646:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317696:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.125652:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317824:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.125657:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994317952:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.125687:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:0.0:1746127009.125753:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991824768 00000100:00100000:0.0:1746127009.125756:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991824768 00010000:00010000:0.0:1746127009.125768:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 22 pid: 11634 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.125778:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991824640 00000100:00100000:0.0:1746127009.125780:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991824640 00010000:00010000:0.0:1746127009.125787:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 23 pid: 7260 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.125794:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991824896 00000100:00100000:0.0:1746127009.125795:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991824896 00010000:00010000:0.0:1746127009.125802:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 24 pid: 11634 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.125811:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10358 00000100:00100000:0.0:1746127009.125817:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991824512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.125829:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.125835:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 42 pid: 7260 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.125844:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 42 pid: 7260 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.125864:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e5400/0x34dc807b6efa91c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5391e expref: 42 pid: 7260 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.125881:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.125885:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.125893:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.125926:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991824512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 109us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.125932:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10358 00000100:00100000:0.0:1746127009.125965:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10359 00000100:00100000:0.0:1746127009.125969:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991824768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.125974:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.125977:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 24 pid: 11634 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.125985:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 24 pid: 11634 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.125994:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a200/0x34dc807b6efa900 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53902 expref: 24 pid: 11634 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126002:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.126005:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.126021:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.126034:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991824768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 65us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.126043:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10359 00000100:00100000:0.0:1746127009.126051:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10360 00000100:00100000:0.0:1746127009.126055:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991824640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.126060:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.126063:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 22 pid: 7260 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126070:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 22 pid: 7260 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126079:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967e4c00/0x34dc807b6efa907 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53910 expref: 22 pid: 7260 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126086:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.126089:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.126094:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.126103:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991824640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 48us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.126108:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10360 00000100:00100000:0.0:1746127009.126114:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10361 00000100:00100000:0.0:1746127009.126117:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991824896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.126122:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.126125:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 20 pid: 11634 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126155:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 20 pid: 11634 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126165:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bfec00/0x34dc807b6efab92 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a98 expref: 20 pid: 11634 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126172:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.126175:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.126179:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.126190:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991824896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.126194:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10361 00000100:00100000:0.0:1746127009.126220:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.126232:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825024 00000100:00100000:0.0:1746127009.126235:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825024 00010000:00010000:0.0:1746127009.126243:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 41 pid: 13466 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.126253:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10362 00000100:00100000:0.0:1746127009.126257:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2029:x1830945991825024:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.126263:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.126266:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 41 pid: 13466 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126274:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 41 pid: 13466 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126284:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8de200/0x34dc807b6efaaea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53a3d expref: 41 pid: 13466 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.126291:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.126294:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.126301:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.126306:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.126319:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.126330:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2029:x1830945991825024:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 72us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127009.126645:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.126652:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000040:00080000:2.0:1746127009.126900:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1417, 88 off132304 00000004:00080000:2.0:1746127009.126908:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904168777770ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.126934:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1433, 88 off133800 00000004:00080000:2.0:1746127009.126944:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904168814412ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127009.126958:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1434, 88 off133888 00000004:00080000:2.0:1746127009.126960:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904168831008ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127009.127063:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1418, 88 off132392 00000004:00080000:2.0:1746127009.127068:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904168938490ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.127160:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1419, 88 off132480 00000004:00080000:2.0:1746127009.127164:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904169034980ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.127178:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1435, 88 off133976 00000004:00080000:2.0:1746127009.127181:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904169051885ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127009.127191:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1436, 88 off134064 00000004:00080000:2.0:1746127009.127194:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904169064845ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127009.127201:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1437, 88 off134152 00000004:00080000:2.0:1746127009.127204:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904169074742ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127009.127212:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1420, 88 off132568 00000004:00080000:2.0:1746127009.127215:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904169085165ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.127222:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1438, 88 off134240 00000004:00080000:2.0:1746127009.127224:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904169094500ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127009.127230:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1421, 88 off132656 00000004:00080000:2.0:1746127009.127233:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904169103352ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.127240:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1439, 88 off134328 00000004:00080000:2.0:1746127009.127242:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904169112912ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127009.127249:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1422, 88 off132744 00000004:00080000:2.0:1746127009.127251:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904169121807ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.127258:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1423, 88 off132832 00000004:00080000:2.0:1746127009.127261:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904169131735ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.127279:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1424, 88 off132920 00000004:00080000:2.0:1746127009.127281:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904169151978ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127009.127287:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1425, 88 off133008 00000004:00080000:2.0:1746127009.127290:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904169160282ns, next at 847916292410ns, rc = 0 00000100:00100000:0.0:1746127009.127291:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10362 00000040:00080000:2.0:1746127009.127296:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1440, 88 off134416 00000004:00080000:2.0:1746127009.127298:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904169168641ns, next at 895431202182ns, rc = 0 00000100:00100000:0.0:1746127009.128412:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.128524:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.128547:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825280 00000100:00100000:0.0:1746127009.128553:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825280 00000100:00100000:0.0:1746127009.128593:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825152 00000100:00100000:0.0:1746127009.128596:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825152 00000100:00100000:0.0:1746127009.128611:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17360 00000100:00100000:0.0:1746127009.128617:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4506:x1830945991825280:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:3.0:1746127009.128626:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17361 00000100:00100000:3.0:1746127009.128634:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:4518:x1830945991825152:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127009.128639:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.128645:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.128654:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ba2 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.128655:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ba9 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.128698:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.128709:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 41 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.129574:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba9 expref: 20 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.129586:0:13448:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127009.129587:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba9 expref: 20 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.129598:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.129601:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127009.129604:0:11634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 41 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.129610:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6c00, rc 0) 00010000:00010000:3.0:1746127009.129612:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 41 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.129621:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.129623:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127009.129635:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 41 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.129643:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f45e00, rc 0) 00000100:00100000:0.0:1746127009.129644:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4506:x1830945991825280:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1025us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.129649:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17360 00000100:00100000:3.0:1746127009.129664:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4518:x1830945991825152:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1031us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.129670:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17361 00000001:00080000:1.0:1746127009.130843:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938322 is committed 00000004:00080000:1.0:1746127009.130850:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1414 committed 00000004:00080000:1.0:1746127009.130858:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1399 committed 00000004:00080000:1.0:1746127009.130899:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1398 committed 00000004:00080000:1.0:1746127009.130901:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1397 committed 00000004:00080000:1.0:1746127009.130902:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1396 committed 00000004:00080000:1.0:1746127009.130904:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1413 committed 00000004:00080000:1.0:1746127009.130905:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1395 committed 00000004:00080000:1.0:1746127009.130907:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1412 committed 00000004:00080000:1.0:1746127009.130908:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1394 committed 00000004:00080000:1.0:1746127009.130910:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1411 committed 00000004:00080000:1.0:1746127009.130912:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1410 committed 00000004:00080000:1.0:1746127009.130913:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1409 committed 00000004:00080000:1.0:1746127009.130916:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1393 committed 00000004:00080000:1.0:1746127009.130918:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1392 committed 00000004:00080000:1.0:1746127009.130920:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1408 committed 00000004:00080000:1.0:1746127009.130921:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1407 committed 00000004:00080000:1.0:1746127009.130922:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1391 committed 00000001:00080000:1.0:1746127009.130927:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938321 is committed 00000001:00080000:1.0:1746127009.130935:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938317 is committed 00000100:00100000:3.0:1746127009.131125:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127009.131381:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.131428:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.131453:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127009.131469:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.131479:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.131490:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.131499:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.131509:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.131522:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746127009.131526:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127009.131537:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.131545:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127009.131557:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.131567:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127009.131590:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318080 00000100:00100000:0.0:1746127009.131595:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318080 00000100:00100000:0.0:1746127009.131623:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318592 00000100:00100000:0.0:1746127009.131625:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318592 00000100:00100000:3.0:1746127009.131632:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.131655:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.131673:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.132275:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994319360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.132293:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.132319:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994319104 00000100:00100000:0.0:1746127009.132323:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994319104 00000100:00100000:0.0:1746127009.132340:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994319616 00000100:00100000:0.0:1746127009.132342:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994319616 00000100:00100000:0.0:1746127009.132349:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318208 00000100:00100000:0.0:1746127009.132350:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318208 00000100:00100000:0.0:1746127009.132356:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318720 00000100:00100000:0.0:1746127009.132358:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318720 00000100:00100000:2.0:1746127009.132389:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318848 00000100:00100000:2.0:1746127009.132394:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318848 00000100:00100000:1.0:1746127009.132396:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994319360 00000100:00100000:1.0:1746127009.132399:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994319360 00000100:00100000:3.0:1746127009.132403:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994319872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127009.132411:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21970 00000100:00100000:3.0:1746127009.132420:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.132421:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318336 00000100:00100000:2.0:1746127009.132428:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21971 00000100:00100000:3.0:1746127009.132430:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746127009.132430:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3784:x1830945994318080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127009.132432:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3784:x1830945994318592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.132435:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.132454:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.132461:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.132473:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.132478:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994319488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.132488:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.132493:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994320000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.132505:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.132526:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994319872 00000100:00100000:3.0:1746127009.132529:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994319872 00000100:00100000:3.0:1746127009.132542:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318464 00000100:00100000:3.0:1746127009.132543:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318464 00002000:00010000:2.0:1746127009.132543:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127009.132543:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746127009.132546:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.132546:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:2.0:1746127009.132548:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.132548:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00000100:00100000:3.0:1746127009.132549:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994318976 00000100:00100000:3.0:1746127009.132550:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318976 00002000:00010000:2.0:1746127009.132550:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.132550:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:2.0:1746127009.132552:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:1.0:1746127009.132552:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746127009.132556:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994319488 00000100:00100000:3.0:1746127009.132557:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994319488 00000100:00100000:3.0:1746127009.132563:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994320000 00000100:00100000:3.0:1746127009.132565:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994320000 00000100:00100000:3.0:1746127009.132573:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21972 00000100:00100000:3.0:1746127009.132577:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994319104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127009.132579:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3784:x1830945994318592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (1109us total) trans 17179875644 rc 0/0 00000100:00100000:1.0:1746127009.132579:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994318080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (1151us total) trans 21474842915 rc 0/0 00000100:00100000:1.0:1746127009.132584:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21970 00000100:00100000:2.0:1746127009.132586:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21971 00000100:00100000:2.0:1746127009.132596:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21973 00000100:00100000:2.0:1746127009.132600:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3784:x1830945994319616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.132612:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994318336 00002000:00010000:3.0:1746127009.132627:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746127009.132629:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127009.132632:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127009.132633:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127009.132635:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:3.0:1746127009.132655:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3784:x1830945994319104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1164us total) trans 21474842916 rc 0/0 00000100:00100000:2.0:1746127009.132658:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3784:x1830945994319616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1147us total) trans 21474842917 rc 0/0 00000100:00100000:1.0:1746127009.132908:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21974 00000100:00100000:1.0:1746127009.132914:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3784:x1830945994318208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127009.132948:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127009.132950:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127006 -> 1746127006 00002000:00010000:1.0:1746127009.132952:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127003 -> 1746127003 00002000:00010000:1.0:1746127009.132953:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127006 -> 1746127006 00002000:00010000:1.0:1746127009.132955:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746127009.132975:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3784:x1830945994318208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1437us total) trans 17179875645 rc 0/0 00000100:00100000:1.0:1746127009.132979:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21974 00000100:00100000:1.0:1746127009.132990:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21975 00000100:00100000:1.0:1746127009.132994:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3784:x1830945994318720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127009.133035:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127009.133037:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127009.133039:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:1.0:1746127009.133041:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127009.133042:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:1.0:1746127009.133056:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3784:x1830945994318720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1499us total) trans 17179875646 rc 0/0 00000100:00100000:1.0:1746127009.133060:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21975 00000100:00100000:1.0:1746127009.133067:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21976 00000100:00100000:1.0:1746127009.133070:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3782:x1830945994318848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127009.133099:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:1.0:1746127009.133101:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.133102:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.133104:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.133105:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:1.0:1746127009.133121:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3782:x1830945994318848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (1448us total) trans 21474842918 rc 0/0 00000100:00100000:1.0:1746127009.133125:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21976 00000100:00100000:1.0:1746127009.133148:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21977 00000100:00100000:1.0:1746127009.133152:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3782:x1830945994319360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127009.133193:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3782:x1830945994319360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (900us total) trans 21474842919 rc 0/0 00000100:00100000:1.0:1746127009.133197:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21977 00000100:00100000:1.0:1746127009.133205:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21978 00000100:00100000:1.0:1746127009.133208:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3782:x1830945994319872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127009.133244:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127009.133247:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127009.133248:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127009.133249:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127009.133251:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:1.0:1746127009.133266:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3782:x1830945994319872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (846us total) trans 21474842920 rc 0/0 00000100:00100000:1.0:1746127009.133271:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21978 00000100:00100000:1.0:1746127009.133281:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21979 00000100:00100000:1.0:1746127009.133284:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3782:x1830945994318464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127009.133317:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127009.133318:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.133320:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.133322:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.133323:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746127009.133338:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3782:x1830945994318464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (884us total) trans 21474842921 rc 0/0 00000100:00100000:1.0:1746127009.133342:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21979 00000100:00100000:1.0:1746127009.133349:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21980 00000100:00100000:1.0:1746127009.133352:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3782:x1830945994318976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127009.133399:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3782:x1830945994318976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (925us total) trans 17179875647 rc 0/0 00000100:00100000:1.0:1746127009.133403:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21980 00000100:00100000:1.0:1746127009.133410:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21981 00000100:00100000:1.0:1746127009.133414:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3782:x1830945994319488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127009.133451:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3782:x1830945994319488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (962us total) trans 17179875648 rc 0/0 00000100:00100000:1.0:1746127009.133455:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21981 00000100:00100000:1.0:1746127009.133461:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21982 00000100:00100000:1.0:1746127009.133465:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3782:x1830945994320000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127009.133493:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:1.0:1746127009.133495:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127009.133496:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127009.133498:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127009.133499:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:1.0:1746127009.133511:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3782:x1830945994320000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1005us total) trans 21474842922 rc 0/0 00000100:00100000:1.0:1746127009.133514:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21982 00000100:00080000:1.0:1746127009.133527:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746127009.133530:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746127009.133610:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21973 00000100:00100000:0.0:1746127009.133631:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21983 00000100:00100000:0.0:1746127009.133637:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3782:x1830945994318336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127009.133680:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127009.133682:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127009.133684:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127009.133685:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127006 -> 1746127006 00002000:00010000:0.0:1746127009.133687:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746127009.133706:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3782:x1830945994318336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (2075us total) trans 17179875649 rc 0/0 00000100:00100000:0.0:1746127009.133712:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21983 00000100:00100000:0.0:1746127009.133727:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.133747:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.133758:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21972 00000100:00100000:0.0:1746127009.133767:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746127009.133806:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d1c00/2, rc 0, transno 21474842915 00000100:00100000:0.0:1746127009.133816:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.133823:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994319232 00000100:00100000:1.0:1746127009.133823:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994319744 00000004:00080000:0.0:1746127009.133824:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b99f80/2, rc 0, transno 17179875644 00000100:00100000:1.0:1746127009.133826:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994319744 00000100:00100000:3.0:1746127009.133827:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994319232 00000100:00100000:0.0:1746127009.133827:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127009.133833:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d3480/2, rc 0, transno 21474842916 00000100:00100000:0.0:1746127009.133836:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127009.133841:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d3100/2, rc 0, transno 21474842917 00000100:00100000:1.0:1746127009.133842:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21984 00000100:00100000:0.0:1746127009.133844:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.133847:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21985 00000100:00100000:1.0:1746127009.133847:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3784:x1830945994319744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.133852:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3784:x1830945994319232:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127009.133852:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b99180/2, rc 0, transno 17179875645 00000100:00100000:0.0:1746127009.133854:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127009.133860:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b9b480/2, rc 0, transno 17179875646 00000100:00100000:0.0:1746127009.133862:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994318720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127009.133901:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3784:x1830945994319744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (133us total) trans 17179875650 rc 0/0 00002000:00010000:3.0:1746127009.133902:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:3.0:1746127009.133904:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:3.0:1746127009.133906:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746127009.133906:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21984 00002000:00010000:3.0:1746127009.133908:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:3.0:1746127009.133910:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1746127009.133934:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994319232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (205us total) trans 17179875651 rc 0/0 00000100:00100000:3.0:1746127009.133939:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21985 00000100:00100000:1.0:1746127009.133968:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746127009.133976:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994320128:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746127009.133985:0:10958:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a2fc8380 reply state ffff8800a5e8a000 transno 8589938322 ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10958 initiator: MDT0 00000100:00100000:1.0:1746127009.133995:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746127009.134004:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.134023:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000100:00100000:1.0:1746127009.134024:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994320128 00010000:00010000:2.0:1746127009.134025:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746127009.134027:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994320128 00010000:00010000:2.0:1746127009.134031:0:10958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.134042:0:10958:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.134048:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.134055:0:10958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba9 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.134061:0:10958:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba9 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.134067:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba9 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746127009.134105:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c42aa00/2, rc 0, transno 17179875651 00000100:00100000:0.0:1746127009.134108:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c42aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127009.134116:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c42ad80/2, rc 0, transno 17179875650 00000100:00100000:0.0:1746127009.134118:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c42ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994319744:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746127009.134306:0:10958:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba9 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.134316:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994320256:192.168.203.42@tcp:105: 00000004:00080000:3.0:1746127009.134528:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d2d80/2, rc 0, transno 21474842921 00000100:00100000:3.0:1746127009.134533:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318464:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746127009.134536:0:10958:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746127009.134541:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b9b800/2, rc 0, transno 17179875647 00000100:00100000:3.0:1746127009.134543:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127009.134545:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994320384:192.168.203.42@tcp:105: 00000004:00080000:3.0:1746127009.134550:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c429c00/2, rc 0, transno 17179875648 00000100:00100000:3.0:1746127009.134552:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994319488:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127009.134558:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3ca80/2, rc 0, transno 21474842922 00000100:00100000:3.0:1746127009.134560:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994320000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127009.134565:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000004:00080000:3.0:1746127009.134567:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b99c00/2, rc 0, transno 17179875649 00000100:00100000:3.0:1746127009.134569:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318336:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127009.134575:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d2300/2, rc 0, transno 21474842918 00000100:00100000:3.0:1746127009.134579:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994318848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127009.134585:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d3b80/2, rc 0, transno 21474842919 00000100:00100000:3.0:1746127009.134588:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994319360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127009.134594:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3c000/2, rc 0, transno 21474842920 00000100:00100000:3.0:1746127009.134595:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994319872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127009.134768:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21986 00000100:00100000:1.0:1746127009.134775:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3785:x1830945994320128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127009.134843:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3785:x1830945994320128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (847us total) trans 21474842923 rc 0/0 00000100:00100000:1.0:1746127009.134848:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21986 00000004:00080000:1.0:1746127009.134868:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3df80/2, rc 0, transno 21474842923 00000100:00100000:1.0:1746127009.134872:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994320128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127009.137037:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994320256:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127009.137047:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994320384:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127009.137069:0:10958:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746127009.137323:0:10958:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746127009.137346:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4510:x1830945991824384:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 15123us (15595us total) trans 8589938322 rc 0/0 00000100:00100000:2.0:1746127009.137354:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17359 00000100:00100000:2.0:1746127009.137423:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.137443:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825408 00000100:00100000:2.0:1746127009.137447:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825408 00000100:00100000:2.0:1746127009.137470:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6636 00000100:00100000:2.0:1746127009.137475:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4518:x1830945991825408:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:1.0:1746127009.137594:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.137611:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4518:x1830945991825408:12345-192.168.203.42@tcp:49:cat.0 Request processed in 135us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.137617:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6636 00010000:00010000:3.0:1746127009.137644:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.137656:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.137662:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.137667:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098ac7600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127009.137671:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.137677:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.137907:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.137910:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127009.137913:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.137918:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098ac7600/0x34dc807b6efad52 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00000100:00100000:2.0:1746127009.138311:0:12342:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825536 00000100:00100000:2.0:1746127009.138315:0:12342:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825536 00000100:00100000:2.0:1746127009.138337:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6637 00000100:00100000:2.0:1746127009.138364:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4506:x1830945991825536:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:2.0:1746127009.138500:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4506:x1830945991825536:12345-192.168.203.42@tcp:49:cat.0 Request processed in 135us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.138505:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6637 00000100:00100000:1.0:1746127009.140901:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.140925:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.141066:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825792 00000100:00100000:0.0:1746127009.141072:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825792 00000100:00100000:2.0:1746127009.141236:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825664 00000100:00100000:2.0:1746127009.141239:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825664 00000100:00100000:2.0:1746127009.141258:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21987 00000100:00100000:2.0:1746127009.141264:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991825792:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.141279:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.141295:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bb7 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.141315:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.141317:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.141325:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.141343:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.141353:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6ce00, rc 0) 00000100:00100000:2.0:1746127009.141382:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991825792:12345-192.168.203.42@tcp:101:cat.0 Request processed in 118us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.141387:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21987 00000100:00100000:2.0:1746127009.141397:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21988 00000100:00100000:2.0:1746127009.141401:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991825664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.141405:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.141410:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bb0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.141418:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.141420:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.141423:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.141430:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.141436:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6de00, rc 0) 00000100:00100000:2.0:1746127009.141446:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991825664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 44us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.141451:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21988 00000100:00100000:2.0:1746127009.141937:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.141974:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991825920 00000100:00100000:3.0:1746127009.141978:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991825920 00000100:00100000:3.0:1746127009.142030:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17362 00000100:00100000:3.0:1746127009.142035:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4510:x1830945991825920:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127009.142051:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.142062:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bbe expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.142243:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.142254:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.142269:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.142272:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127009.142275:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673600, rc 0) 00000100:00100000:3.0:1746127009.142308:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4510:x1830945991825920:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 273us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.142314:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17362 00000100:00100000:0.0:1746127009.143926:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.144083:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991826176 00000100:00100000:3.0:1746127009.144089:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991826176 00002000:00100000:3.0:1746127009.144427:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff8800a8ee8a80 x1830945991826176/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.144439:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee8a80 with x1830945991826176 ext(4825088->4829183) 00002000:00010000:3.0:1746127009.144444:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee8a80 00000100:00100000:3.0:1746127009.144475:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8816 00000100:00100000:3.0:1746127009.144483:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991826176:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127009.145115:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991826176:12345-192.168.203.42@tcp:3:cat.0 Request processed in 631us (1191us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127009.145122:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8816 00002000:00100000:3.0:1746127009.145150:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff8800a8ee8a80 x1830945991826176/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.145157:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee8a80 with x1830945991826176 ext(4825088->4829183) 00002000:00010000:3.0:1746127009.145160:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee8a80 00000100:00100000:0.0:1746127009.146361:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.146432:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991826304 00000100:00100000:3.0:1746127009.146438:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991826304 00000100:00100000:3.0:1746127009.146578:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17363 00000100:00100000:3.0:1746127009.146585:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4510:x1830945991826304:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127009.146601:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.146619:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6efad83 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bc5 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.146700:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efad8a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.146713:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efad8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.146725:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efad8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:3.0:1746127009.146749:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127009.146753:0:10958:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127009.146766:0:10958:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efad8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.146786:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6efad83 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bc5 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.146802:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efad8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bc5 expref: 9 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.146809:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.146811:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127009.146815:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673400, rc 0) 00000100:00100000:3.0:1746127009.146861:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4510:x1830945991826304:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 276us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.146867:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17363 00000100:00100000:1.0:1746127009.150661:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.151083:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.151109:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991826560 00000100:00100000:1.0:1746127009.151119:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991826560 00002000:00100000:1.0:1746127009.151178:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a2fc8e00 x1830945991826560/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.151189:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8e00 with x1830945991826560 ext(0->1048575) 00002000:00010000:1.0:1746127009.151194:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8e00 00000100:00100000:3.0:1746127009.151223:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991826816 00000100:00100000:3.0:1746127009.151230:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991826816 00002000:00100000:3.0:1746127009.151246:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a2fc8a80 x1830945991826816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.151253:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8a80 with x1830945991826816 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.151257:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc8a80 00000100:00100000:3.0:1746127009.151286:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8817 00000100:00100000:3.0:1746127009.151294:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2028:x1830945991826816:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.151971:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8818 00000100:00100000:1.0:1746127009.151978:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991826560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.153945:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.154003:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991827072 00000100:00100000:2.0:1746127009.154010:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991827072 00002000:00100000:2.0:1746127009.154055:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fc9880 x1830945991827072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.154063:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9880 with x1830945991827072 ext(1048576->2097151) 00002000:00010000:2.0:1746127009.154068:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9880 00000100:00100000:2.0:1746127009.154094:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8819 00000100:00100000:2.0:1746127009.154100:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991827072:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.155184:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.155221:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.155230:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991827328 00000100:00100000:3.0:1746127009.155235:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991827328 00000100:00100000:0.0:1746127009.155236:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.155251:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991827584 00000100:00100000:0.0:1746127009.155255:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991827584 00002000:00100000:3.0:1746127009.155263:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a8ee9180 x1830945991827328/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.155271:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9180 with x1830945991827328 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.155275:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee9180 00000100:00100000:0.0:1746127009.155276:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991827840 00000100:00100000:0.0:1746127009.155278:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991827840 00000100:00100000:0.0:1746127009.155291:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21989 00000100:00100000:3.0:1746127009.155297:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8820 00000100:00100000:3.0:1746127009.155303:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991827328:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.155303:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2027:x1830945991827584:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.155315:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.155332:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bd3 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.155352:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.155354:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.155363:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.155377:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.155387:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb7000, rc 0) 00000100:00100000:0.0:1746127009.155416:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991827584:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 119us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.155422:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21989 00000100:00100000:0.0:1746127009.155436:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21990 00000100:00100000:0.0:1746127009.155440:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991827840:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.155446:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.155457:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53be1 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.155467:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.155468:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.155472:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.155481:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.155503:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6a00, rc 0) 00000100:00100000:0.0:1746127009.155858:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991827840:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.155866:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21990 00000100:00100000:0.0:1746127009.155899:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.155913:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828096 00000100:00100000:0.0:1746127009.155915:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828096 00000100:00100000:0.0:1746127009.155927:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21991 00000100:00100000:0.0:1746127009.155931:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991828096:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.155938:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.155946:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bef expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.155956:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.155957:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.155961:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.155974:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.155981:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb7e00, rc 0) 00000100:00100000:0.0:1746127009.155995:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991828096:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 63us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.156000:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21991 00000100:00100000:0.0:1746127009.156058:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.156069:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991827456 00000100:00100000:0.0:1746127009.156071:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991827456 00000100:00100000:0.0:1746127009.156084:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21992 00000100:00100000:0.0:1746127009.156088:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991827456:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.156093:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.156100:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bcc expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.156109:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.156111:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.156115:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.156123:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.156146:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6800, rc 0) 00000100:00100000:0.0:1746127009.156161:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991827456:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 72us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.156166:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21992 00000100:00100000:0.0:1746127009.156733:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.156748:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991827712 00000100:00100000:0.0:1746127009.156751:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991827712 00000100:00100000:0.0:1746127009.156775:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21993 00000100:00100000:0.0:1746127009.156780:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991827712:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127009.156786:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.156794:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bda expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.156806:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.156807:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.156811:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.156821:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.156828:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbb6000, rc 0) 00000100:00100000:0.0:1746127009.156842:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991827712:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 62us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.156847:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21993 00000100:00100000:0.0:1746127009.156884:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.156926:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991827968 00000100:00100000:2.0:1746127009.156935:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991827968 00000100:00100000:2.0:1746127009.156958:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21994 00000100:00100000:2.0:1746127009.156963:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991827968:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127009.156970:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.156978:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53be8 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.156993:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.156994:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.156999:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.157008:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.157025:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d400, rc 0) 00000100:00100000:2.0:1746127009.157063:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991827968:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.157070:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21994 00000100:00100000:0.0:1746127009.167794:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.167815:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.167827:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.167841:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.167855:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.167882:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.167903:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828352 00000100:00100000:0.0:1746127009.167912:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828352 00000100:00100000:0.0:1746127009.167945:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828608 00000100:00100000:0.0:1746127009.167947:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828608 00000100:00100000:0.0:1746127009.167956:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828864 00000100:00100000:0.0:1746127009.167958:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828864 00000100:00100000:0.0:1746127009.167966:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828224 00000100:00100000:0.0:1746127009.167968:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828224 00000100:00100000:2.0:1746127009.167974:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828480 00000100:00100000:0.0:1746127009.167976:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828736 00000100:00100000:2.0:1746127009.167977:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828480 00000100:00100000:0.0:1746127009.167977:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828736 00000100:00100000:0.0:1746127009.167989:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21995 00000100:00100000:1.0:1746127009.168238:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991826560:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16259us (17587us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127009.168247:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8818 00002000:00100000:1.0:1746127009.168258:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a2fc8e00 x1830945991826560/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.168272:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8e00 with x1830945991826560 ext(0->1048575) 00002000:00010000:1.0:1746127009.168278:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8e00 00000100:00100000:2.0:1746127009.168392:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21996 00000100:00100000:2.0:1746127009.168399:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991828608:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127009.168447:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21997 00000100:00100000:3.0:1746127009.168454:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991828864:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127009.168464:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991828608:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 66us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.168468:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21996 00000100:00100000:2.0:1746127009.168478:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21998 00000100:00100000:2.0:1746127009.168482:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991828224:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127009.168490:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991828864:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 37us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.168495:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21997 00000100:00100000:3.0:1746127009.168503:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21999 00000100:00100000:3.0:1746127009.168507:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991828736:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127009.168508:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991828224:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.168512:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21998 00000100:00100000:2.0:1746127009.168519:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22000 00000100:00100000:2.0:1746127009.168523:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991828480:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127009.168531:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991828736:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 24us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.168535:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21999 00000100:00100000:2.0:1746127009.168547:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991828480:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 24us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.168551:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22000 00000100:00100000:0.0:1746127009.168946:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991828352:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127009.168994:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991828352:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 999us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.169000:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21995 00000100:00100000:3.0:1746127009.175490:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991826816:12345-192.168.203.42@tcp:3:cat.0 Request processed in 24183us (24394us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.175503:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8817 00002000:00100000:3.0:1746127009.175516:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a2fc8a80 x1830945991826816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.175526:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8a80 with x1830945991826816 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.175532:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc8a80 00000100:00100000:0.0:1746127009.176678:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.177785:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.177803:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.177817:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.177830:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.177850:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991829120 00000100:00100000:1.0:1746127009.177858:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991829120 00000100:00100000:1.0:1746127009.177912:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991829376 00000100:00100000:1.0:1746127009.177915:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991829376 00000100:00100000:1.0:1746127009.177931:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991829632 00000100:00100000:1.0:1746127009.177933:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991829632 00000100:00100000:1.0:1746127009.177942:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991828992 00000100:00100000:1.0:1746127009.177944:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991828992 00000100:00100000:1.0:1746127009.177953:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991829248 00000100:00100000:1.0:1746127009.177954:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991829248 00000100:00100000:1.0:1746127009.177966:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22001 00000100:00100000:1.0:1746127009.177972:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991829120:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127009.178047:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22002 00000100:00100000:2.0:1746127009.178056:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991829376:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127009.178096:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991829120:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 123us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.178103:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22001 00000100:00100000:1.0:1746127009.178118:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22003 00000100:00100000:1.0:1746127009.178123:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991829632:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127009.178162:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991829376:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.178168:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22002 00000100:00100000:1.0:1746127009.178176:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991829632:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.178181:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22004 00000100:00100000:2.0:1746127009.178186:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991828992:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127009.178222:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991828992:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 36us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.178995:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22003 00000100:00100000:1.0:1746127009.179028:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22005 00000100:00100000:1.0:1746127009.179034:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991829248:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127009.179071:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991829248:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 38us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.179076:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22005 00000100:00100000:1.0:1746127009.179228:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.179244:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991829504 00000100:00100000:1.0:1746127009.179247:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991829504 00000100:00100000:1.0:1746127009.179264:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22006 00000100:00100000:1.0:1746127009.179268:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991829504:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127009.179300:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991829504:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 32us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.179305:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22006 00000100:00100000:2.0:1746127009.179449:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22004 00000100:00100000:2.0:1746127009.187943:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2028:x1830945991827072:12345-192.168.203.42@tcp:3:cat.0 Request processed in 33832us (33992us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.187956:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8819 00002000:00100000:2.0:1746127009.187968:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fc9880 x1830945991827072/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.187977:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9880 with x1830945991827072 ext(1048576->2097151) 00002000:00010000:2.0:1746127009.187982:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9880 00000100:00100000:1.0:1746127009.191429:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.191429:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.191513:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991830016 00000100:00100000:2.0:1746127009.191521:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991830016 00000100:00100000:3.0:1746127009.191749:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991829760 00000100:00100000:3.0:1746127009.191754:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991829760 00000100:00100000:3.0:1746127009.191818:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22007 00000100:00100000:2.0:1746127009.191827:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17364 00000100:00100000:2.0:1746127009.191834:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4521:x1830945991830016:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:3.0:1746127009.191836:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991829760:12345-192.168.203.42@tcp:22:lfs.0 00010000:00010000:2.0:1746127009.191851:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.191869:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efadbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bf6 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.191934:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.191946:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.191956:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.191968:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.191973:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.191978:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00002000:00010000:3.0:1746127009.192071:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127009.192075:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.192077:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127009.192079:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.192081:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127009.192659:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991829760:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 304us (710us total) trans 17179875652 rc 0/0 00000100:00100000:3.0:1746127009.192678:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22007 00010000:00010000:2.0:1746127009.192746:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.192769:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.192779:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.192981:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.192993:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 8 pid: 10958 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.193006:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994320512:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.193232:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.193675:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991827328:12345-192.168.203.42@tcp:3:cat.0 Request processed in 38372us (38495us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.193684:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8820 00002000:00100000:3.0:1746127009.193692:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a8ee9180 x1830945991827328/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.193700:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9180 with x1830945991827328 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.193705:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee9180 00000100:00100000:0.0:1746127009.195950:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.196430:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.196487:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991830144 00000100:00100000:1.0:1746127009.196494:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991830272 00000100:00100000:3.0:1746127009.196495:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991830144 00000100:00100000:1.0:1746127009.196499:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991830272 00010000:00010000:1.0:1746127009.196527:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 9 pid: 10958 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.196530:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22008 00000100:00100000:3.0:1746127009.196537:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991830144:12345-192.168.203.42@tcp:22:lfs.0 00000100:00100000:1.0:1746127009.196559:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10363 00000100:00100000:1.0:1746127009.196565:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991830272:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.196575:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.196581:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 9 pid: 10958 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.196592:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 9 pid: 10958 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.196614:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127009.196618:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127009.196627:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127009.196634:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127009.196650:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.196690:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991830272:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.196696:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10363 00002000:00010000:3.0:1746127009.196712:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127009.196715:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.196717:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127009.196719:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.196721:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:3.0:1746127009.196740:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991830144:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 203us (797us total) trans 21474842924 rc 0/0 00000100:00100000:3.0:1746127009.196749:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22008 00010000:00010000:2.0:1746127009.197171:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efacaa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b40 expref: 8 pid: 10958 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.197191:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994320512:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.197211:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197218:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197223:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127009.197237:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127009.197301:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197308:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197314:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197319:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6d200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.197323:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197329:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197342:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.197344:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127009.197347:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197352:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efadd0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197368:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197372:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197376:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197380:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6c400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.197382:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197386:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197392:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127009.197394:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.197396:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.197400:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c400/0x34dc807b6efadc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198008:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198045:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198050:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198054:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6ca00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.198057:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198062:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198069:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b8e7a00) 00010000:00010000:2.0:1746127009.198071:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.198073:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198077:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6ca00/0x34dc807b6efadc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.198121:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efadbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bf6 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.198149:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efadbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bf6 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.198157:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6c200, rc 0) 00000100:00100000:2.0:1746127009.198224:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4521:x1830945991830016:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6390us (6799us total) trans 8589938323 rc 301/301 00000100:00100000:2.0:1746127009.198232:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17364 00000100:00100000:2.0:1746127009.203895:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.204046:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.204223:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.204385:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.204399:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991830528 00000100:00100000:3.0:1746127009.204407:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991830528 00000100:00100000:3.0:1746127009.204421:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991830912 00000100:00100000:3.0:1746127009.204423:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991830912 00000100:00100000:3.0:1746127009.204474:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991830784 00000100:00100000:3.0:1746127009.204476:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991830784 00000100:00100000:3.0:1746127009.204499:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8821 00000100:00100000:3.0:1746127009.204506:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991830912:12345-192.168.203.42@tcp:3:lfs.0 00000100:00100000:1.0:1746127009.204524:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8822 00000100:00100000:1.0:1746127009.204535:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991830784:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127009.204570:0:9617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.204585:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.204587:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.204593:0:9617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.204607:0:9617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.204657:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.204674:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991831424 00000100:00100000:2.0:1746127009.204679:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991831424 00000100:00100000:2.0:1746127009.204704:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991831296 00000100:00100000:2.0:1746127009.204706:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991831296 00000100:00100000:2.0:1746127009.204721:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8823 00000100:00100000:2.0:1746127009.204727:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991831424:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127009.204742:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.204751:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.204752:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.204755:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.204764:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.204936:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8824 00000100:00100000:0.0:1746127009.204952:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991831296:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746127009.204968:0:29588:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.204975:0:29588:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.204976:0:29588:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.204979:0:29588:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.204988:0:29588:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.205241:0:20411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.205249:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.205250:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.205253:0:20411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.205260:0:20411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.206378:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.206395:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991831936 00000100:00100000:1.0:1746127009.206400:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991831936 00000100:00100000:1.0:1746127009.206432:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8825 00000100:00100000:1.0:1746127009.206438:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2029:x1830945991831936:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127009.206456:0:29584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.206465:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.206467:0:29584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.206471:0:29584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.206479:0:29584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.206608:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.207111:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991832064 00000100:00100000:1.0:1746127009.207114:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991832064 00000100:00100000:1.0:1746127009.207162:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8826 00000100:00100000:1.0:1746127009.207168:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991832064:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127009.207184:0:9616:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.207191:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.207193:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.207196:0:9616:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.207204:0:9616:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.207289:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.207306:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991832320 00000100:00100000:2.0:1746127009.207309:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991832320 00000100:00100000:2.0:1746127009.207332:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8827 00000100:00100000:2.0:1746127009.207337:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991832320:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127009.207351:0:29586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.207358:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.207360:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.207362:0:29586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.207376:0:29586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.209826:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8828 00000100:00100000:3.0:1746127009.209837:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2028:x1830945991830528:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127009.209873:0:13835:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.209887:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.209889:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.209893:0:13835:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.209906:0:13835:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.212346:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.212388:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.212414:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991832576 00000100:00100000:3.0:1746127009.212421:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991832576 00000100:00100000:0.0:1746127009.212429:0:29585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991832832 00000100:00100000:0.0:1746127009.212434:0:29585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991832832 00002000:00100000:3.0:1746127009.212458:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880122384e00 x1830945991832576/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.212459:0:29585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122385f80 x1830945991832832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.212468:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384e00 with x1830945991832576 ext(2097152->4194303) 00002000:00100000:0.0:1746127009.212468:0:29585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385f80 with x1830945991832832 ext(2097152->4194303) 00002000:00010000:3.0:1746127009.212473:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122384e00 00002000:00010000:0.0:1746127009.212473:0:29585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122385f80 00010000:00010000:1.0:1746127009.212791:0:9617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.212803:0:9617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.212810:0:9617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.212816:0:9617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098ac6200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127009.212820:0:9617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.212827:0:9617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.212845:0:9617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.212851:0:9617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efadde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.212904:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2028:x1830945991830784:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 8371us (8680us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127009.212912:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8822 00000100:00100000:1.0:1746127009.212931:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8829 00000100:00100000:1.0:1746127009.212939:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991832576:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127009.213291:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8830 00000100:00100000:3.0:1746127009.213297:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991832832:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127009.218307:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.218325:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.218333:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.218339:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6d800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127009.218343:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.218351:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.218369:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.218374:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efade5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.218448:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2028:x1830945991831424:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 13715us (14057us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.218461:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8823 00010000:00010000:2.0:1746127009.219879:0:29584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.219888:0:29584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.219895:0:29584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.219899:0:29584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebe600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127009.219902:0:29584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.219907:0:29584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.219916:0:29584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.219921:0:29584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe600/0x34dc807b6efadfa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.219958:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991831936:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 13520us (13583us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.219965:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8825 00010000:00010000:2.0:1746127009.227335:0:29586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.227355:0:29586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.227363:0:29586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.227376:0:29586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a45600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127009.227380:0:29586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.227389:0:29586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.227409:0:29586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.227416:0:29586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efae08 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.227536:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991832320:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 20192us (20241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.227547:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8827 00010000:00010000:1.0:1746127009.231022:0:29588:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.231038:0:29588:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.231046:0:29588:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.231053:0:29588:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbb6e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127009.231057:0:29588:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.231064:0:29588:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.231084:0:29588:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.231090:0:29588:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6e00/0x34dc807b6efadec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29588 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.231197:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991831296:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 26247us (26532us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127009.231571:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8824 00010000:00010000:1.0:1746127009.235253:0:9616:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.235271:0:9616:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.235277:0:9616:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.235281:0:9616:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdb3400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127009.235284:0:9616:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.235289:0:9616:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.235303:0:9616:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.235307:0:9616:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdb3400/0x34dc807b6efae01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.235381:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991832064:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 28209us (28770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127009.235389:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8826 00010000:00010000:3.0:1746127009.241461:0:13835:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.241480:0:13835:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.241487:0:13835:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.241494:0:13835:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2aa00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127009.241497:0:13835:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.241509:0:13835:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.241528:0:13835:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.241534:0:13835:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2aa00/0x34dc807b6efae0f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.241617:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991830528:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 31777us (37729us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746127009.241628:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8828 00000100:00100000:3.0:1746127009.248720:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991832832:12345-192.168.203.42@tcp:3:cat.0 Request processed in 35415us (36323us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127009.248729:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8830 00002000:00100000:3.0:1746127009.248738:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122385f80 x1830945991832832/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.248746:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385f80 with x1830945991832832 ext(2097152->4194303) 00002000:00010000:3.0:1746127009.248750:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122385f80 00010000:00010000:2.0:1746127009.252325:0:20411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.252342:0:20411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.252356:0:20411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.252363:0:20411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2ba00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127009.252368:0:20411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.252375:0:20411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.252397:0:20411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.252403:0:20411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c2ba00/0x34dc807b6efadf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.252516:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991830912:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 48005us (48464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.252527:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8821 00000100:00100000:2.0:1746127009.257776:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991832576:12345-192.168.203.42@tcp:3:cat.0 Request processed in 44831us (45429us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127009.257785:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8829 00002000:00100000:2.0:1746127009.257795:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880122384e00 x1830945991832576/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.257802:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384e00 with x1830945991832576 ext(2097152->4194303) 00002000:00010000:2.0:1746127009.257808:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122384e00 00000100:00100000:0.0:1746127009.260404:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.260874:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991833088 00000100:00100000:2.0:1746127009.260882:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991833088 00000100:00100000:2.0:1746127009.260934:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17365 00000100:00100000:2.0:1746127009.260941:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4510:x1830945991833088:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1746127009.260977:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.260998:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efad8a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bc5 expref: 8 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.261291:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.261295:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127009.261330:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.261340:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.261348:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00010000:2.0:1746127009.261418:0:13448:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ced5180 reply state ffff880099566000 transno 8589938324 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.261426:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.261431:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.261433:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746127009.261435:0:13448:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746127009.261486:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4510:x1830945991833088:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 545us (1088us total) trans 8589938324 rc 0/0 00000100:00100000:2.0:1746127009.261495:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17365 00000100:00100000:0.0:1746127009.270252:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.270296:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.270326:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.270356:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.270378:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991833600 00000100:00100000:0.0:1746127009.270385:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991833600 00000100:00100000:0.0:1746127009.270418:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991833856 00000100:00100000:0.0:1746127009.270420:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991833856 00000100:00100000:0.0:1746127009.270432:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991834112 00000100:00100000:0.0:1746127009.270434:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991834112 00000100:00100000:0.0:1746127009.270448:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22009 00000100:00100000:0.0:1746127009.270454:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991833600:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127009.270564:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127009.270567:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127006 -> 1746127007 00002000:00010000:0.0:1746127009.270568:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127003 -> 1746127007 00002000:00010000:0.0:1746127009.270570:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127006 -> 1746127007 00002000:00010000:0.0:1746127009.270572:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127009.270609:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991833600:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 155us (312us total) trans 17179875653 rc 0/0 00000100:00100000:0.0:1746127009.270615:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22009 00000100:00100000:0.0:1746127009.270629:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22010 00000100:00100000:0.0:1746127009.270633:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991833856:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127009.270687:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127009.270689:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270691:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270692:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270694:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127009.270709:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991833856:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 75us (383us total) trans 21474842925 rc 0/0 00000100:00100000:0.0:1746127009.270714:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22010 00000100:00100000:0.0:1746127009.270722:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22011 00000100:00100000:0.0:1746127009.270726:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991834112:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127009.270761:0:3148:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127009.270763:0:3148:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270764:0:3148:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270765:0:3148:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270767:0:3148:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746127009.270781:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991834112:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 55us (424us total) trans 17179875654 rc 0/0 00000100:00100000:0.0:1746127009.270785:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22011 00000100:00100000:0.0:1746127009.270821:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.270836:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991833472 00000100:00100000:0.0:1746127009.270838:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991833472 00000100:00100000:0.0:1746127009.270851:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22012 00000100:00100000:0.0:1746127009.270854:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991833472:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127009.270889:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127009.270891:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270893:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270895:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.270896:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746127009.270911:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991833472:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 55us (89us total) trans 21474842926 rc 0/0 00000100:00100000:0.0:1746127009.270916:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22012 00000100:00100000:0.0:1746127009.270957:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.270970:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991833728 00000100:00100000:0.0:1746127009.270973:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991833728 00000100:00100000:0.0:1746127009.270986:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22013 00000100:00100000:0.0:1746127009.270990:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991833728:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127009.271038:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127009.271040:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127006 -> 1746127007 00002000:00010000:0.0:1746127009.271041:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127006 -> 1746127007 00002000:00010000:0.0:1746127009.271043:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127006 -> 1746127007 00002000:00010000:0.0:1746127009.271044:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746127009.271058:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991833728:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 68us (101us total) trans 17179875655 rc 0/0 00000100:00100000:0.0:1746127009.271063:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22013 00000100:00100000:0.0:1746127009.271102:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.271113:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991833984 00000100:00100000:0.0:1746127009.271115:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991833984 00000100:00100000:0.0:1746127009.271126:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22014 00000100:00100000:0.0:1746127009.271157:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991833984:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127009.271191:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127009.271193:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.271194:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.271196:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.271197:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746127009.271210:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991833984:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 54us (108us total) trans 21474842927 rc 0/0 00000100:00100000:0.0:1746127009.271214:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22014 00000100:00100000:2.0:1746127009.271263:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991833344 00000100:00100000:2.0:1746127009.271267:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991833344 00002000:00100000:2.0:1746127009.271288:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012ced6a00 x1830945991833344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.271296:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6a00 with x1830945991833344 ext(4194304->4829183) 00002000:00010000:2.0:1746127009.271300:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced6a00 00000100:00100000:2.0:1746127009.271312:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8831 00000100:00100000:2.0:1746127009.271317:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991833344:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.273507:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.273564:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991834368 00000100:00100000:0.0:1746127009.273570:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991834368 00000100:00100000:0.0:1746127009.273608:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6638 00000100:00100000:0.0:1746127009.273613:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4510:x1830945991834368:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1746127009.273745:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4510:x1830945991834368:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 131us (242us total) trans 8589938325 rc 0/0 00000100:00100000:0.0:1746127009.273751:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6638 00000100:00100000:0.0:1746127009.277272:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746127009.277289:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994320640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746127009.277337:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.277914:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991833344:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6594us (7667us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746127009.277923:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8831 00002000:00100000:0.0:1746127009.277932:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012ced6a00 x1830945991833344/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.277941:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6a00 with x1830945991833344 ext(4194304->4829183) 00002000:00010000:0.0:1746127009.277946:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced6a00 00000100:00100000:2.0:1746127009.277985:0:9236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994320640 00000100:00100000:2.0:1746127009.277991:0:9236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994320640 00000100:00100000:2.0:1746127009.278267:0:9236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1746127009.278274:0:9236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3784:x1830945994320640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746127009.278298:0:9236:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445584896 avail 1316122624 00000100:00100000:2.0:1746127009.278327:0:9236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3784:x1830945994320640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.278331:0:9236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1746127009.278346:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994320640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746127009.278500:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.278540:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.278692:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991834752 00000100:00100000:3.0:1746127009.278736:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991834880 00000100:00100000:3.0:1746127009.278740:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991834880 00000100:00100000:2.0:1746127009.278758:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991834752 00000100:00100000:3.0:1746127009.278774:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17366 00000100:00100000:3.0:1746127009.278779:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4521:x1830945991834880:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:2.0:1746127009.278782:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6639 00000100:00100000:2.0:1746127009.278786:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4510:x1830945991834752:12345-192.168.203.42@tcp:35:lfs.0 00010000:00010000:3.0:1746127009.278791:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.278794:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:2.0:1746127009.278902:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:4510:x1830945991834752:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 114us (401us total) trans 8589938326 rc 0/0 00000100:00100000:2.0:1746127009.278910:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6639 00010000:00010000:3.0:1746127009.279031:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbb6c00/0x34dc807b6efad67 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba9 expref: 10 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.279050:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.279054:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127009.279062:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fd800/0x34dc807b6efae1d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53bfd expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.279090:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.279100:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.279105:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.279110:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.279144:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.279152:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 10 pid: 10958 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.279161:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994320768:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.279209:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.279220:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 27 pid: 13448 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.279226:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994320896:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.279246:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2780 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.283874:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994320896:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.283968:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994320768:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.283986:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127009.285676:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.285908:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991835008 00000100:00100000:2.0:1746127009.285915:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991835008 00010000:00010000:2.0:1746127009.285946:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 28 pid: 13448 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.285986:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10364 00000100:00100000:2.0:1746127009.285993:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991835008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.286005:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.286024:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 28 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.286035:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 28 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.286054:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f45e00/0x34dc807b6efad60 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ba2 expref: 28 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.286075:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.286080:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.286088:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.286092:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.286155:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991835008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 162us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.286165:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10364 00000100:00100000:0.0:1746127009.286254:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.286384:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991835136 00000100:00100000:1.0:1746127009.286387:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991835136 00010000:00010000:1.0:1746127009.286402:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 11 pid: 10958 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.286423:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10365 00000100:00100000:1.0:1746127009.286428:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991835136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.286435:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.286439:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 11 pid: 10958 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.286446:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 11 pid: 10958 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.286464:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efad7c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bbe expref: 11 pid: 10958 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.286474:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127009.286478:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127009.286484:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127009.286490:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127009.286506:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127009.286517:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.286524:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127009.286526:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991835136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.286532:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10365 00000040:00080000:3.0:1746127009.286728:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1426, 88 off133096 00000004:00080000:3.0:1746127009.286732:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328602741ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.286761:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1441, 88 off134504 00000004:00080000:3.0:1746127009.286764:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328635072ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127009.286783:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1442, 88 off134592 00000004:00080000:3.0:1746127009.286786:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328656426ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127009.286868:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1427, 88 off133184 00000004:00080000:3.0:1746127009.286872:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328742426ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.286884:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1428, 88 off133272 00000004:00080000:3.0:1746127009.286886:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328757046ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.286896:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1443, 88 off134680 00000004:00080000:3.0:1746127009.286898:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328769026ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127009.286907:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1444, 88 off134768 00000004:00080000:3.0:1746127009.286909:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328780121ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127009.286917:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1445, 88 off134856 00000004:00080000:3.0:1746127009.286919:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328789549ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127009.286926:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1429, 88 off133360 00000004:00080000:3.0:1746127009.286929:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328799136ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.286937:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1446, 88 off134944 00000004:00080000:3.0:1746127009.286940:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328810499ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127009.286947:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1430, 88 off133448 00000004:00080000:3.0:1746127009.286950:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328820966ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.286959:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1447, 88 off135032 00000004:00080000:3.0:1746127009.286961:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328832069ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127009.286969:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1431, 88 off133536 00000004:00080000:3.0:1746127009.286971:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328841715ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.286980:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1432, 88 off133624 00000004:00080000:3.0:1746127009.286982:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328853066ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.286998:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1433, 88 off133712 00000004:00080000:3.0:1746127009.287001:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328871347ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.287023:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1434, 88 off133800 00000004:00080000:3.0:1746127009.287028:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904328898332ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127009.287040:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1448, 88 off135120 00000004:00080000:3.0:1746127009.287042:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904328913022ns, next at 895431202182ns, rc = 0 00000001:00080000:1.0:1746127009.289253:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938327 is committed 00000004:00080000:1.0:1746127009.289263:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1422 committed 00000004:00080000:1.0:1746127009.289732:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1408 committed 00000004:00080000:1.0:1746127009.289753:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1407 committed 00000004:00080000:1.0:1746127009.289759:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1406 committed 00000004:00080000:1.0:1746127009.289761:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1405 committed 00000004:00080000:1.0:1746127009.289763:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1421 committed 00000004:00080000:1.0:1746127009.289764:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1404 committed 00000004:00080000:1.0:1746127009.289766:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1420 committed 00000004:00080000:1.0:1746127009.289767:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1403 committed 00000004:00080000:1.0:1746127009.289769:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1419 committed 00000004:00080000:1.0:1746127009.289770:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1418 committed 00000004:00080000:1.0:1746127009.289771:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1417 committed 00000004:00080000:1.0:1746127009.289773:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1402 committed 00000004:00080000:1.0:1746127009.289774:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1401 committed 00000004:00080000:1.0:1746127009.289776:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1416 committed 00000004:00080000:1.0:1746127009.289777:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1415 committed 00000004:00080000:1.0:1746127009.289778:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1400 committed 00000001:00080000:1.0:1746127009.289790:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938326 is committed 00010000:00010000:3.0:1746127009.289857:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.289865:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.289870:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.289892:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213f800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127009.289894:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127009.289909:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.289919:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127009.289919:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.289922:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746127009.289928:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.289930:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127009.289932:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.289934:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f800/0x34dc807b6efae16 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127009.289935:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fd800/0x34dc807b6efae1d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 10 pid: 13448 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746127009.289961:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 9 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.289983:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.289986:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746127009.289987:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fc000, rc 0) 00000100:00100000:3.0:1746127009.290027:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.290038:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4521:x1830945991834880:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 11257us (11497us total) trans 8589938327 rc 0/0 00000100:00100000:0.0:1746127009.290045:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17366 00000100:00100000:0.0:1746127009.290068:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.290069:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.290089:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.290092:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.290103:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.290109:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.290117:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746127009.290121:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.290124:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.290152:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.290155:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746127009.290161:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.290164:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.290177:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127009.290381:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127009.290404:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127009.290553:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.290560:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321280 00000100:00100000:0.0:1746127009.290560:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321024 00000100:00100000:3.0:1746127009.290566:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321280 00000100:00100000:0.0:1746127009.290566:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321024 00000100:00100000:2.0:1746127009.290572:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127009.290586:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746127009.290589:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321536 00000100:00100000:2.0:1746127009.290590:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.290591:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321536 00000100:00100000:0.0:1746127009.290597:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321792 00000100:00100000:0.0:1746127009.290599:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321792 00000100:00100000:3.0:1746127009.290600:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321152 00000100:00100000:3.0:1746127009.290602:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321152 00000100:00100000:3.0:1746127009.290608:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322176 00000100:00100000:0.0:1746127009.290608:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321664 00000100:00100000:3.0:1746127009.290610:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322176 00000100:00100000:0.0:1746127009.290610:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321664 00000100:00100000:2.0:1746127009.290616:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.290616:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322688 00000100:00100000:0.0:1746127009.290618:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322688 00000100:00100000:3.0:1746127009.290619:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22015 00000100:00100000:2.0:1746127009.290624:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.290625:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3784:x1830945994321280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.290625:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322048 00000100:00100000:0.0:1746127009.290627:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322048 00000100:00100000:0.0:1746127009.290635:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22016 00000100:00100000:2.0:1746127009.290638:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.290640:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994321024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127009.290654:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322560 00000100:00100000:2.0:1746127009.290657:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322560 00000100:00100000:2.0:1746127009.290672:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22017 00000100:00100000:2.0:1746127009.290676:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994321536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.290703:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22018 00000100:00100000:3.0:1746127009.290707:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3784:x1830945994321792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127009.290716:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127009.290719:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.290721:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.290723:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127009.290724:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746127009.290730:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22019 00000100:00100000:2.0:1746127009.290735:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994321152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.290744:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994321024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (676us total) trans 21474842928 rc 0/0 00000100:00100000:0.0:1746127009.290749:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22016 00002000:00010000:3.0:1746127009.290750:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127009.290753:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.290755:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127009.290757:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.290758:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000004:00080000:2.0:1746127009.290758:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122386a00/2, rc 0, transno 21474842928 00000100:00100000:0.0:1746127009.290759:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22020 00000100:00100000:0.0:1746127009.290764:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994321664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127009.290766:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.290778:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3784:x1830945994321792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (653us total) trans 21474842931 rc 0/0 00000100:00100000:3.0:1746127009.290783:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22018 00000100:00100000:2.0:1746127009.290790:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994323072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.290793:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22021 00000100:00100000:3.0:1746127009.290797:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3783:x1830945994322176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127009.290807:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127009.290817:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994321664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (638us total) trans 21474842932 rc 0/0 00000004:00080000:2.0:1746127009.290821:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b78700/2, rc 0, transno 21474842932 00000100:00100000:0.0:1746127009.290822:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22020 00000100:00100000:2.0:1746127009.290824:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127009.290829:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323072 00000100:00100000:0.0:1746127009.290832:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323072 00000100:00100000:0.0:1746127009.290840:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22022 00000100:00100000:0.0:1746127009.290843:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3783:x1830945994322688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127009.290847:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127009.290850:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.290851:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.290853:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.290854:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746127009.290875:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3783:x1830945994322176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (469us total) trans 17179875656 rc 0/0 00000100:00100000:1.0:1746127009.290875:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.290882:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22021 00000100:00100000:3.0:1746127009.290891:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22023 00000100:00100000:3.0:1746127009.290895:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3783:x1830945994322048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127009.290896:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127009.290906:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127009.290917:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127009.290924:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746127009.290928:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322304:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127009.290930:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127009.290933:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.290934:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.290936:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00000100:00100000:1.0:1746127009.290937:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746127009.290938:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746127009.290943:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.290955:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3783:x1830945994322048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (339us total) trans 17179875657 rc 0/0 00000100:00100000:1.0:1746127009.290958:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.290959:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22023 00000100:00100000:3.0:1746127009.290967:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322432 00000100:00100000:3.0:1746127009.290969:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322432 00000100:00100000:1.0:1746127009.290971:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322944 00000100:00100000:1.0:1746127009.290973:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322944 00000100:00100000:3.0:1746127009.290977:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322304 00000100:00100000:3.0:1746127009.290979:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322304 00000100:00100000:3.0:1746127009.290985:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994322816 00000100:00100000:3.0:1746127009.290987:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994322816 00000100:00100000:1.0:1746127009.290987:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22024 00000100:00100000:1.0:1746127009.290992:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3783:x1830945994322560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.290994:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22025 00000100:00100000:3.0:1746127009.290998:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994323072:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127009.291002:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094826300/2, rc 0, transno 17179875657 00000100:00100000:2.0:1746127009.291006:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127009.291024:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094824000/2, rc 0, transno 17179875656 00000100:00100000:2.0:1746127009.291027:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.291066:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994323072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (258us total) trans 21474842933 rc 0/0 00000004:00080000:2.0:1746127009.291069:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba55f80/2, rc 0, transno 21474842933 00000100:00100000:3.0:1746127009.291071:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22025 00000100:00100000:2.0:1746127009.291072:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994323072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127009.291073:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994322560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (433us total) trans 17179875658 rc 0/0 00000100:00100000:1.0:1746127009.291078:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22024 00000100:00100000:3.0:1746127009.291081:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22026 00000004:00080000:2.0:1746127009.291081:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede2300/2, rc 0, transno 17179875658 00000100:00100000:2.0:1746127009.291083:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.291085:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3785:x1830945994322432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127009.291089:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22027 00000100:00100000:1.0:1746127009.291094:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3785:x1830945994322944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127009.291119:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127009.291121:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.291123:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127009.291125:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127009.291127:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127009.291163:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3785:x1830945994322432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (266us total) trans 17179875659 rc 0/0 00000100:00100000:3.0:1746127009.291168:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22026 00000100:00100000:1.0:1746127009.291176:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994322944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (257us total) trans 17179875660 rc 0/0 00000100:00100000:3.0:1746127009.291177:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22028 00000100:00100000:3.0:1746127009.291181:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994322304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127009.291181:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22027 00000100:00100000:1.0:1746127009.291192:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22029 00000100:00100000:1.0:1746127009.291197:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3785:x1830945994322816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127009.291213:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127009.291215:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.291216:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.291218:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127009.291219:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746127009.291234:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3785:x1830945994322304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (296us total) trans 17179875661 rc 0/0 00000100:00100000:3.0:1746127009.291238:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22028 00000100:00100000:3.0:1746127009.291253:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127009.291254:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994322816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (294us total) trans 17179875662 rc 0/0 00000100:00100000:1.0:1746127009.291259:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22029 00000100:00100000:1.0:1746127009.291267:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321408 00000100:00100000:1.0:1746127009.291269:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321408 00000100:00100000:3.0:1746127009.291272:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127009.291281:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22030 00000100:00100000:1.0:1746127009.291284:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3784:x1830945994321408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.291287:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746127009.291298:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b79f80/2, rc 0, transno 21474842931 00000100:00100000:3.0:1746127009.291301:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127009.291324:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994321920 00002000:00010000:3.0:1746127009.291325:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:3.0:1746127009.291327:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.291327:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746127009.291328:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00000100:00100000:2.0:1746127009.291328:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994321920 00002000:00010000:3.0:1746127009.291329:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127009.291330:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127009.291331:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00002000:00010000:1.0:1746127009.291331:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127009.291333:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127009.291334:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:2.0:1746127009.291343:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22031 00000100:00100000:2.0:1746127009.291348:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3784:x1830945994321920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127009.291349:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3784:x1830945994321280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 725us (1257us total) trans 21474842929 rc 0/0 00000100:00100000:1.0:1746127009.291353:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3784:x1830945994321408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (100us total) trans 21474842934 rc 0/0 00000100:00100000:3.0:1746127009.291354:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22015 00000100:00100000:1.0:1746127009.291361:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22030 00000004:00080000:3.0:1746127009.291369:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122386d80/2, rc 0, transno 21474842934 00000100:00100000:3.0:1746127009.291373:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321408:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127009.291379:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122387480/2, rc 0, transno 21474842929 00000100:00100000:3.0:1746127009.291381:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127009.291385:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede0a80/2, rc 0, transno 17179875661 00000100:00100000:1.0:1746127009.291389:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322304:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127009.291392:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:2.0:1746127009.291395:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00000004:00080000:1.0:1746127009.291395:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede0700/2, rc 0, transno 17179875662 00002000:00010000:2.0:1746127009.291397:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127009.291398:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00000100:00100000:1.0:1746127009.291398:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322816:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127009.291400:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000004:00080000:1.0:1746127009.291403:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede1f80/2, rc 0, transno 17179875659 00000100:00100000:1.0:1746127009.291406:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322432:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127009.291417:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba56a00/2, rc 0, transno 17179875660 00000100:00100000:1.0:1746127009.291419:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994322944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127009.291426:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3782:x1830945994321536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 749us (1322us total) trans 21474842930 rc 0/0 00000100:00100000:2.0:1746127009.291426:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3784:x1830945994321920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (138us total) trans 21474842935 rc 0/0 00000100:00100000:3.0:1746127009.291431:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22017 00000100:00100000:2.0:1746127009.291440:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22031 00000004:00080000:3.0:1746127009.291447:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b7ad80/2, rc 0, transno 21474842935 00000100:00100000:3.0:1746127009.291450:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994321920:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127009.291490:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127009.291492:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:2.0:1746127009.291494:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:2.0:1746127009.291495:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:2.0:1746127009.291497:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746127009.291516:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994321152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 781us (1363us total) trans 21474842936 rc 0/0 00000100:00100000:2.0:1746127009.291521:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22019 00000004:00080000:2.0:1746127009.291612:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880122384700/2, rc 0, transno 21474842936 00000100:00100000:2.0:1746127009.291616:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127009.291623:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d0000/2, rc 0, transno 21474842930 00000100:00100000:2.0:1746127009.291625:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994321536:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127009.291701:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746127009.291705:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127009.291707:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127009.291709:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127009.291711:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746127009.291741:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994322688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 896us (1167us total) trans 17179875663 rc 0/0 00000100:00100000:0.0:1746127009.291747:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22022 00000004:00080000:2.0:1746127009.291765:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede1c00/2, rc 0, transno 17179875663 00000100:00100000:2.0:1746127009.291768:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994322688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127009.293243:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:444fe009-ee02-43e3-bd8f-cf01026dcff4:3783:1830945994323200:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293274:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127009.293317:0:8221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323200 00000100:00100000:2.0:1746127009.293320:0:8221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323200 00000100:00100000:2.0:1746127009.293528:0:8221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1746127009.293535:0:8221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3783:x1830945994323200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.293547:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994323328:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293564:0:8221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3783:x1830945994323200:12345-0@lo:400:kworker.0 Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.293570:0:8221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1746127009.293573:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.293590:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3784:1830945994323840:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293590:0:9236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323328 00000100:00100000:2.0:1746127009.293592:0:9236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323328 00000100:00100000:3.0:1746127009.293607:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.293617:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3784:1830945994324352:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293621:0:9236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1746127009.293625:0:9236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3784:x1830945994323328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.293630:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.293641:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746127009.293645:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3784:1830945994323456:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293647:0:9236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3784:x1830945994323328:12345-0@lo:400:kworker.0 Request processed in 21us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.293651:0:9236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1746127009.293660:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127009.293663:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994323712:0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.293672:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3784:1830945994323968:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293678:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.293686:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127009.293691:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3783:1830945994324224:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293703:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.293705:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994323328:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293717:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:444fe009-ee02-43e3-bd8f-cf01026dcff4:3783:1830945994323200:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293726:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746127009.293728:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323840 00000100:00100000:3.0:1746127009.293730:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323840 00000100:00100000:2.0:1746127009.293730:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994323584:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.293741:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127009.293750:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3783:1830945994324096:0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.293755:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994324352 00000100:00100000:3.0:1746127009.293757:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994324352 00000100:00100000:3.0:1746127009.293766:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323456 00000100:00100000:3.0:1746127009.293768:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323456 00000100:00100000:3.0:1746127009.293775:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323968 00000100:00100000:3.0:1746127009.293776:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323968 00000100:00100000:3.0:1746127009.293784:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994324224 00000100:00100000:3.0:1746127009.293786:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994324224 00000100:00100000:3.0:1746127009.293795:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1746127009.293799:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3784:x1830945994323840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127009.293876:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323712 00000100:00100000:0.0:1746127009.293879:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323712 00000100:00100000:0.0:1746127009.293898:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994323584 00000100:00100000:0.0:1746127009.293899:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994323584 00000100:00100000:0.0:1746127009.293910:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1746127009.293914:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994323712:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1746127009.293966:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746127009.293969:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746127009.293971:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746127009.293972:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746127009.294292:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.294310:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3784:x1830945994323840:12345-0@lo:400:kworker.0 Request processed in 509us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.294316:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1746127009.294326:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994324096 00000100:00100000:3.0:1746127009.294329:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994324096 00000100:00100000:2.0:1746127009.294341:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1746127009.294347:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3784:x1830945994324352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.294349:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1746127009.294353:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3784:x1830945994323456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.294378:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3784:x1830945994323456:12345-0@lo:400:kworker.0 Request processed in 24us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.294382:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1746127009.294390:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1746127009.294394:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3784:x1830945994323968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.294395:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3784:x1830945994324352:12345-0@lo:400:kworker.0 Request processed in 49us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.294402:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1746127009.294416:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3784:x1830945994323968:12345-0@lo:400:kworker.0 Request processed in 21us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.294420:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:1.0:1746127009.294588:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746127009.294634:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994323712:12345-0@lo:400:kworker.0 Request processed in 719us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.294640:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1746127009.294651:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1746127009.294655:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994323584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127009.294676:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3783:x1830945994323584:12345-0@lo:400:kworker.0 Request processed in 21us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.294680:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1746127009.294819:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1746127009.294825:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1746127009.294825:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3783:x1830945994324224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.294832:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3783:x1830945994324096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.294848:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3783:x1830945994324224:12345-0@lo:400:kworker.0 Request processed in 24us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.294852:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1746127009.294857:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3783:x1830945994324096:12345-0@lo:400:kworker.0 Request processed in 27us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.294869:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1746127009.294876:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994323584:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.294883:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3783:1830945994324096:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.294890:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994323712:0@lo:400:kworker.0 00000100:00100000:2.0:1746127009.294896:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3783:1830945994324224:0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.294900:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3784:1830945994323456:0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.294907:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3784:1830945994323968:0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.294914:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3784:1830945994323840:0@lo:400:kworker.0 00000100:00100000:3.0:1746127009.294920:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3784:1830945994324352:0@lo:400:kworker.0 00000100:00100000:0.0:1746127009.296158:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.296200:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991835392 00000100:00100000:2.0:1746127009.296206:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991835392 00000100:00100000:2.0:1746127009.296231:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17367 00000100:00100000:2.0:1746127009.296236:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4523:x1830945991835392:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127009.296247:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.296261:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6efae2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c04 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.296314:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296324:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296337:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296347:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296352:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296356:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296422:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296428:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296433:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127009.296441:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127009.296488:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296494:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296499:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296503:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099158a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.296506:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296511:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296519:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127009.296521:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.296525:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296529:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efae32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296553:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296558:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296561:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296568:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099159800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.296570:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296574:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296579:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b8e7800) 00010000:00010000:2.0:1746127009.296580:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.296582:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296585:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159800/0x34dc807b6efae39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.296611:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159400/0x34dc807b6efae2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.296619:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.296624:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.296625:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127009.296627:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159c00, rc 0) 00000100:00100000:2.0:1746127009.296705:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4523:x1830945991835392:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 468us (550us total) trans 8589938328 rc 0/0 00000100:00100000:2.0:1746127009.296711:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17367 00000100:00100000:0.0:1746127009.297267:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.297306:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991835520 00000100:00100000:2.0:1746127009.297310:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991835520 00000100:00100000:2.0:1746127009.297330:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22032 00000100:00100000:2.0:1746127009.297334:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4521:x1830945991835520:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127009.297342:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.297351:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c0b expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.297367:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 25 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.297374:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.297381:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 42 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.297385:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.297387:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.297389:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [348160->917503] (req 348160->917503) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 25 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.297408:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 42 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.297416:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 42 pid: 1964 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.297424:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994324480:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.297492:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.297500:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.297508:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994324608:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.297527:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 25 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.297533:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 25 pid: 12340 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.297539:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994324736:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.297615:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.299679:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994324480:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.299689:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994324608:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.299696:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994324736:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.299720:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [348160->917503] (req 348160->917503) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 25 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.299734:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158800, rc 0) 00000100:00100000:2.0:1746127009.299772:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4521:x1830945991835520:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2436us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.299817:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22032 00000100:00100000:0.0:1746127009.300897:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.300995:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.301060:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.301071:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991835776 00000100:00100000:1.0:1746127009.301077:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991835776 00010000:00010000:1.0:1746127009.301102:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 15 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.301117:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991835648 00000100:00100000:2.0:1746127009.301121:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991835648 00000100:00100000:1.0:1746127009.301121:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991835904 00000100:00100000:1.0:1746127009.301123:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991835904 00010000:00010000:1.0:1746127009.301152:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 25 pid: 12340 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.301165:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10366 00010000:00010000:2.0:1746127009.301170:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 43 pid: 1964 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.301170:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991835776:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.301179:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.301194:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 15 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.301195:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10367 00000100:00100000:2.0:1746127009.301200:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991835904:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.301201:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 15 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.301208:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.301217:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6800/0x34dc807b6efada6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bcc expref: 15 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.301222:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 25 pid: 12340 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.301228:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127009.301230:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 25 pid: 12340 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.301242:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800911df600/0x34dc807b6efad05 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b55 expref: 25 pid: 12340 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.301249:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991835776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 79us (355us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127009.301251:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.301254:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10366 00000100:00100000:3.0:1746127009.301263:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10368 00000100:00100000:2.0:1746127009.301266:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991835904:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.301271:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991835648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127009.301278:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127009.301287:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 43 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.301296:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 43 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.301307:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7e00/0x34dc807b6efad28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b4e expref: 43 pid: 1964 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.301315:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.301316:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.301321:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 24 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.301332:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 24 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.301355:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 24 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.301365:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994324864:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127009.301421:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.301560:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10367 00000100:00100000:3.0:1746127009.302822:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994324864:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127009.302836:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127009.302860:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991835648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1590us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.302866:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10368 00000100:00100000:0.0:1746127009.324449:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.324551:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991836160 00000100:00100000:2.0:1746127009.324559:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991836160 00002000:00100000:2.0:1746127009.324593:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (348160->352255) req@ffff88012153ea00 x1830945991836160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.324608:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153ea00 with x1830945991836160 ext(348160->352255) 00002000:00010000:2.0:1746127009.324612:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153ea00 00000100:00100000:2.0:1746127009.324639:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8832 00000100:00100000:2.0:1746127009.324645:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991836160:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127009.324754:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991836160:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 108us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127009.324759:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8832 00002000:00100000:2.0:1746127009.324764:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (348160->352255) req@ffff88012153ea00 x1830945991836160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.324771:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153ea00 with x1830945991836160 ext(348160->352255) 00002000:00010000:2.0:1746127009.324774:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153ea00 00000100:00100000:0.0:1746127009.329595:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.329824:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991836416 00000100:00100000:2.0:1746127009.329832:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991836416 00002000:00100000:2.0:1746127009.329880:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (913408->917503) req@ffff88012153c380 x1830945991836416/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.329889:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153c380 with x1830945991836416 ext(913408->917503) 00002000:00010000:2.0:1746127009.329894:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153c380 00000100:00100000:2.0:1746127009.329914:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8833 00000100:00100000:2.0:1746127009.329921:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991836416:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127009.330034:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991836416:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 112us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127009.330039:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8833 00002000:00100000:2.0:1746127009.330045:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (913408->917503) req@ffff88012153c380 x1830945991836416/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.330051:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153c380 with x1830945991836416 ext(913408->917503) 00002000:00010000:2.0:1746127009.330053:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153c380 00000100:00100000:0.0:1746127009.339968:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.340060:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991836672 00000100:00100000:1.0:1746127009.340071:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991836672 00000100:00100000:1.0:1746127009.340170:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6640 00000100:00100000:1.0:1746127009.340178:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4baf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4521:x1830945991836672:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127009.340490:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4baf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4521:x1830945991836672:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 312us (530us total) trans 8589938329 rc 0/0 00000100:00100000:1.0:1746127009.340496:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6640 00000100:00100000:0.0:1746127009.357407:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994324992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746127009.357480:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127009.357617:0:7265:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994324992 00000100:00100000:1.0:1746127009.357626:0:7265:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994324992 00000100:00100000:1.0:1746127009.357670:0:7265:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1746127009.357676:0:7265:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3785:x1830945994324992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746127009.357705:0:7265:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445502976 avail 1316040704 00000100:00100000:1.0:1746127009.357770:0:7265:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3785:x1830945994324992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.357776:0:7265:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1746127009.357835:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994324992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746127009.373054:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.373330:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991836928 00000100:00100000:2.0:1746127009.373340:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991836928 00000100:00100000:2.0:1746127009.376036:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17368 00000100:00100000:2.0:1746127009.376052:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4529:x1830945991836928:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.376075:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.376092:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158e00/0x34dc807b6efae55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c12 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.376170:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376180:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376189:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376199:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376204:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376209:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376288:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376295:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376300:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127009.376307:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127009.376359:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376492:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376497:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376502:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099159000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.376504:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376509:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376518:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127009.376520:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.376523:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376527:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376560:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376568:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376572:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376576:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099158400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.376579:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376583:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376589:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b8e7800) 00010000:00010000:2.0:1746127009.376591:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.376594:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376598:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158400/0x34dc807b6efae63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.376629:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158e00/0x34dc807b6efae55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.376638:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.376644:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.376645:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127009.376647:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158200, rc 0) 00000100:00100000:2.0:1746127009.376695:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4529:x1830945991836928:12345-192.168.203.42@tcp:101:cat.0 Request processed in 648us (3652us total) trans 8589938330 rc 0/0 00000100:00100000:2.0:1746127009.376701:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17368 00000100:00100000:0.0:1746127009.379412:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.379454:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991837184 00000100:00100000:1.0:1746127009.379461:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991837184 00000100:00100000:1.0:1746127009.379504:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6641 00000100:00100000:1.0:1746127009.379511:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4529:x1830945991837184:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127009.380214:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4529:x1830945991837184:12345-192.168.203.42@tcp:35:cat.0 Request processed in 702us (806us total) trans 8589938331 rc 0/0 00000100:00100000:1.0:1746127009.380221:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6641 00000100:00100000:3.0:1746127009.389623:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994325120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746127009.389681:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127009.389803:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994325120 00000100:00100000:1.0:1746127009.389810:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994325120 00000100:00100000:1.0:1746127009.389844:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1746127009.389851:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994325120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746127009.389870:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1136397632 pending 8163328 free 3907129344 avail 3675607040 00000100:00100000:1.0:1746127009.389903:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994325120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.389917:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1746127009.389983:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994325120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746127009.405347:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.405629:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991837312 00000100:00100000:2.0:1746127009.405640:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991837312 00000100:00100000:2.0:1746127009.405691:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22033 00000100:00100000:2.0:1746127009.405705:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991837312:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.405719:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.405732:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efae78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c19 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.405756:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746127009.405766:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994325376:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127009.405840:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.405948:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994325248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746127009.405982:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127009.406029:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994325248 00000100:00100000:3.0:1746127009.406032:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994325248 00000100:00100000:3.0:1746127009.406056:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1746127009.406060:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994325248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746127009.406077:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1111682368 pending 8392704 free 3910705152 avail 3679182848 00000100:00100000:3.0:1746127009.406102:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994325248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.406108:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1746127009.406152:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994325248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746127009.410815:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.411294:0:20411:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991837824 00000100:00100000:2.0:1746127009.411305:0:20411:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991837824 00002000:00100000:2.0:1746127009.411363:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123475c00 x1830945991837824/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.411374:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475c00 with x1830945991837824 ext(1048576->2097151) 00002000:00010000:2.0:1746127009.411381:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123475c00 00000100:00100000:2.0:1746127009.411410:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8834 00000100:00100000:2.0:1746127009.411420:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991837824:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:3.0:1746127009.412403:0:9612:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127007 -> 1746127008 00000100:00100000:3.0:1746127009.412421:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994325376:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127009.412453:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efae78 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c19 expref: 43 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.412465:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efae78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c19 expref: 43 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.412480:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159400, rc 0) 00000100:00100000:3.0:1746127009.412519:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991837312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6821us (7186us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127009.412526:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22033 00000100:00100000:0.0:1746127009.422068:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.422102:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.422188:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.422383:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991837696 00000100:00100000:3.0:1746127009.422391:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991837696 00002000:00100000:3.0:1746127009.422425:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880123475180 x1830945991837696/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.422434:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475180 with x1830945991837696 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.422439:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123475180 00000100:00100000:3.0:1746127009.422460:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991838080 00000100:00100000:3.0:1746127009.422462:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991838080 00002000:00100000:3.0:1746127009.422474:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880123474a80 x1830945991838080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 504/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.422486:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474a80 with x1830945991838080 ext(0->1048575) 00002000:00010000:3.0:1746127009.422489:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123474a80 00000100:00100000:3.0:1746127009.422498:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991838208 00000100:00100000:3.0:1746127009.422499:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991838208 00002000:00100000:3.0:1746127009.422509:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880123476680 x1830945991838208/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.422515:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476680 with x1830945991838208 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.422517:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123476680 00000100:00100000:3.0:1746127009.422530:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8835 00000100:00100000:3.0:1746127009.422536:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991837696:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.422562:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8836 00000100:00100000:2.0:1746127009.422577:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991838080:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.423403:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8837 00000100:00100000:1.0:1746127009.423412:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991838208:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.424021:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.424193:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991837824:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12769us (13386us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.424203:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8834 00002000:00100000:2.0:1746127009.424215:0:20411:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123475c00 x1830945991837824/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.424224:0:20411:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475c00 with x1830945991837824 ext(1048576->2097151) 00002000:00010000:2.0:1746127009.424229:0:20411:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123475c00 00000100:00100000:2.0:1746127009.424376:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991838464 00000100:00100000:2.0:1746127009.424384:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991838464 00000100:00100000:2.0:1746127009.424439:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22034 00000100:00100000:2.0:1746127009.424447:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4532:x1830945991838464:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.424461:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.424481:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c20 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.424856:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.424866:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127009.424868:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127009.424872:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 43 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.424910:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.424924:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 27 pid: 9612 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.424938:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994325504:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.425029:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.435569:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.436374:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994325504:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.436398:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 43 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.436412:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158400, rc 0) 00000100:00100000:3.0:1746127009.436779:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4532:x1830945991838464:12345-192.168.203.42@tcp:101:cat.0 Request processed in 12331us (12757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.436786:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22034 00000100:00100000:2.0:1746127009.436845:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991838080:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14274us (14741us total) trans 0 rc 479232/479232 00000100:00100000:2.0:1746127009.436852:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8836 00002000:00100000:2.0:1746127009.436859:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880123474a80 x1830945991838080/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 504/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 479232/479232 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.436868:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474a80 with x1830945991838080 ext(0->1048575) 00010000:00010000:2.0:1746127009.436874:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.436885:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746127009.436891:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880123474a80 00000100:00100000:2.0:1746127009.436905:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991838592 00000100:00100000:2.0:1746127009.436910:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991838592 00002000:00100000:2.0:1746127009.436931:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (348160->917503) req@ffff880123474000 x1830945991838592/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.436938:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474000 with x1830945991838592 ext(348160->917503) 00010000:00010000:2.0:1746127009.436941:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.436949:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746127009.436954:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880123474000 00000100:00100000:2.0:1746127009.436974:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1966 00000100:00100000:2.0:1746127009.436980:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991838592:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127009.444030:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991837696:12345-192.168.203.42@tcp:3:cat.0 Request processed in 21485us (21961us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.444041:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8835 00002000:00100000:3.0:1746127009.444246:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880123475180 x1830945991837696/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.444265:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475180 with x1830945991837696 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.444269:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123475180 00000100:00100000:2.0:1746127009.446774:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991838592:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9789us (11207us total) trans 21474842937 rc 0/0 00000100:00100000:2.0:1746127009.446783:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1966 00002000:00100000:2.0:1746127009.446793:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (348160->917503) req@ffff880123474000 x1830945991838592/t21474842937(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.446801:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474000 with x1830945991838592 ext(348160->917503) 00010000:00010000:2.0:1746127009.447124:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 28 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.447482:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 28 pid: 9612 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746127009.447489:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880123474000 00000100:00100000:2.0:1746127009.454002:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991838208:12345-192.168.203.42@tcp:3:cat.0 Request processed in 30584us (31806us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.454024:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8837 00002000:00100000:2.0:1746127009.454034:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880123476680 x1830945991838208/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.454044:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476680 with x1830945991838208 ext(1048576->2097151) 00002000:00010000:2.0:1746127009.454049:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123476680 00000100:00100000:0.0:1746127009.454566:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.454864:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991838720 00000100:00100000:3.0:1746127009.454871:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991838720 00010000:00010000:3.0:1746127009.454901:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.454967:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10369 00000100:00100000:3.0:1746127009.454974:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991838720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127009.454984:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127009.454998:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.455007:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.455039:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099158800/0x34dc807b6efae4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 348160->917503) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c0b expref: 26 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.455141:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.455143:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.455149:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.455157:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.455190:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.455200:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994325632:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127009.455767:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2900 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.462310:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994325632:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127009.462331:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127009.462390:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991838720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7415us (7823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.462400:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10369 00000100:00100000:0.0:1746127009.463761:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.463866:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991838976 00000100:00100000:2.0:1746127009.463874:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991838976 00002000:00100000:2.0:1746127009.463919:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880123477b80 x1830945991838976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.463931:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477b80 with x1830945991838976 ext(2097152->4194303) 00002000:00010000:2.0:1746127009.463937:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123477b80 00000100:00100000:2.0:1746127009.463956:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8838 00000100:00100000:2.0:1746127009.463962:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991838976:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.464785:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.464874:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991839232 00000100:00100000:1.0:1746127009.464878:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991839232 00002000:00100000:1.0:1746127009.464899:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880123476d80 x1830945991839232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.464908:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476d80 with x1830945991839232 ext(2097152->4194303) 00002000:00010000:1.0:1746127009.464911:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123476d80 00000100:00100000:1.0:1746127009.464987:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8839 00000100:00100000:1.0:1746127009.464994:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991839232:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.467693:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.468282:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.468325:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.468325:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991839488 00000100:00100000:1.0:1746127009.468333:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991839488 00000100:00100000:2.0:1746127009.468341:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991839744 00000100:00100000:2.0:1746127009.468344:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991839744 00002000:00100000:2.0:1746127009.468371:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba54700 x1830945991839744/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.468371:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012ba54a80 x1830945991839488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.468379:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54a80 with x1830945991839488 ext(0->1048575) 00002000:00100000:2.0:1746127009.468380:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54700 with x1830945991839744 ext(1048576->2097151) 00002000:00010000:2.0:1746127009.468384:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba54700 00002000:00010000:1.0:1746127009.468384:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba54a80 00000100:00100000:1.0:1746127009.468411:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991840000 00000100:00100000:1.0:1746127009.468413:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991840000 00002000:00100000:1.0:1746127009.468423:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012ba56d80 x1830945991840000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.468430:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba56d80 with x1830945991840000 ext(1048576->2097151) 00002000:00010000:1.0:1746127009.468433:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba56d80 00000100:00100000:1.0:1746127009.468446:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8840 00000100:00100000:1.0:1746127009.468451:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2028:x1830945991839744:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127009.468603:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8841 00000100:00100000:3.0:1746127009.468612:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991839488:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.469154:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8842 00000100:00100000:1.0:1746127009.469161:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991840000:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.469977:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.471709:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991840256 00000100:00100000:0.0:1746127009.471721:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991840256 00002000:00100000:0.0:1746127009.471763:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012ba54380 x1830945991840256/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.471773:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54380 with x1830945991840256 ext(1048576->2097151) 00002000:00010000:0.0:1746127009.471780:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba54380 00000100:00100000:0.0:1746127009.471821:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8843 00000100:00100000:0.0:1746127009.471829:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991840256:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.473264:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.473577:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991840512 00000100:00100000:2.0:1746127009.473583:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991840512 00000100:00100000:2.0:1746127009.473637:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17369 00000100:00100000:2.0:1746127009.473644:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4534:x1830945991840512:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127009.473664:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.473684:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c27 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.473786:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.473801:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.473807:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.473813:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127009.473840:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.473852:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 14 pid: 13448 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.473864:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994325760:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.473949:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.473957:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 28 pid: 13448 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.473964:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994325888:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.473980:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.488124:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2028:x1830945991838976:12345-192.168.203.42@tcp:3:cat.0 Request processed in 24150us (24360us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127009.488180:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8838 00002000:00100000:2.0:1746127009.488193:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880123477b80 x1830945991838976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.488210:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477b80 with x1830945991838976 ext(2097152->4194303) 00002000:00010000:2.0:1746127009.488216:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123477b80 00000100:00100000:3.0:1746127009.488670:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994325760:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.488673:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.488681:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994325888:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.488707:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:0.0:1746127009.488718:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.488754:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991840768 00000100:00100000:0.0:1746127009.488760:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991840768 00010000:00010000:0.0:1746127009.488788:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 15 pid: 13448 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.488818:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991840640 00000100:00100000:0.0:1746127009.488820:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991840640 00010000:00010000:0.0:1746127009.488832:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 29 pid: 13448 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.488848:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10370 00000100:00100000:0.0:1746127009.488854:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991840768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.488867:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.488873:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 15 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.488883:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 15 pid: 13448 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.488892:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10371 00000100:00100000:1.0:1746127009.488904:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991840640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.488906:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158200/0x34dc807b6efae6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c12 expref: 15 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.488915:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.488922:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 29 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.488937:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 29 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.488952:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159c00/0x34dc807b6efae40 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c04 expref: 29 pid: 13448 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.488966:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127009.488969:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127009.488974:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127009.488978:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127009.488989:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.489070:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991840640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 169us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.489076:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10371 00010000:00010000:0.0:1746127009.489772:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127009.489781:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.489828:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991840768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 972us (1153us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127009.489859:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.489866:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:3.0:1746127009.489885:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:1.0:1746127009.489969:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10370 00010000:00010000:3.0:1746127009.490020:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159000/0x34dc807b6efae86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 15 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.490046:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 14 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.490052:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.490054:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127009.490056:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159600, rc 0) 00000100:00100000:3.0:1746127009.490086:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4534:x1830945991840512:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 16443us (16825us total) trans 8589938332 rc 0/0 00000100:00100000:3.0:1746127009.490092:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17369 00000100:00100000:2.0:1746127009.497203:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991839232:12345-192.168.203.42@tcp:3:cat.0 Request processed in 32196us (32405us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127009.497215:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8839 00002000:00100000:2.0:1746127009.497227:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880123476d80 x1830945991839232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.497237:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476d80 with x1830945991839232 ext(2097152->4194303) 00002000:00010000:2.0:1746127009.497244:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123476d80 00000100:00100000:1.0:1746127009.510066:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991839744:12345-192.168.203.42@tcp:3:cat.0 Request processed in 41602us (41773us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127009.510079:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8840 00002000:00100000:1.0:1746127009.510090:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ba54700 x1830945991839744/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.510106:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54700 with x1830945991839744 ext(1048576->2097151) 00002000:00010000:1.0:1746127009.510112:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba54700 00000100:00100000:3.0:1746127009.516465:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991839488:12345-192.168.203.42@tcp:3:cat.0 Request processed in 47847us (48772us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.516476:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8841 00002000:00100000:3.0:1746127009.516486:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012ba54a80 x1830945991839488/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.516494:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54a80 with x1830945991839488 ext(0->1048575) 00002000:00010000:3.0:1746127009.516500:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba54a80 00000100:00100000:0.0:1746127009.526995:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.527046:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.527166:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991840896 00000100:00100000:2.0:1746127009.527178:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991840896 00000100:00100000:2.0:1746127009.527229:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22035 00000100:00100000:2.0:1746127009.527237:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991840896:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.527252:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.527267:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c2e expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.527285:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.527287:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.527293:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 26 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.527306:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 26 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.527319:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e96400, rc 0) 00000100:00100000:2.0:1746127009.527364:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991840896:12345-192.168.203.42@tcp:101:cat.0 Request processed in 128us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.527369:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22035 00000100:00100000:3.0:1746127009.527531:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991841024 00000100:00100000:3.0:1746127009.527535:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991841024 00000100:00100000:1.0:1746127009.527551:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2028:x1830945991840000:12345-192.168.203.42@tcp:3:cat.0 Request processed in 58388us (59222us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.527562:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17370 00000100:00100000:1.0:1746127009.527562:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8842 00000100:00100000:3.0:1746127009.527567:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4523:x1830945991841024:12345-192.168.203.42@tcp:101:multiop.0 00002000:00100000:1.0:1746127009.527574:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012ba56d80 x1830945991840000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746127009.527579:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746127009.527583:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba56d80 with x1830945991840000 ext(1048576->2097151) 00002000:00010000:1.0:1746127009.527589:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba56d80 00010000:00010000:3.0:1746127009.527590:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c35 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.528104:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 29 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.528116:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 29 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.528153:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.528156:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127009.528158:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fcc00, rc 0) 00000100:00100000:3.0:1746127009.528194:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4523:x1830945991841024:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 626us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.528200:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17370 00000100:00100000:0.0:1746127009.531270:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991840256:12345-192.168.203.42@tcp:3:cat.0 Request processed in 59430us (61283us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127009.531283:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8843 00002000:00100000:0.0:1746127009.531295:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012ba54380 x1830945991840256/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.531304:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba54380 with x1830945991840256 ext(1048576->2097151) 00002000:00010000:0.0:1746127009.531310:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba54380 00000100:00100000:0.0:1746127009.534174:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.534212:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.534249:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.534335:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991841536 00000100:00100000:3.0:1746127009.534344:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991841536 00000100:00100000:3.0:1746127009.534386:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17371 00000100:00100000:3.0:1746127009.534393:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4532:x1830945991841536:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.534411:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.534428:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efaea9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c43 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.534483:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efaea9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c43 expref: 30 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.534501:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efaea9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c43 expref: 30 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.534517:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.534520:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127009.534523:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fc400, rc 0) 00000100:00100000:3.0:1746127009.534566:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4532:x1830945991841536:12345-192.168.203.42@tcp:101:cat.0 Request processed in 174us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.534572:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17371 00000100:00100000:2.0:1746127009.534710:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991841152 00000100:00100000:2.0:1746127009.534721:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991841152 00000100:00100000:1.0:1746127009.534766:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991841408 00000100:00100000:1.0:1746127009.534770:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991841408 00002000:00100000:1.0:1746127009.534801:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012cc9d500 x1830945991841408/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.534809:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d500 with x1830945991841408 ext(4194304->4829183) 00002000:00010000:1.0:1746127009.534814:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9d500 00000100:00100000:1.0:1746127009.534826:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8844 00000100:00100000:1.0:1746127009.534831:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991841408:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.535840:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22036 00000100:00100000:2.0:1746127009.536100:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4523:x1830945991841152:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127009.536118:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.536145:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c3c expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.536170:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 25 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.536179:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.536186:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.536192:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.536193:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.536196:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2469888->3145727] (req 2469888->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 49 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.536429:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.536439:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.536450:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994326016:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.536542:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127009.537223:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.537232:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.537240:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994326144:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.537289:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 25 pid: 9611 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127009.537358:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991841664 00000100:00100000:3.0:1746127009.537366:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991841664 00000100:00100000:3.0:1746127009.537405:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22037 00000100:00100000:3.0:1746127009.537417:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4534:x1830945991841664:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127009.537431:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.537446:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c4a expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.537470:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 27 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.537478:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.537485:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 49 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.537491:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.537493:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.537495:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1236992->1449983] (req 1236992->1449983) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.537519:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 49 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.537528:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 49 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.537539:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326400:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.537588:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.537595:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.538072:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 27 pid: 9611 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.538083:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994326272:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.538115:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.538460:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326528:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.538522:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 27 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.538531:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 27 pid: 12340 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.538539:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326656:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.538558:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.541586:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.542377:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991841792 00000100:00100000:1.0:1746127009.542386:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991841792 00000100:00100000:1.0:1746127009.542446:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1034 00000100:00100000:1.0:1746127009.542453:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991841792:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.542468:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.542494:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efaea9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c43 expref: 30 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.542552:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127009.542556:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.542608:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991841792:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 155us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.542615:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1034 00000100:00100000:1.0:1746127009.546444:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991841408:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11601us (12219us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127009.546457:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8844 00002000:00100000:1.0:1746127009.546468:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012cc9d500 x1830945991841408/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.546477:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d500 with x1830945991841408 ext(4194304->4829183) 00002000:00010000:1.0:1746127009.546483:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9d500 00000100:00100000:2.0:1746127009.550860:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994326016:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.552862:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.552891:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.552962:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991841920 00000100:00100000:0.0:1746127009.552970:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991841920 00010000:00010000:0.0:1746127009.553005:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.553045:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991842048 00000100:00100000:0.0:1746127009.553048:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991842048 00010000:00010000:0.0:1746127009.553059:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 50 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.553073:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10372 00000100:00100000:0.0:1746127009.553079:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991841920:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.553092:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.553112:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.553123:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.553171:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.553210:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991841920:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 131us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.553216:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10372 00000100:00100000:0.0:1746127009.553230:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10373 00000100:00100000:0.0:1746127009.553234:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991842048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.553240:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.553247:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 50 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.553259:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 50 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.553270:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.553281:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991842048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.553286:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10373 00010000:00010000:3.0:1746127009.553434:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f44e00/0x34dc807b6efad36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b7f expref: 49 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.553451:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326400:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.553462:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326528:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.553469:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326656:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.553501:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1236992->1449983] (req 1236992->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.553510:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a02e00, rc 0) 00000100:00100000:3.0:1746127009.553534:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4534:x1830945991841664:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 16118us (16997us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.553540:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22037 00010000:00010000:2.0:1746127009.554260:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7e00/0x34dc807b6efad9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bef expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.554274:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994326144:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.554282:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994326272:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.554306:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2469888->3145727] (req 2469888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.554316:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e97c00, rc 0) 00000100:00100000:2.0:1746127009.554338:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4523:x1830945991841152:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 18492us (20172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.554344:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22036 00000100:00100000:2.0:1746127009.556472:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.557000:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.557597:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991842176 00000100:00100000:1.0:1746127009.557608:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991842176 00010000:00010000:1.0:1746127009.557647:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.557699:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991842304 00000100:00100000:0.0:1746127009.557703:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991842304 00010000:00010000:0.0:1746127009.557718:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 27 pid: 12340 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.557748:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10374 00000100:00100000:0.0:1746127009.557756:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991842304:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.557771:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.557790:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 27 pid: 12340 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.557801:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 27 pid: 12340 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.558435:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10375 00000100:00100000:1.0:1746127009.558442:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991842176:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.558450:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.558842:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.558842:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911df200/0x34dc807b6efad1a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b5c expref: 27 pid: 12340 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.558851:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.558864:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbb7000/0x34dc807b6efad91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bd3 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.558866:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.558868:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.558875:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 26 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.558882:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 26 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.558890:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.558949:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991842176:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 507us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.558955:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10375 00010000:00010000:2.0:1746127009.558991:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 26 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.559005:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994326784:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127009.559190:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.559450:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991842560 00000100:00100000:1.0:1746127009.559456:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991842560 00002000:00100000:1.0:1746127009.559488:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012d3fe680 x1830945991842560/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.559498:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe680 with x1830945991842560 ext(2097152->4194303) 00002000:00010000:1.0:1746127009.559503:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fe680 00000100:00100000:1.0:1746127009.559523:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8845 00000100:00100000:1.0:1746127009.559529:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991842560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.559832:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.559918:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.559941:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.559966:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.560022:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.560038:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991843200 00000100:00100000:3.0:1746127009.560040:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991843200 00000100:00100000:3.0:1746127009.560059:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991843072 00000100:00100000:3.0:1746127009.560060:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991843072 00000100:00100000:3.0:1746127009.560071:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22038 00000100:00100000:3.0:1746127009.560075:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991843200:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.560084:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.560095:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaebe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c58 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.560113:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.560120:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaebe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c58 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.560144:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaebe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c58 expref: 29 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.560156:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644800, rc 0) 00000100:00100000:3.0:1746127009.560181:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991843200:12345-192.168.203.42@tcp:101:cat.0 Request processed in 105us (214us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127009.560186:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22038 00000100:00100000:3.0:1746127009.560197:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22039 00000100:00100000:3.0:1746127009.560202:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991843072:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.560207:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.560213:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c644c00/0x34dc807b6efaec5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c51 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.560237:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326912:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127009.560270:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.560338:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991842688 00000100:00100000:3.0:1746127009.560341:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991842688 00010000:00010000:3.0:1746127009.560352:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 29 pid: 9611 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.560367:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10376 00000100:00100000:3.0:1746127009.560371:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991842688:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127009.560377:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127009.560389:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 29 pid: 9611 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.560397:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 29 pid: 9611 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.560412:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096642c00/0x34dc807b6efad2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b78 expref: 29 pid: 9611 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.560420:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127009.560436:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991842688:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.560441:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10376 00000100:00100000:2.0:1746127009.560845:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991842944 00000100:00100000:2.0:1746127009.560849:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991842944 00002000:00100000:2.0:1746127009.560871:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012ced5f80 x1830945991842944/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.560879:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5f80 with x1830945991842944 ext(2097152->4194303) 00010000:00010000:2.0:1746127009.560884:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 48 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.560894:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 48 pid: 11152 timeout: 1004 lvb_type: 1 00002000:00010000:2.0:1746127009.560899:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ced5f80 00000100:00100000:2.0:1746127009.560911:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1967 00000100:00100000:2.0:1746127009.560916:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2028:x1830945991842944:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.562699:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:0.0:1746127009.564640:0:9612:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127007 -> 1746127008 00002000:00010000:0.0:1746127009.564647:0:9612:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127007 -> 1746127008 00002000:00010000:0.0:1746127009.564649:0:9612:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127007 -> 1746127008 00000100:00100000:0.0:1746127009.564669:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994326912:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127009.564702:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c644c00/0x34dc807b6efaec5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c51 expref: 27 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.564714:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c644c00/0x34dc807b6efaec5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c51 expref: 27 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.564725:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644c00, rc 0) 00000100:00100000:0.0:1746127009.564768:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991843072:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4564us (4744us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127009.564776:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22039 00000100:00100000:0.0:1746127009.564851:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994326784:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127009.564864:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.564875:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991843456 00000100:00100000:0.0:1746127009.564880:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991842304:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7127us (7881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.564882:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991843456 00000100:00100000:0.0:1746127009.564890:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10374 00002000:00100000:2.0:1746127009.564914:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1236992->1241087) req@ffff88012d3fea00 x1830945991843456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.564923:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fea00 with x1830945991843456 ext(1236992->1241087) 00002000:00010000:2.0:1746127009.564927:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fea00 00000100:00100000:2.0:1746127009.564949:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8846 00000100:00100000:2.0:1746127009.564957:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991843456:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127009.565070:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991843456:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 114us (2378us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127009.565076:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8846 00002000:00100000:2.0:1746127009.565081:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1236992->1241087) req@ffff88012d3fea00 x1830945991843456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.565088:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fea00 with x1830945991843456 ext(1236992->1241087) 00002000:00010000:2.0:1746127009.565090:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fea00 00000100:00100000:0.0:1746127009.574338:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.574816:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991843584 00000100:00100000:2.0:1746127009.574826:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991843584 00000100:00100000:2.0:1746127009.574883:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22040 00000100:00100000:2.0:1746127009.574890:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991843584:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.574908:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.574927:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c644000/0x34dc807b6efaecc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c5f expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.574952:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.574963:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c644000/0x34dc807b6efaecc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c5f expref: 26 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.574973:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c644000/0x34dc807b6efaecc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c5f expref: 26 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.574987:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644000, rc 0) 00000100:00100000:1.0:1746127009.575059:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991842560:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15528us (15867us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127009.575068:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8845 00002000:00100000:1.0:1746127009.575078:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012d3fe680 x1830945991842560/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.575089:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe680 with x1830945991842560 ext(2097152->4194303) 00002000:00010000:1.0:1746127009.575094:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fe680 00000100:00100000:2.0:1746127009.575174:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991843584:12345-192.168.203.42@tcp:101:cat.0 Request processed in 284us (847us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127009.575181:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22040 00000100:00100000:0.0:1746127009.582545:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.582929:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991843712 00000100:00100000:2.0:1746127009.582939:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991843712 00000100:00100000:2.0:1746127009.582993:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22041 00000100:00100000:2.0:1746127009.583002:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4532:x1830945991843712:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.583033:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.583051:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c66 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.583076:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.583082:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2469888->3145727] (req 2469888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 51 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.583088:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127009.583091:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 51 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.583153:0:9612:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2469888->3145727] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 51 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.583166:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 51 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.583176:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644800, rc 0) 00000100:00100000:2.0:1746127009.583226:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4532:x1830945991843712:12345-192.168.203.42@tcp:101:cat.0 Request processed in 226us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.583231:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22041 00000100:00100000:2.0:1746127009.586229:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2028:x1830945991842944:12345-192.168.203.42@tcp:3:cat.0 Request processed in 25302us (26276us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127009.586241:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1967 00002000:00100000:2.0:1746127009.586253:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012ced5f80 x1830945991842944/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.586667:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5f80 with x1830945991842944 ext(2097152->4194303) 00010000:00010000:2.0:1746127009.586678:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.586693:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 1004 lvb_type: 1 00002000:00010000:2.0:1746127009.586701:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ced5f80 00000100:00100000:0.0:1746127009.590804:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.590945:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991843968 00000100:00100000:2.0:1746127009.590953:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991843968 00002000:00100000:2.0:1746127009.591002:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1445888->1449983) req@ffff88012d3fca80 x1830945991843968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.591021:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fca80 with x1830945991843968 ext(1445888->1449983) 00002000:00010000:2.0:1746127009.591026:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fca80 00000100:00100000:2.0:1746127009.591062:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8847 00000100:00100000:2.0:1746127009.591069:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991843968:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.591245:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991843968:12345-192.168.203.42@tcp:3:cat.0 Request processed in 176us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127009.591252:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8847 00002000:00100000:2.0:1746127009.591257:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x9f:0x0] (1445888->1449983) req@ffff88012d3fca80 x1830945991843968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.591265:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fca80 with x1830945991843968 ext(1445888->1449983) 00002000:00010000:2.0:1746127009.591267:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fca80 00000100:00100000:0.0:1746127009.593504:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.593588:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991844096 00000100:00100000:2.0:1746127009.593595:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991844096 00010000:00010000:2.0:1746127009.593625:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.594221:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10377 00000100:00100000:3.0:1746127009.594230:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2027:x1830945991844096:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127009.594241:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127009.594261:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.594272:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.594294:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911de600/0x34dc807b6efad4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b9b expref: 49 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746127009.594319:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.594321:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.594328:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.594335:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.594366:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.594375:0:26073:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.594385:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994327168:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127009.594474:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.595747:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:26073:1830945994327168:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127009.595764:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127009.595802:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991844096:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1573us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.595810:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10377 00000100:00100000:0.0:1746127009.596681:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.596752:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991844352 00000100:00100000:1.0:1746127009.596759:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991844352 00002000:00100000:1.0:1746127009.596796:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2469888->2473983) req@ffff88012d3fc700 x1830945991844352/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.596806:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fc700 with x1830945991844352 ext(2469888->2473983) 00010000:00010000:1.0:1746127009.596814:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.596827:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:1.0:1746127009.596834:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3fc700 00000100:00100000:1.0:1746127009.597277:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1968 00000100:00100000:1.0:1746127009.597285:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991844352:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.597412:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991844352:12345-192.168.203.42@tcp:3:cat.0 Request processed in 128us (733us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127009.597417:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1968 00002000:00100000:1.0:1746127009.597421:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2469888->2473983) req@ffff88012d3fc700 x1830945991844352/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127009.597428:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fc700 with x1830945991844352 ext(2469888->2473983) 00010000:00010000:1.0:1746127009.597433:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746127009.597442:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:1.0:1746127009.597448:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3fc700 00000100:00100000:0.0:1746127009.607497:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.608469:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.608529:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991844736 00000100:00100000:2.0:1746127009.608536:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991844608 00000100:00100000:3.0:1746127009.608538:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991844736 00000100:00100000:2.0:1746127009.608540:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991844608 00002000:00100000:3.0:1746127009.608580:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2469888->3145727) req@ffff88011dc60e00 x1830945991844736/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127009.608585:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22042 00002000:00100000:3.0:1746127009.608589:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60e00 with x1830945991844736 ext(2469888->3145727) 00000100:00100000:2.0:1746127009.608592:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4523:x1830945991844608:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127009.608597:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.608605:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.608609:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 48 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.608618:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011dc60e00 00010000:00010000:2.0:1746127009.608619:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c6d expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.608645:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 44 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.608653:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.608659:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 25 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.608665:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.608667:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.608670:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 44 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.608701:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 25 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.608711:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 25 pid: 12333 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.608723:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994327296:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.608800:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 13 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.608808:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.608815:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994327424:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.608841:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 44 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.608848:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 44 pid: 3542 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.608855:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994327552:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.608869:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.608895:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1969 00000100:00100000:3.0:1746127009.608901:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991844736:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127009.613708:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994327296:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.613794:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994327424:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.613796:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.613802:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994327552:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127009.613834:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 44 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.613847:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127009.613853:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3b600, rc 0) 00000100:00100000:1.0:1746127009.613879:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991844992 00000100:00100000:1.0:1746127009.613885:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991844992 00000100:00100000:2.0:1746127009.613895:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4523:x1830945991844608:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5304us (6410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.613903:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22042 00010000:00010000:1.0:1746127009.613913:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 45 pid: 3542 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.613931:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991844864 00000100:00100000:1.0:1746127009.613933:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991844864 00000100:00100000:2.0:1746127009.613937:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10378 00010000:00010000:1.0:1746127009.613941:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.613943:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991844992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127009.613954:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10379 00010000:00010000:2.0:1746127009.613955:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127009.613957:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991844864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.613963:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.613973:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 44 pid: 3542 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.613973:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.613982:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 44 pid: 3542 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.614805:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.614827:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d400/0x34dc807b6efadb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be8 expref: 14 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.614841:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.614860:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991844864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 901us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.614865:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10379 00010000:00010000:2.0:1746127009.614931:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f45a00/0x34dc807b6efad59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b94 expref: 44 pid: 3542 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.614947:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.614968:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991844992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1025us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.614975:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10378 00000100:00100000:0.0:1746127009.615306:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.615366:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991845120 00000100:00100000:2.0:1746127009.615371:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991845120 00010000:00010000:2.0:1746127009.615386:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 26 pid: 12333 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.616462:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10380 00000100:00100000:1.0:1746127009.616471:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991845120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.616490:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127009.616508:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 26 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.616518:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 26 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.616534:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6ce00/0x34dc807b6efad6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb7 expref: 26 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.616544:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.616546:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.616553:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.616561:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.616593:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.616604:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994327680:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127009.616707:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.618062:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994327680:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127009.618081:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127009.618122:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991845120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1653us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.618145:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10380 00000100:00100000:2.0:1746127009.619080:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991844736:12345-192.168.203.42@tcp:4:cat.0 Request processed in 10174us (10607us total) trans 17179875664 rc 0/0 00000100:00100000:2.0:1746127009.619090:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1969 00002000:00100000:2.0:1746127009.619101:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2469888->3145727) req@ffff88011dc60e00 x1830945991844736/t17179875664(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.619118:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60e00 with x1830945991844736 ext(2469888->3145727) 00010000:00010000:2.0:1746127009.619127:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 50 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.619162:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 50 pid: 3148 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746127009.619169:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011dc60e00 00000001:00080000:0.0:1746127009.620511:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875664 is committed 00000001:00080000:0.0:1746127009.620522:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875663 is committed 00000001:00080000:0.0:1746127009.620537:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875655 is committed 00000001:00080000:0.0:1746127009.620558:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875642 is committed 00000100:00100000:1.0:1746127009.620845:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.620911:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.620974:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991845376 00000100:00100000:2.0:1746127009.620982:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991845376 00002000:00100000:2.0:1746127009.621030:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (3448832->3452927) req@ffff88008c5bea00 x1830945991845376/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.621039:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bea00 with x1830945991845376 ext(3448832->3452927) 00002000:00010000:2.0:1746127009.621044:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bea00 00000100:00100000:2.0:1746127009.621061:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8848 00000100:00100000:2.0:1746127009.621068:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991845376:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.621218:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991845504 00000100:00100000:0.0:1746127009.621222:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991845504 00000100:00100000:2.0:1746127009.621233:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991845376:12345-192.168.203.42@tcp:3:cat.0 Request processed in 165us (389us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1746127009.621238:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 28 pid: 3148 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.621239:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8848 00002000:00100000:2.0:1746127009.621244:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (3448832->3452927) req@ffff88008c5bea00 x1830945991845376/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.621251:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bea00 with x1830945991845376 ext(3448832->3452927) 00002000:00010000:2.0:1746127009.621254:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bea00 00000100:00100000:0.0:1746127009.621268:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10381 00000100:00100000:0.0:1746127009.621273:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991845504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127009.621283:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746127009.621295:0:10641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127007 -> 1746127008 00002000:00010000:0.0:1746127009.621298:0:10641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127007 -> 1746127008 00010000:00010000:0.0:1746127009.621302:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 28 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.621316:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 28 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.621338:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97c00/0x34dc807b6efaeb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c3c expref: 28 pid: 3148 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.621468:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.621471:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.621478:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.621487:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.621651:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.621663:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994327808:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127009.621948:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.622851:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994327808:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127009.622869:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127009.623001:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991845504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1726us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.623020:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10381 00000100:00100000:0.0:1746127009.624648:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.624717:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991845760 00000100:00100000:2.0:1746127009.624726:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991845760 00002000:00100000:2.0:1746127009.624765:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012d288000 x1830945991845760/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.624774:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288000 with x1830945991845760 ext(2097152->3145727) 00002000:00010000:2.0:1746127009.624779:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288000 00000100:00100000:2.0:1746127009.624805:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8849 00000100:00100000:2.0:1746127009.624811:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991845760:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.625952:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.626060:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991846016 00000100:00100000:2.0:1746127009.626066:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991846016 00000100:00100000:2.0:1746127009.626112:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6642 00000100:00100000:2.0:1746127009.626119:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4523:x1830945991846016:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127009.626371:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4523:x1830945991846016:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 251us (424us total) trans 8589938333 rc 0/0 00000100:00100000:2.0:1746127009.626379:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6642 00000100:00100000:2.0:1746127009.631338:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991845760:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6516us (6686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127009.631350:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8849 00002000:00100000:2.0:1746127009.631361:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff88012d288000 x1830945991845760/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.631370:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d288000 with x1830945991845760 ext(2097152->3145727) 00002000:00010000:2.0:1746127009.631376:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d288000 00000100:00100000:0.0:1746127009.637445:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.639461:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991846272 00000100:00100000:0.0:1746127009.639466:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.639472:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991846272 00002000:00100000:2.0:1746127009.639623:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (3452928->4194303) req@ffff88012d28ad80 x1830945991846272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.639639:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28ad80 with x1830945991846272 ext(3452928->4194303) 00002000:00010000:2.0:1746127009.639644:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d28ad80 00000100:00100000:2.0:1746127009.639663:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991846528 00000100:00100000:2.0:1746127009.639665:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991846528 00002000:00100000:2.0:1746127009.639678:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88012d28b480 x1830945991846528/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.639684:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28b480 with x1830945991846528 ext(3145728->4194303) 00002000:00010000:2.0:1746127009.639686:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d28b480 00000100:00100000:2.0:1746127009.639712:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8850 00000100:00100000:2.0:1746127009.639718:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991846272:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.639927:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8851 00000100:00100000:0.0:1746127009.639934:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991846528:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.648198:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991846272:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8466us (10750us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746127009.648211:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8850 00002000:00100000:2.0:1746127009.648228:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (3452928->4194303) req@ffff88012d28ad80 x1830945991846272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.648238:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28ad80 with x1830945991846272 ext(3452928->4194303) 00002000:00010000:2.0:1746127009.648243:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d28ad80 00000100:00100000:3.0:1746127009.649153:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991846528:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9217us (9689us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.649162:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8851 00002000:00100000:3.0:1746127009.649167:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->4194303) req@ffff88012d28b480 x1830945991846528/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.649174:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d28b480 with x1830945991846528 ext(3145728->4194303) 00002000:00010000:3.0:1746127009.649178:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d28b480 00000100:00100000:0.0:1746127009.651856:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.651925:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991846656 00000100:00100000:2.0:1746127009.651933:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991846656 00000100:00100000:2.0:1746127009.651976:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22043 00000100:00100000:2.0:1746127009.651984:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991846656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.652001:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.652031:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efaee1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c74 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.652083:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994327936:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127009.652189:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.653037:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994327936:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127009.653058:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efaee1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c74 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.653067:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db3aa00/0x34dc807b6efaee1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c74 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.653083:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3aa00, rc 0) 00000100:00100000:2.0:1746127009.653118:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991846656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1134us (1269us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127009.653124:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22043 00000100:00100000:0.0:1746127009.655574:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.655665:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991846912 00000100:00100000:3.0:1746127009.655673:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991846912 00002000:00100000:3.0:1746127009.655718:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012d289180 x1830945991846912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.655728:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d289180 with x1830945991846912 ext(4194304->4829183) 00002000:00010000:3.0:1746127009.655733:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d289180 00000100:00100000:3.0:1746127009.655766:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8852 00000100:00100000:3.0:1746127009.655772:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991846912:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127009.663928:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991846912:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8141us (8347us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127009.663941:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8852 00002000:00100000:3.0:1746127009.663954:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012d289180 x1830945991846912/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.663964:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d289180 with x1830945991846912 ext(4194304->4829183) 00002000:00010000:3.0:1746127009.663971:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d289180 00000100:00100000:0.0:1746127009.666361:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.666744:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991847040 00000100:00100000:2.0:1746127009.666753:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991847040 00000100:00100000:2.0:1746127009.666807:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22044 00000100:00100000:2.0:1746127009.666816:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991847040:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.666832:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.666850:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db3b800/0x34dc807b6efaee8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c7b expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.666902:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994328064:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127009.666993:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.670284:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994328064:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127009.670325:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db3b800/0x34dc807b6efaee8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c7b expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.670339:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db3b800/0x34dc807b6efaee8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c7b expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.670370:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3b800, rc 0) 00000100:00100000:2.0:1746127009.670421:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991847040:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3606us (4068us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127009.671120:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22044 00000100:00100000:0.0:1746127009.672845:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.672954:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991847168 00000100:00100000:2.0:1746127009.672962:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991847168 00000100:00100000:2.0:1746127009.673017:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22045 00000100:00100000:2.0:1746127009.673025:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991847168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.673042:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.673061:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db3a400/0x34dc807b6efaeef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c82 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.673113:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994328192:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127009.673238:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.675628:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994328192:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127009.675660:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db3a400/0x34dc807b6efaeef lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c82 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.675674:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db3a400/0x34dc807b6efaeef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c82 expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.675749:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3a400, rc 0) 00000100:00100000:2.0:1746127009.675789:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991847168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2764us (2949us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127009.675798:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22045 00000100:00100000:0.0:1746127009.719713:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.720826:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991847424 00000100:00100000:2.0:1746127009.720837:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991847424 00000100:00100000:2.0:1746127009.721388:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17372 00000100:00100000:2.0:1746127009.721397:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4540:x1830945991847424:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127009.721424:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.721443:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a000/0x34dc807b6efaef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c89 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.721522:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721535:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721547:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721558:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721564:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721569:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721671:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721679:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721684:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127009.721693:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127009.721757:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721763:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721768:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721772:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009db3aa00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.721775:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721780:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721788:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127009.721791:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.721794:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721798:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3aa00/0x34dc807b6efaefd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721826:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721830:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721834:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721838:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009db3a400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.721839:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721843:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721847:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58af00) 00010000:00010000:2.0:1746127009.721849:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.721851:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721854:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a400/0x34dc807b6efaf04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.721883:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3a000/0x34dc807b6efaef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 17 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.721891:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 16 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.721897:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.721900:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127009.721901:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3b800, rc 0) 00000100:00100000:2.0:1746127009.721957:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4540:x1830945991847424:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 562us (2256us total) trans 8589938334 rc 0/0 00000100:00100000:2.0:1746127009.721963:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17372 00000100:00100000:0.0:1746127009.723412:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.724365:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991847680 00000100:00100000:3.0:1746127009.724374:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991847680 00000100:00100000:3.0:1746127009.724416:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6643 00000100:00100000:3.0:1746127009.724422:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4540:x1830945991847680:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127009.724589:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4540:x1830945991847680:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 166us (1182us total) trans 8589938335 rc 0/0 00000100:00100000:3.0:1746127009.724595:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6643 00000100:00100000:0.0:1746127009.813432:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.813612:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991847936 00000100:00100000:3.0:1746127009.813621:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991847936 00000100:00100000:3.0:1746127009.813669:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17373 00000100:00100000:3.0:1746127009.813676:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4543:x1830945991847936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.813700:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.813720:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9600/0x34dc807b6efaf19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c90 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.813795:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813809:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813819:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813831:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813836:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813840:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813940:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e8a00/0x34dc807b6efaf2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813949:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e8a00/0x34dc807b6efaf2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.813955:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e8a00/0x34dc807b6efaf2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:3.0:1746127009.813964:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127009.814045:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814051:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814057:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814063:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814069:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e9a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127009.814073:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814079:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814089:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127009.814092:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127009.814096:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814101:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9a00/0x34dc807b6efaf20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814115:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814120:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814125:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814156:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e9200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127009.814158:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814167:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814173:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cec5100) 00010000:00010000:3.0:1746127009.814175:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127009.814177:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814182:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9200/0x34dc807b6efaf27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:3.0:1746127009.814217:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9600/0x34dc807b6efaf19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c90 expref: 20 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.814226:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e8a00/0x34dc807b6efaf2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c90 expref: 19 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.814232:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.814233:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127009.814236:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e8a00, rc 0) 00000100:00100000:3.0:1746127009.814299:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4543:x1830945991847936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 623us (876us total) trans 8589938336 rc 0/0 00000100:00100000:3.0:1746127009.814305:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17373 00000100:00100000:0.0:1746127009.816327:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.816401:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991848192 00000100:00100000:2.0:1746127009.816410:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991848192 00000100:00100000:2.0:1746127009.816460:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6644 00000100:00100000:2.0:1746127009.816469:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4543:x1830945991848192:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127009.816648:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4543:x1830945991848192:12345-192.168.203.42@tcp:35:cat.0 Request processed in 180us (330us total) trans 8589938337 rc 0/0 00000100:00100000:2.0:1746127009.816655:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6644 00000100:00100000:0.0:1746127009.817464:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.817521:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991848320 00000100:00100000:3.0:1746127009.817525:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991848320 00000100:00100000:3.0:1746127009.817555:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1035 00000100:00100000:3.0:1746127009.817561:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991848320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127009.817570:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127009.817596:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e8a00/0x34dc807b6efaf2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c90 expref: 20 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.817610:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.817615:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127009.817650:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991848320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.817655:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1035 00000100:00100000:0.0:1746127009.819316:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.819359:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.819426:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991848448 00000100:00100000:1.0:1746127009.819432:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991848448 00000100:00100000:1.0:1746127009.819475:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991848576 00000100:00100000:1.0:1746127009.819477:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991848576 00000100:00100000:1.0:1746127009.819492:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22046 00000100:00100000:1.0:1746127009.819497:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991848448:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127009.819513:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.819529:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efaf3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c97 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.819578:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994328320:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127009.819654:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22047 00000100:00100000:3.0:1746127009.819661:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991848576:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.819668:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.819678:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53c9e expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.819689:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.819691:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.819699:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.819712:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 8 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.819721:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9800, rc 0) 00000100:00100000:3.0:1746127009.819792:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991848576:12345-192.168.203.42@tcp:101:cat.0 Request processed in 132us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.819797:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22047 00000100:00100000:1.0:1746127009.820043:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00002000:00010000:1.0:1746127009.823974:0:9613:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127007 -> 1746127008 00002000:00010000:1.0:1746127009.823983:0:9613:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127007 -> 1746127008 00002000:00010000:1.0:1746127009.823985:0:9613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127007 -> 1746127008 00000100:00100000:1.0:1746127009.824019:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994328320:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127009.824053:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efaf3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c97 expref: 26 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.824066:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efaf3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c97 expref: 26 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.824093:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6c00, rc 0) 00000100:00100000:1.0:1746127009.824252:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991848448:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4753us (4939us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127009.824262:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22046 00000100:00100000:0.0:1746127009.833545:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.833602:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.833694:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991848960 00000100:00100000:3.0:1746127009.833704:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991848960 00002000:00100000:3.0:1746127009.833752:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009942d880 x1830945991848960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.833763:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d880 with x1830945991848960 ext(0->1048575) 00002000:00010000:3.0:1746127009.833768:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942d880 00000100:00100000:3.0:1746127009.833787:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991849088 00000100:00100000:3.0:1746127009.833789:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991849088 00002000:00100000:3.0:1746127009.833801:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009942c380 x1830945991849088/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 504/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.833808:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c380 with x1830945991849088 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.833811:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c380 00000100:00100000:3.0:1746127009.833837:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8853 00000100:00100000:3.0:1746127009.833844:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991848960:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127009.835663:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8854 00000100:00100000:1.0:1746127009.835678:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991849088:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.850227:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.853074:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991849344 00000100:00100000:2.0:1746127009.853090:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991849344 00000100:00100000:2.0:1746127009.853740:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17374 00000100:00100000:2.0:1746127009.853752:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4545:x1830945991849344:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127009.853779:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.853799:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97a00/0x34dc807b6efaf4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ca5 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.853881:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.853898:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.853909:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.853924:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.853929:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.853933:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854039:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854049:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854055:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127009.854063:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127009.854147:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854155:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854160:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854166:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e96a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.854170:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854175:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854186:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127009.854189:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.854193:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.854198:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96a00/0x34dc807b6efaf51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855577:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855587:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855592:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855597:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e96800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127009.855600:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855605:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855615:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58aa00) 00010000:00010000:2.0:1746127009.855616:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127009.855618:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855622:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96800/0x34dc807b6efaf58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127009.855665:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97a00/0x34dc807b6efaf4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 33 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.855679:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.855685:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.855687:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127009.855689:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e97000, rc 0) 00000100:00100000:2.0:1746127009.856812:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4545:x1830945991849344:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3056us (6589us total) trans 8589938338 rc 0/0 00000100:00100000:2.0:1746127009.856822:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17374 00000100:00100000:3.0:1746127009.857292:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2027:x1830945991848960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23446us (23756us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.857304:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8853 00002000:00100000:3.0:1746127009.857313:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009942d880 x1830945991848960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.857322:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d880 with x1830945991848960 ext(0->1048575) 00002000:00010000:3.0:1746127009.857327:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942d880 00000100:00100000:3.0:1746127009.857389:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991849088:12345-192.168.203.42@tcp:3:cat.0 Request processed in 21716us (23786us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746127009.857394:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8854 00002000:00100000:3.0:1746127009.857399:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009942c380 x1830945991849088/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 504/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.857411:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c380 with x1830945991849088 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.857414:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c380 00000100:00100000:0.0:1746127009.878429:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.878729:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991849472 00000100:00100000:1.0:1746127009.878738:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991849472 00000100:00100000:1.0:1746127009.878801:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22048 00000100:00100000:1.0:1746127009.878810:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4543:x1830945991849472:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127009.878827:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.878846:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cac expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.878876:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.878883:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127009.878885:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127009.878889:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 26 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.878919:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 42 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.878935:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 42 pid: 9612 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.878945:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994328448:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.879054:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.882408:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994328448:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.882440:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 26 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.882457:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158e00, rc 0) 00000100:00100000:1.0:1746127009.882518:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4543:x1830945991849472:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3707us (4095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.882527:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22048 00000100:00100000:0.0:1746127009.882592:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.882980:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991849600 00000100:00100000:2.0:1746127009.882989:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991849600 00002000:00100000:2.0:1746127009.883045:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3452927) req@ffff8800a1789500 x1830945991849600/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.883054:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789500 with x1830945991849600 ext(3145728->3452927) 00010000:00010000:2.0:1746127009.883061:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 43 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.883074:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 43 pid: 9612 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746127009.883080:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a1789500 00000100:00100000:2.0:1746127009.883101:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1970 00000100:00100000:2.0:1746127009.883110:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991849600:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127009.888872:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991849600:12345-192.168.203.42@tcp:4:cat.0 Request processed in 5754us (6271us total) trans 21474842938 rc 0/0 00000100:00100000:0.0:1746127009.888885:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1970 00002000:00100000:0.0:1746127009.888897:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3452927) req@ffff8800a1789500 x1830945991849600/t21474842938(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.888906:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1789500 with x1830945991849600 ext(3145728->3452927) 00010000:00010000:0.0:1746127009.888916:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 45 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.888931:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 45 pid: 9612 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746127009.888938:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a1789500 00000100:00100000:0.0:1746127009.893961:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.894079:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991849728 00000100:00100000:2.0:1746127009.894089:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991849728 00010000:00010000:2.0:1746127009.894163:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 45 pid: 9612 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.894200:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10382 00000100:00100000:2.0:1746127009.894207:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991849728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.894220:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.894241:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 45 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.894253:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 45 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.894273:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efaeda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c6d expref: 45 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.894303:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.894305:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.894315:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.894324:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.894356:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 25 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.894372:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994328576:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127009.894465:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.896541:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994328576:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127009.896553:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127009.896562:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.896595:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991849728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2387us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.896604:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10382 00000100:00100000:1.0:1746127009.896621:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991849856 00000100:00100000:1.0:1746127009.896626:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991849856 00000100:00100000:1.0:1746127009.896661:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22049 00000100:00100000:1.0:1746127009.896671:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4545:x1830945991849856:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127009.896687:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.896702:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cb3 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.896726:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 7 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.896962:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127009.896965:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127009.896969:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 28 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.896992:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 7 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.897002:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 7 pid: 9612 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746127009.897021:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994328704:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.897445:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.899551:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.899753:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991850112 00000100:00100000:3.0:1746127009.899760:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991850112 00000100:00100000:3.0:1746127009.899802:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17375 00000100:00100000:3.0:1746127009.899809:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4548:x1830945991850112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.899831:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.899850:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6efaf7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cba expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.899918:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.899930:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.899942:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.899954:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.899960:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.899965:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127009.900071:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994328704:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.900094:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 28 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.900108:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159c00, rc 0) 00000100:00100000:1.0:1746127009.900185:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4545:x1830945991849856:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3517us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.900193:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22049 00000100:00100000:0.0:1746127009.900315:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.900339:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991850240 00000100:00100000:0.0:1746127009.900342:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991850240 00002000:00100000:0.0:1746127009.900366:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1236992->1449983) req@ffff8800a2fdad80 x1830945991850240/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.900375:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdad80 with x1830945991850240 ext(1236992->1449983) 00010000:00010000:0.0:1746127009.900383:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 8 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.900395:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 8 pid: 9612 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746127009.900401:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2fdad80 00000100:00100000:2.0:1746127009.900438:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1971 00000100:00100000:2.0:1746127009.900446:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2028:x1830945991850240:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:3.0:1746127009.900722:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6efaf90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900736:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6efaf90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900742:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6efaf90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127009.900751:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127009.900815:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900821:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900827:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900832:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bc6600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127009.900836:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900842:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900851:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127009.900853:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127009.900857:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900861:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6600/0x34dc807b6efaf82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900888:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900896:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900900:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900904:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bc7c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127009.900906:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900910:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900915:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cec5d00) 00010000:00010000:3.0:1746127009.900917:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127009.900919:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900922:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7c00/0x34dc807b6efaf89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.900956:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc6200/0x34dc807b6efaf7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cba expref: 35 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.900963:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6efaf90 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cba expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.900969:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127009.900970:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127009.900972:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bc7400, rc 0) 00000100:00100000:3.0:1746127009.900994:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4548:x1830945991850112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1186us (1451us total) trans 8589938339 rc 0/0 00000100:00100000:3.0:1746127009.901000:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17375 00000100:00100000:2.0:1746127009.903540:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991850240:12345-192.168.203.42@tcp:4:cat.0 Request processed in 3086us (3216us total) trans 17179875665 rc 0/0 00000100:00100000:2.0:1746127009.903551:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1971 00002000:00100000:2.0:1746127009.903562:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1236992->1449983) req@ffff8800a2fdad80 x1830945991850240/t17179875665(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.903570:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdad80 with x1830945991850240 ext(1236992->1449983) 00010000:00010000:2.0:1746127009.903579:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 10 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.903593:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 10 pid: 9612 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746127009.903599:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2fdad80 00000100:00100000:0.0:1746127009.903960:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.904002:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.904053:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991850368 00000100:00100000:2.0:1746127009.904060:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991850368 00000100:00100000:2.0:1746127009.904110:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1036 00000100:00100000:2.0:1746127009.904116:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991850368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.904150:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.904173:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bc7400/0x34dc807b6efaf90 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cba expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.904190:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127009.904195:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.904227:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991850368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.904234:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1036 00000100:00100000:3.0:1746127009.904794:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991850624 00000100:00100000:3.0:1746127009.904799:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991850624 00000100:00100000:3.0:1746127009.904885:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6645 00000100:00100000:3.0:1746127009.904890:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4548:x1830945991850624:12345-192.168.203.42@tcp:35:cat.0 00010000:00010000:2.0:1746127009.905506:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127009.905569:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.905604:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.905628:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991850880 00000100:00100000:0.0:1746127009.905631:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991850880 00000100:00100000:3.0:1746127009.905649:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4548:x1830945991850624:12345-192.168.203.42@tcp:35:cat.0 Request processed in 758us (1689us total) trans 8589938340 rc 0/0 00000100:00100000:3.0:1746127009.905655:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6645 00002000:00100000:0.0:1746127009.905656:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880093641180 x1830945991850880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.905664:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093641180 with x1830945991850880 ext(2097152->4194303) 00002000:00010000:0.0:1746127009.905669:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093641180 00000100:00100000:0.0:1746127009.905682:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991851136 00000100:00100000:0.0:1746127009.905685:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991851136 00002000:00100000:0.0:1746127009.905697:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880093640380 x1830945991851136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.905703:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093640380 with x1830945991851136 ext(2097152->4194303) 00002000:00010000:0.0:1746127009.905706:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093640380 00000100:00100000:0.0:1746127009.905715:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8855 00000100:00100000:0.0:1746127009.905720:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991850880:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.905842:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8856 00000100:00100000:2.0:1746127009.905849:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991851136:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.910219:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.910323:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.910391:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991851264 00000100:00100000:1.0:1746127009.910399:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991851264 00000100:00100000:1.0:1746127009.910444:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991851392 00000100:00100000:1.0:1746127009.910446:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991851392 00000100:00100000:3.0:1746127009.910469:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22050 00000100:00100000:1.0:1746127009.910476:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22051 00000100:00100000:3.0:1746127009.910481:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991851264:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127009.910484:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991851392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.910498:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.910499:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.910513:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cc8 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.910514:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efafa5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cc1 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.910572:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994328832:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127009.910944:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.910947:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127009.910959:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 45 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.910973:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 45 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.910983:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159400, rc 0) 00000100:00100000:1.0:1746127009.911030:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991851392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 546us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.911036:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22051 00000100:00100000:3.0:1746127009.911096:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.912544:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.912604:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991851520 00000100:00100000:2.0:1746127009.912613:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991851520 00010000:00010000:2.0:1746127009.912645:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 12 pid: 9612 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.912675:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10383 00000100:00100000:2.0:1746127009.912683:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991851520:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.912693:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.912711:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 12 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.912720:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 12 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746127009.912741:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.912743:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.912747:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.912752:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.912774:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.912780:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994328960:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127009.913355:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4600 going to sleep for 11 seconds 00010000:00010000:3.0:1746127009.913819:0:11152:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff88012ced7800 x1830945994328832) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 12 pid: 9612 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.913838:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a02e00/0x34dc807b6efaeb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1449983) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c4a expref: 12 pid: 9612 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746127009.913849:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994328832:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127009.913874:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efafa5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc1 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.913884:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efafa5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc1 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.913890:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505c00, rc 0) 00000100:00100000:3.0:1746127009.913927:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991851264:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3449us (3715us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127009.913933:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22050 00000100:00100000:0.0:1746127009.918158:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.918235:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.918262:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991851904 00000100:00100000:0.0:1746127009.918272:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991851904 00002000:00100000:0.0:1746127009.918315:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1654784->1658879) req@ffff8800a7c50000 x1830945991851904/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.918326:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50000 with x1830945991851904 ext(1654784->1658879) 00002000:00010000:0.0:1746127009.918333:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c50000 00000100:00100000:0.0:1746127009.918352:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8857 00000100:00100000:0.0:1746127009.918359:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991851904:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127009.918495:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2028:x1830945991851904:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 136us (259us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127009.918501:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8857 00002000:00100000:0.0:1746127009.918506:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1654784->1658879) req@ffff8800a7c50000 x1830945991851904/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.918513:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50000 with x1830945991851904 ext(1654784->1658879) 00002000:00010000:0.0:1746127009.918516:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c50000 00000100:00100000:2.0:1746127009.918742:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994328960:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127009.918764:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.918787:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991851520:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6104us (6244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.918796:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10383 00000100:00100000:3.0:1746127009.919533:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991851648 00000100:00100000:3.0:1746127009.919539:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991851648 00000100:00100000:3.0:1746127009.919569:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22052 00000100:00100000:3.0:1746127009.919575:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+28:4540:x1830945991851648:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127009.919586:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.919603:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ccf expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.919628:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 44 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.919636:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.919643:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 29 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.919649:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.919651:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.919655:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1515520->2097151] (req 1515520->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 29 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.919682:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 29 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.919694:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 29 pid: 12333 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.919705:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994329088:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.919762:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.919770:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 12 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.919778:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994329216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.919803:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 44 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.919854:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 44 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.919863:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994329344:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.919882:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.924490:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.925615:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991850880:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19890us (20044us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746127009.925627:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8855 00002000:00100000:0.0:1746127009.925639:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880093641180 x1830945991850880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.925648:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093641180 with x1830945991850880 ext(2097152->4194303) 00002000:00010000:0.0:1746127009.925654:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093641180 00000100:00100000:0.0:1746127009.925676:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991852160 00000100:00100000:0.0:1746127009.925682:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991852160 00002000:00100000:0.0:1746127009.925709:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a7c52680 x1830945991852160/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 504/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.925716:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52680 with x1830945991852160 ext(1048576->2097151) 00002000:00010000:0.0:1746127009.925719:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c52680 00000100:00100000:0.0:1746127009.925732:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8858 00000100:00100000:0.0:1746127009.925738:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991852160:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127009.926176:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991851136:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20327us (20569us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127009.926184:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8856 00002000:00100000:3.0:1746127009.926190:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880093640380 x1830945991851136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.926197:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093640380 with x1830945991851136 ext(2097152->4194303) 00002000:00010000:3.0:1746127009.926200:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093640380 00000100:00100000:2.0:1746127009.928177:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.928201:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991852416 00000100:00100000:2.0:1746127009.928208:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991852416 00010000:00010000:2.0:1746127009.928239:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 28 pid: 12333 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.928280:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10384 00000100:00100000:2.0:1746127009.928287:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991852416:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.928301:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.928320:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 28 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.928332:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 28 pid: 12333 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.928357:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.928392:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991852416:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.928398:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10384 00000100:00100000:2.0:1746127009.928429:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.928440:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991852544 00000100:00100000:2.0:1746127009.928443:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991852544 00010000:00010000:2.0:1746127009.928454:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 45 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.928468:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10385 00000100:00100000:2.0:1746127009.928473:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991852544:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.928480:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.928486:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 45 pid: 9612 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.928493:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 45 pid: 9612 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.928504:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.928517:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991852544:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.928522:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10385 00000100:00100000:2.0:1746127009.928576:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.928588:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991852288 00000100:00100000:2.0:1746127009.928591:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991852288 00010000:00010000:2.0:1746127009.928601:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.928615:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10386 00000100:00100000:2.0:1746127009.928620:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991852288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.928626:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.928633:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.928641:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.928652:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.928654:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.928661:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.928669:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.928698:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.928714:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994329472:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127009.928769:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746127009.928895:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6de00/0x34dc807b6efad75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bb0 expref: 27 pid: 12333 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.928911:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994329088:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.928921:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbb6a00/0x34dc807b6efad98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53be1 expref: 13 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.928929:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994329216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.928937:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7000/0x34dc807b6efad44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b8d expref: 44 pid: 9612 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.928949:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994329344:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.928979:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 26 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.928988:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5400, rc 0) 00000100:00100000:3.0:1746127009.929025:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4540:x1830945991851648:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 9449us (10896us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.929035:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22052 00000100:00100000:2.0:1746127009.932851:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994329472:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127009.932878:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.933000:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991852288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4377us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.933024:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10386 00000100:00100000:0.0:1746127009.934669:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.934896:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991852800 00000100:00100000:3.0:1746127009.934929:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991852800 00000100:00100000:2.0:1746127009.935937:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991852160:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10194us (11452us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746127009.935947:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8858 00002000:00100000:2.0:1746127009.935959:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a7c52680 x1830945991852160/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 504/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.935968:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52680 with x1830945991852160 ext(1048576->2097151) 00002000:00010000:2.0:1746127009.935974:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c52680 00002000:00100000:3.0:1746127009.936102:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1515520->1519615) req@ffff880094e6e300 x1830945991852800/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.936518:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6e300 with x1830945991852800 ext(1515520->1519615) 00002000:00010000:3.0:1746127009.937220:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6e300 00000100:00100000:3.0:1746127009.937270:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8859 00000100:00100000:3.0:1746127009.937284:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991852800:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127009.937715:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991852800:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 436us (3049us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127009.937721:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8859 00002000:00100000:3.0:1746127009.937727:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1515520->1519615) req@ffff880094e6e300 x1830945991852800/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.937734:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6e300 with x1830945991852800 ext(1515520->1519615) 00002000:00010000:3.0:1746127009.937738:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6e300 00000100:00100000:0.0:1746127009.942321:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.942507:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991852928 00000100:00100000:0.0:1746127009.942508:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.942515:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991852928 00000100:00100000:3.0:1746127009.942564:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991853056 00000100:00100000:3.0:1746127009.942567:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991853056 00000100:00100000:1.0:1746127009.942574:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22053 00000100:00100000:1.0:1746127009.942585:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991852928:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:3.0:1746127009.942597:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22054 00000100:00100000:3.0:1746127009.942602:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4545:x1830945991853056:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127009.942603:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.942610:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.942619:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cdd expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.942619:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efafb3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cd6 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.942644:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.942652:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 7 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.942659:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.942665:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127009.942666:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746127009.942667:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994329600:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127009.942670:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 29 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.942689:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.942700:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 29 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.942709:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994329728:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.942716:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.942750:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991853184 00000100:00100000:1.0:1746127009.942750:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.942755:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991853184 00010000:00010000:3.0:1746127009.942760:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 7 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.942768:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 7 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.942776:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22055 00000100:00100000:3.0:1746127009.942781:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994329856:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.942781:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4548:x1830945991853184:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.942788:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.942811:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.942818:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 10 pid: 9611 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.942825:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994329984:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.942841:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2780 going to sleep for 11 seconds 00010000:00010000:2.0:1746127009.942910:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ce4 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.942928:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 25 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.942935:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127009.942937:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127009.942939:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 45 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.942955:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 25 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.942962:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 25 pid: 11152 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746127009.942970:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994330112:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.942994:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.946230:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994329600:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127009.946261:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efafb3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cd6 expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.946274:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099158600/0x34dc807b6efafb3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cd6 expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.946301:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158600, rc 0) 00000100:00100000:1.0:1746127009.946342:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991852928:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3760us (4032us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127009.946349:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22053 00000100:00100000:0.0:1746127009.946443:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.946460:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.946525:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991853312 00000100:00100000:0.0:1746127009.946536:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991853312 00000100:00100000:1.0:1746127009.946563:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991853440 00010000:00010000:0.0:1746127009.946563:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 30 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.946572:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991853440 00000100:00100000:0.0:1746127009.946590:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10387 00000100:00100000:0.0:1746127009.946597:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991853312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.946603:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 8 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.946607:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.946618:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 30 pid: 11152 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746127009.946627:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 30 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746127009.946629:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10388 00000100:00100000:1.0:1746127009.946633:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991853440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127009.946642:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127009.946649:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127009.946654:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 8 pid: 3148 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746127009.946662:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 8 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.946671:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991853312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 74us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127009.946677:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127009.946677:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10387 00000100:00100000:0.0:1746127009.946704:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994330112:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127009.946713:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991853440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.946723:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10388 00010000:00010000:0.0:1746127009.946723:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 45 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.946732:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3a000, rc 0) 00000100:00100000:0.0:1746127009.946750:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4548:x1830945991853184:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3969us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.946756:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22055 00010000:00010000:3.0:1746127009.947024:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911df800/0x34dc807b6efad3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b86 expref: 29 pid: 11152 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.947276:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994329728:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.947449:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbb6000/0x34dc807b6efadad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bda expref: 7 pid: 3148 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746127009.947461:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994329856:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.947472:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994329984:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.947492:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 28 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.947500:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8df600, rc 0) 00000100:00100000:3.0:1746127009.947522:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4545:x1830945991853056:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4920us (5014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127009.947529:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22054 00000100:00100000:0.0:1746127009.949154:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.949186:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.949222:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.949347:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991853568 00000100:00100000:2.0:1746127009.949354:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991853568 00010000:00010000:2.0:1746127009.949383:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 9 pid: 9611 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.949408:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10389 00000100:00100000:2.0:1746127009.949415:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991853568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.949427:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.949443:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 9 pid: 9611 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.949452:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 9 pid: 9611 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.949473:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096643800/0x34dc807b6efad0c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53b63 expref: 9 pid: 9611 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.949487:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.949489:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.949495:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.949503:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.949537:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.949549:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994330240:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127009.949664:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991853824 00000100:00100000:3.0:1746127009.949668:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991853824 00002000:00100000:3.0:1746127009.949697:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1515520->2097151) req@ffff88012238c000 x1830945991853824/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.949706:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238c000 with x1830945991853824 ext(1515520->2097151) 00010000:00010000:3.0:1746127009.949713:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 26 pid: 11152 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.949723:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 26 pid: 11152 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.949728:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238c000 00000100:00100000:3.0:1746127009.949742:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1972 00000100:00100000:3.0:1746127009.949747:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2029:x1830945991853824:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127009.949806:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991853952 00000100:00100000:0.0:1746127009.949809:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991853952 00000100:00100000:0.0:1746127009.949830:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22056 00000100:00100000:0.0:1746127009.949834:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4540:x1830945991853952:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127009.949842:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.949854:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ceb expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.949869:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.949876:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 44 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.949882:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.949883:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.949886:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2555903] (req 2097152->2555903) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 29 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.949903:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 44 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.949913:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 44 pid: 9613 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.949922:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994330368:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127009.950088:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4780 going to sleep for 11 seconds 00010000:00010000:0.0:1746127009.950151:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 29 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.950160:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 29 pid: 9613 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746127009.950168:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994330496:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.950199:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.956513:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.956791:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991854208 00000100:00100000:3.0:1746127009.956801:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991854208 00002000:00100000:3.0:1746127009.956846:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012238d880 x1830945991854208/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.956857:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238d880 with x1830945991854208 ext(4194304->4829183) 00010000:00010000:3.0:1746127009.956866:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 30 pid: 9613 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.956878:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 30 pid: 9613 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746127009.956888:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238d880 00000100:00100000:1.0:1746127009.956905:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.956909:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1973 00000100:00100000:3.0:1746127009.956916:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991854208:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.957022:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991854336 00000100:00100000:2.0:1746127009.957026:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991854336 00010000:00010000:2.0:1746127009.957042:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 45 pid: 9613 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746127009.957176:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10390 00000100:00100000:2.0:1746127009.957183:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991854336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.957192:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.957204:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 45 pid: 9613 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.957215:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 45 pid: 9613 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746127009.957238:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.957515:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991854336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 331us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.957521:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10390 00000100:00100000:2.0:1746127009.957561:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994330240:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127009.957579:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.957595:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991853568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 8180us (8408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.957602:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10389 00010000:00010000:0.0:1746127009.957714:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099159400/0x34dc807b6efaf9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cc8 expref: 44 pid: 9613 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746127009.957730:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994330368:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127009.958700:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012238ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994330496:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127009.958722:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2555903] (req 2097152->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 31 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.958735:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f121200, rc 0) 00000100:00100000:0.0:1746127009.958761:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4540:x1830945991853952:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8925us (9537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.958769:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22056 00000100:00100000:0.0:1746127009.958817:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.959055:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991854592 00000100:00100000:2.0:1746127009.959063:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991854592 00002000:00100000:2.0:1746127009.959091:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1073152->1077247) req@ffff88012238ea00 x1830945991854592/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.959100:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238ea00 with x1830945991854592 ext(1073152->1077247) 00002000:00010000:2.0:1746127009.959104:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238ea00 00000100:00100000:2.0:1746127009.959126:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8860 00000100:00100000:2.0:1746127009.959148:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991854592:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.960736:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991854592:12345-192.168.203.42@tcp:3:cat.0 Request processed in 1580us (1910us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127009.960746:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8860 00002000:00100000:2.0:1746127009.960755:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1073152->1077247) req@ffff88012238ea00 x1830945991854592/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.960764:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238ea00 with x1830945991854592 ext(1073152->1077247) 00002000:00010000:2.0:1746127009.960768:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012238ea00 00000100:00100000:0.0:1746127009.962001:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2029:x1830945991853824:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 12249us (12872us total) trans 21474842939 rc 0/0 00000100:00100000:0.0:1746127009.962025:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1972 00002000:00100000:0.0:1746127009.962034:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1515520->2097151) req@ffff88012238c000 x1830945991853824/t21474842939(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127009.962042:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238c000 with x1830945991853824 ext(1515520->2097151) 00010000:00010000:0.0:1746127009.962050:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 31 pid: 11152 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746127009.962063:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 31 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127009.962069:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238c000 00000100:00100000:3.0:1746127009.962263:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2029:x1830945991854208:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5346us (6632us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127009.962269:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1973 00002000:00100000:3.0:1746127009.962274:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012238d880 x1830945991854208/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.962280:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012238d880 with x1830945991854208 ext(4194304->4829183) 00010000:00010000:3.0:1746127009.962285:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 29 pid: 9613 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746127009.962292:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 29 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127009.962294:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:3.0:1746127009.962297:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012238d880 00000100:00100000:0.0:1746127009.962370:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991854848 00000100:00100000:0.0:1746127009.962379:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991854848 00000100:00100000:0.0:1746127009.962415:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6646 00000100:00100000:0.0:1746127009.962421:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4baf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4545:x1830945991854848:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:0.0:1746127009.962599:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4baf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4545:x1830945991854848:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 177us (303us total) trans 8589938341 rc 0/0 00000100:00100000:0.0:1746127009.962604:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6646 00000100:00100000:0.0:1746127009.966518:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.966679:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991854976 00000100:00100000:2.0:1746127009.966688:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991854976 00010000:00010000:2.0:1746127009.966725:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 29 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127009.966752:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10391 00000100:00100000:2.0:1746127009.966759:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991854976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.966773:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746127009.966791:0:7245:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127007 -> 1746127008 00002000:00010000:2.0:1746127009.966793:0:7245:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127007 -> 1746127008 00010000:00010000:2.0:1746127009.966798:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 29 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.966810:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 29 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.966834:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5400/0x34dc807b6efafac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ccf expref: 29 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.966851:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.966853:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.966860:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 43 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.966873:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 43 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.966904:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 43 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.966916:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994330624:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127009.967993:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.971734:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.971828:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994330624:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127009.971851:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127009.972026:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991854976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5266us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.972038:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10391 00000100:00100000:2.0:1746127009.972071:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991855104 00000100:00100000:2.0:1746127009.972077:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991855104 00010000:00010000:2.0:1746127009.972102:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 28 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127009.972140:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10392 00000100:00100000:2.0:1746127009.972147:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991855104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127009.972159:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127009.972178:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 28 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.972194:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 28 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.972217:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efaf6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cac expref: 28 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.972230:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.972232:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127009.972238:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.972245:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.972271:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127009.972283:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994330752:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127009.972341:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.972367:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991855232 00000100:00100000:0.0:1746127009.972369:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.972371:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991855232 00000100:00100000:0.0:1746127009.972388:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991855488 00000100:00100000:0.0:1746127009.972394:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991855488 00000100:00100000:2.0:1746127009.973183:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.973267:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22057 00000100:00100000:1.0:1746127009.973274:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991855232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127009.973288:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.973307:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099159400/0x34dc807b6efafcf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cf2 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127009.973312:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22058 00000100:00100000:0.0:1746127009.973319:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991855488:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127009.973331:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127009.973338:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994330880:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127009.973343:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d00 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127009.973361:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.973362:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127009.973367:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 29 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.973376:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 29 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.973382:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f121000, rc 0) 00000100:00100000:1.0:1746127009.973386:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.973410:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991855488:12345-192.168.203.42@tcp:101:cat.0 Request processed in 93us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127009.973414:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22058 00000100:00100000:1.0:1746127009.973415:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.973424:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991855360 00000100:00100000:0.0:1746127009.973426:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991855360 00000100:00100000:0.0:1746127009.973445:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22059 00000100:00100000:0.0:1746127009.973448:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991855360:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127009.973452:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127009.973458:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f120e00/0x34dc807b6efafdd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53cf9 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.973461:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.973468:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991855616 00000100:00100000:1.0:1746127009.973472:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991855616 00000100:00100000:0.0:1746127009.973483:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009da74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994331008:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127009.973491:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22060 00000100:00100000:1.0:1746127009.973495:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991855616:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127009.973501:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.973508:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665d000/0x34dc807b6efafe4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d07 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127009.973528:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994331136:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127009.973544:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.973584:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.973603:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991855872 00000100:00100000:3.0:1746127009.973607:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991855872 00002000:00100000:3.0:1746127009.973634:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88008c5bdf80 x1830945991855872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.973643:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bdf80 with x1830945991855872 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.973647:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bdf80 00000100:00100000:3.0:1746127009.973672:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8861 00000100:00100000:3.0:1746127009.973678:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991855872:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127009.974145:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746127009.978557:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994330880:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127009.978584:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994330752:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127009.978596:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099159400/0x34dc807b6efafcf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cf2 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.978603:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127009.978610:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099159400/0x34dc807b6efafcf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cf2 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.978633:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099159400, rc 0) 00000100:00100000:2.0:1746127009.978645:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991855104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6498us (6921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127009.978655:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10392 00000100:00100000:1.0:1746127009.978670:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012238fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991855232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5396us (6334us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127009.978678:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22057 00000100:00100000:2.0:1746127009.978732:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994331136:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127009.978752:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009665d000/0x34dc807b6efafe4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d07 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.978763:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665d000/0x34dc807b6efafe4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d07 expref: 29 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127009.978772:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665d000, rc 0) 00000100:00100000:2.0:1746127009.978792:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991855616:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5296us (5330us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127009.978798:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22060 00002000:00010000:0.0:1746127009.979987:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime: 1746127007 -> 1746127008 00002000:00010000:0.0:1746127009.979992:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746127007 -> 1746127008 00002000:00010000:0.0:1746127009.979993:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime: 1746127007 -> 1746127008 00000100:00100000:0.0:1746127009.980017:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009da74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994331008:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127009.980236:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f120e00/0x34dc807b6efafdd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cf9 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.980246:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f120e00/0x34dc807b6efafdd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cf9 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127009.980270:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f120e00, rc 0) 00000100:00100000:0.0:1746127009.980312:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991855360:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6862us (6896us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127009.980318:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22059 00000100:00100000:3.0:1746127009.980437:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.980600:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991855872:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6921us (7014us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127009.980608:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8861 00002000:00100000:3.0:1746127009.980616:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88008c5bdf80 x1830945991855872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:15/0 lens 488/440 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.980625:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c5bdf80 with x1830945991855872 ext(1048576->2097151) 00002000:00010000:3.0:1746127009.980630:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c5bdf80 00000100:00100000:3.0:1746127009.980644:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991856128 00000100:00100000:3.0:1746127009.980649:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991856128 00002000:00100000:3.0:1746127009.980677:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2551808->2555903) req@ffff88012ced7800 x1830945991856128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.980683:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced7800 with x1830945991856128 ext(2551808->2555903) 00002000:00010000:3.0:1746127009.980686:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced7800 00000100:00100000:3.0:1746127009.981301:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8862 00000100:00100000:3.0:1746127009.981309:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991856128:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127009.981630:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991856128:12345-192.168.203.42@tcp:3:cat.0 Request processed in 321us (1193us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127009.981636:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8862 00002000:00100000:3.0:1746127009.981641:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2551808->2555903) req@ffff88012ced7800 x1830945991856128/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.981647:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced7800 with x1830945991856128 ext(2551808->2555903) 00002000:00010000:3.0:1746127009.981651:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced7800 00000100:00100000:0.0:1746127009.983613:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127009.984160:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.984322:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991856384 00000100:00100000:2.0:1746127009.984330:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991856384 00000100:00100000:2.0:1746127009.984374:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991856256 00000100:00100000:2.0:1746127009.984376:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991856256 00000100:00100000:2.0:1746127009.984392:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22061 00000100:00100000:2.0:1746127009.984398:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991856384:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127009.984413:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127009.984427:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db3b600/0x34dc807b6efafeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d15 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.984470:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22062 00000100:00100000:3.0:1746127009.984477:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991856256:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127009.984483:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.984489:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efaff2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d0e expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.984522:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994331264:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127009.984591:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127009.985228:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994331392:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127009.985275:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127009.988841:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127009.988911:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991856512 00000100:00100000:1.0:1746127009.988923:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991856512 00000100:00100000:1.0:1746127009.988979:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22063 00000100:00100000:1.0:1746127009.988987:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4548:x1830945991856512:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127009.989020:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127009.989039:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d1c expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.989072:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.989078:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127009.989080:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746127009.989081:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994331392:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127009.989083:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127009.989108:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db3b600/0x34dc807b6efafeb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d15 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.989117:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127009.989125:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994331264:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127009.989125:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db3b600/0x34dc807b6efafeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d15 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127009.989151:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 27 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.989160:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3b600, rc 0) 00000100:00100000:1.0:1746127009.989163:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994331520:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.989180:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efaff2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d0e expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127009.989191:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efaff2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d0e expref: 10 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127009.989197:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991856384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4798us (5588us total) trans 0 rc 301/301 00010000:00010000:3.0:1746127009.989205:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915ac00, rc 0) 00000100:00100000:2.0:1746127009.989205:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22061 00000100:00100000:1.0:1746127009.989223:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.989236:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991856256:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4759us (5105us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127009.989242:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22062 00000100:00100000:1.0:1746127009.990518:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994331520:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127009.990540:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127009.990558:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665c200, rc 0) 00000100:00100000:1.0:1746127009.990597:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4548:x1830945991856512:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1609us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127009.990603:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22063 00000100:00100000:0.0:1746127009.992034:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.992153:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991856640 00000100:00100000:3.0:1746127009.992161:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991856640 00002000:00100000:3.0:1746127009.992197:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2555903) req@ffff88009c4cce00 x1830945991856640/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127009.992207:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cce00 with x1830945991856640 ext(2097152->2555903) 00010000:00010000:3.0:1746127009.992214:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 28 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127009.992226:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 28 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127009.992232:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4cce00 00000100:00100000:3.0:1746127009.992256:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1974 00000100:00100000:3.0:1746127009.992262:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991856640:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127009.992971:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.993035:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991856896 00000100:00100000:2.0:1746127009.993039:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991856896 00002000:00100000:2.0:1746127009.993324:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff88009c4cd500 x1830945991856896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/0 e 0 to 0 dl 1746127020 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.993332:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd500 with x1830945991856896 ext(4825088->4829183) 00010000:00010000:2.0:1746127009.993337:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.993347:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746127009.993354:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4cd500 00000100:00100000:2.0:1746127009.993569:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1975 00000100:00100000:2.0:1746127009.993576:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991856896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127009.993770:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991856896:12345-192.168.203.42@tcp:3:cat.0 Request processed in 193us (797us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127009.994524:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1975 00002000:00100000:2.0:1746127009.994534:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff88009c4cd500 x1830945991856896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/4536 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127009.994541:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cd500 with x1830945991856896 ext(4825088->4829183) 00010000:00010000:2.0:1746127009.994547:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127009.994559:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746127009.994565:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4cd500 00000100:00100000:0.0:1746127009.996766:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127009.996857:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991857024 00000100:00100000:3.0:1746127009.996865:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991857024 00000100:00100000:3.0:1746127009.997119:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17376 00000100:00100000:3.0:1746127009.997127:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4551:x1830945991857024:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127009.997171:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127009.997193:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009915ba00/0x34dc807b6efb000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d23 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.997253:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997266:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997283:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997296:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997300:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997308:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997376:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997386:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 18 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.997391:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127009.997421:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 18 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127009.997429:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 18 pid: 10958 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127009.997441:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994331648:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127009.997639:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127009.998870:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994331648:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127009.998888:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127009.999344:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127009.999392:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991857280 00000100:00100000:2.0:1746127009.999399:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991857280 00000100:00100000:2.0:1746127010.000041:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6647 00000100:00100000:2.0:1746127010.000049:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:8641:x1830945991857280:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746127010.000208:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:8641:x1830945991857280:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 159us (869us total) trans 8589938342 rc 0/0 00000100:00100000:2.0:1746127010.000214:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6647 00000100:00100000:0.0:1746127010.000760:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991856640:12345-192.168.203.42@tcp:4:cat.0 Request processed in 8496us (8729us total) trans 21474842940 rc 0/0 00000100:00100000:0.0:1746127010.000768:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1974 00002000:00100000:0.0:1746127010.000777:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2555903) req@ffff88009c4cce00 x1830945991856640/t21474842940(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:15/0 lens 488/448 e 0 to 0 dl 1746127020 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.000786:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cce00 with x1830945991856640 ext(2097152->2555903) 00010000:00010000:0.0:1746127010.000793:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.000810:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127010.000817:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4cce00 00000100:00100000:1.0:1746127010.002505:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.002568:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991857408 00000100:00100000:2.0:1746127010.002575:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991857408 00010000:00010000:2.0:1746127010.002599:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 20 pid: 10958 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.002617:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10393 00000100:00100000:2.0:1746127010.002622:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991857408:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.002630:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127010.002632:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127010.002634:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 20 pid: 10958 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.002642:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 20 pid: 10958 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.002659:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099159600/0x34dc807b6efae8d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c27 expref: 20 pid: 10958 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.002667:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.002670:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127010.002695:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991857536 00000100:00100000:1.0:1746127010.002697:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991857536 00010000:00010000:1.0:1746127010.002713:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.002729:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10394 00000100:00100000:1.0:1746127010.002732:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991857536:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.002740:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.002754:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.002762:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.002776:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f121200/0x34dc807b6efafc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2555903) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ceb expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.002803:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.002805:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.002813:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 44 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.002821:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 44 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.002853:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 44 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.002865:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994331776:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127010.002912:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127010.002918:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127010.002944:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.002982:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00010000:00010000:3.0:1746127010.002996:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003003:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:2.0:1746127010.003052:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991857408:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 428us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.003058:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10393 00000004:00200000:3.0:1746127010.003069:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127010.003074:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127010.003089:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003098:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003106:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003112:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003117:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003122:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009915a800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127010.003125:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003154:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003162:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127010.003165:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127010.003169:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003173:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a800/0x34dc807b6efb007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003186:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003191:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003195:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003199:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009915be00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127010.003201:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003205:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003210:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e600) 00010000:00010000:3.0:1746127010.003212:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127010.003214:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003218:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915be00/0x34dc807b6efb00e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.003247:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915ba00/0x34dc807b6efb000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.003257:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.003263:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.003264:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127010.003266:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915a200, rc 0) 00000100:00100000:3.0:1746127010.003299:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4551:x1830945991857024:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 6173us (6538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.003306:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17376 00000100:00100000:1.0:1746127010.006600:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994331776:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127010.006625:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.006675:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991857536:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3941us (4049us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.006685:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10394 00000100:00100000:0.0:1746127010.008053:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.008099:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.008126:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991857664 00000100:00100000:1.0:1746127010.008166:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991857664 00000100:00100000:0.0:1746127010.008175:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.008194:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991857920 00000100:00100000:3.0:1746127010.008198:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991857920 00000100:00100000:1.0:1746127010.008208:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991858176 00000100:00100000:1.0:1746127010.008211:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991858176 00000100:00100000:0.0:1746127010.008212:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.008227:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.008485:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.008505:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991857792 00000100:00100000:3.0:1746127010.008508:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991857792 00000100:00100000:3.0:1746127010.008528:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991858048 00000100:00100000:3.0:1746127010.008530:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991858048 00000100:00100000:1.0:1746127010.008539:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22064 00000100:00100000:1.0:1746127010.008549:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991857664:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127010.008570:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.008587:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d2a expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.008612:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.008614:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127010.008618:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22065 00010000:00010000:1.0:1746127010.008623:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127010.008624:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991857920:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127010.008632:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.008638:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.008641:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012341b000/0x34dc807b6efb023 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d38 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.008647:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665da00, rc 0) 00000100:00100000:3.0:1746127010.008680:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994331904:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127010.008681:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991857664:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 136us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.008685:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22064 00000100:00100000:1.0:1746127010.008697:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22066 00000100:00100000:1.0:1746127010.008701:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991858176:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127010.008706:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.008712:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d46 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.008720:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.008721:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127010.008722:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746127010.008725:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.008732:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.008738:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665c800, rc 0) 00000100:00100000:3.0:1746127010.008744:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22067 00000100:00100000:3.0:1746127010.008749:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991857792:12345-192.168.203.42@tcp:101:mirror_io.0 00000100:00100000:1.0:1746127010.008751:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991858176:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 50us (576us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127010.008754:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127010.008755:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22066 00010000:00010000:3.0:1746127010.008759:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb031 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d31 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.008763:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22068 00000100:00100000:1.0:1746127010.008767:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991858048:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:1.0:1746127010.008772:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127010.008782:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994332032:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.008809:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.009056:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991858304 00000100:00100000:2.0:1746127010.009060:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991858304 00000100:00100000:2.0:1746127010.009080:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22069 00000100:00100000:2.0:1746127010.009085:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991858304:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:2.0:1746127010.009091:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.009097:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d4d expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.009111:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.009112:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.009117:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.009127:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 12 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.009161:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03e00, rc 0) 00000100:00100000:2.0:1746127010.009185:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991858304:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 99us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.009189:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22069 00010000:00010000:1.0:1746127010.009254:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d3f expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.009347:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.009349:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.009353:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.009362:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.009372:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665ce00, rc 0) 00000100:00100000:1.0:1746127010.009746:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991858048:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 976us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.009751:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22068 00000100:00080000:1.0:1746127010.009770:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746127010.011497:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.011628:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991858560 00000100:00100000:0.0:1746127010.011637:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991858560 00002000:00100000:0.0:1746127010.011684:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a8eea300 x1830945991858560/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.011693:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eea300 with x1830945991858560 ext(2097152->4194303) 00002000:00010000:0.0:1746127010.011698:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8eea300 00000100:00100000:0.0:1746127010.011724:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8863 00000100:00100000:0.0:1746127010.011731:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991858560:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127010.012797:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994332032:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.012970:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb031 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d31 expref: 11 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.012985:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb031 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d31 expref: 11 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.012994:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915ac00, rc 0) 00000100:00080000:1.0:1746127010.013025:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746127010.013039:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991857792:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 4289us (4825us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.013046:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22067 00000100:00100000:3.0:1746127010.013089:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994331904:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.013103:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012341b000/0x34dc807b6efb023 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d38 expref: 9 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.013111:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012341b000/0x34dc807b6efb023 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d38 expref: 9 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.013118:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341b000, rc 0) 00000100:00100000:3.0:1746127010.013166:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991857920:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 4541us (5065us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.013171:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22065 00000100:00100000:0.0:1746127010.018393:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.018600:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991858816 00000100:00100000:3.0:1746127010.018609:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991858816 00000100:00100000:3.0:1746127010.018666:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17377 00000100:00100000:3.0:1746127010.018673:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4551:x1830945991858816:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127010.018693:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.018714:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb046 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d54 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.018816:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.018830:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.018837:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.018869:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.018881:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 8 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.018893:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994332160:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.018989:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.021348:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.021442:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994332160:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.021466:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127010.021615:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991858944 00000100:00100000:1.0:1746127010.021622:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991858944 00010000:00010000:1.0:1746127010.021656:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.021680:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10395 00000100:00100000:1.0:1746127010.021687:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991858944:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.021699:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.021705:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.021715:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.021737:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009915a200/0x34dc807b6efb015 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d23 expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.021757:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.021761:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127010.021774:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127010.021781:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127010.021806:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.021842:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991858944:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 155us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.021849:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10395 00000100:00100000:0.0:1746127010.021874:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991858560:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10136us (10373us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746127010.021884:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8863 00002000:00100000:0.0:1746127010.021894:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a8eea300 x1830945991858560/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.021903:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eea300 with x1830945991858560 ext(2097152->4194303) 00002000:00010000:0.0:1746127010.021908:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8eea300 00010000:00010000:3.0:1746127010.021966:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.021972:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127010.021991:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127010.022283:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb046 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d54 expref: 9 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.022296:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d54 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.022302:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.022305:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127010.022307:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450dc00, rc 0) 00000100:00100000:3.0:1746127010.022435:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4551:x1830945991858816:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 3762us (4051us total) trans 8589938343 rc 0/0 00000100:00100000:3.0:1746127010.022441:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17377 00000100:00100000:0.0:1746127010.025392:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.025493:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991859200 00000100:00100000:3.0:1746127010.025501:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991859200 00000100:00100000:3.0:1746127010.025610:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17378 00000100:00100000:3.0:1746127010.025617:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4551:x1830945991859200:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127010.025636:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.025640:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746127010.025659:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb04d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d54 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.025676:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.025680:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127010.025689:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb05b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d5b expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.025759:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb062 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.025769:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb062 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.025777:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb062 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127010.025786:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127010.025858:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb05b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d5b expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.025867:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb062 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d5b expref: 9 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.025873:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.025874:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127010.025876:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d800, rc 0) 00000100:00100000:3.0:1746127010.025924:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4551:x1830945991859200:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 305us (536us total) trans 8589938344 rc 0/0 00000100:00100000:3.0:1746127010.025930:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17378 00000100:00100000:0.0:1746127010.029037:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.030267:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991859328 00000100:00100000:3.0:1746127010.030278:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991859328 00000100:00100000:3.0:1746127010.030330:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17379 00000100:00100000:3.0:1746127010.030337:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4551:x1830945991859328:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:3.0:1746127010.030355:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.030370:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6efb070 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d62 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.030411:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6efb070 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d62 expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.030421:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6efb070 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d62 expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.030434:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.030437:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127010.030439:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d000, rc 0) 00000100:00100000:3.0:1746127010.030494:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4551:x1830945991859328:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 158us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.030500:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17379 00000100:00100000:0.0:1746127010.030504:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.030530:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991859584 00000100:00100000:0.0:1746127010.030537:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991859584 00002000:00100000:0.0:1746127010.030577:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094819880 x1830945991859584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.030586:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094819880 with x1830945991859584 ext(4194304->4829183) 00002000:00010000:0.0:1746127010.030592:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094819880 00000100:00100000:0.0:1746127010.030907:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8864 00000100:00100000:0.0:1746127010.030915:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991859584:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.033037:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.033975:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.034691:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991859712 00000100:00100000:2.0:1746127010.034700:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991859712 00000100:00100000:3.0:1746127010.034706:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991859840 00000100:00100000:3.0:1746127010.034710:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991859840 00000100:00100000:0.0:1746127010.035122:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.035749:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991859968 00000100:00100000:3.0:1746127010.035757:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991859968 00000100:00100000:2.0:1746127010.035789:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22070 00000100:00100000:1.0:1746127010.035795:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22071 00000100:00100000:2.0:1746127010.035797:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991859840:12345-192.168.203.42@tcp:1:mirror_io.0 00000100:00100000:1.0:1746127010.035801:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991859712:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:2.0:1746127010.035839:0:9611:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.035839:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.035857:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 27 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.035857:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 46 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.035864:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127010.035865:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.035866:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127010.035869:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.035872:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.035876:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.035877:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.035878:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.035899:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 27 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.035899:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 28 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.035910:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 27 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.035910:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 28 pid: 9612 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.035923:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994332416:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127010.035923:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994332288:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.035989:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.036001:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22072 00000100:00100000:0.0:1746127010.036016:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991859968:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:2.0:1746127010.036017:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.036025:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.036032:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994332544:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127010.036032:0:3542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.036040:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.036050:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127010.036052:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127010.036053:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.036055:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 46 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.036062:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 46 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.036065:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 27 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.036069:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994332672:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127010.036072:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 27 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.036079:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994332800:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.036082:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.036095:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.036117:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.036489:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.036503:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860096 00000100:00100000:3.0:1746127010.036506:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860096 00000100:00100000:3.0:1746127010.036525:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22073 00000100:00100000:3.0:1746127010.036530:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991860096:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:3.0:1746127010.036546:0:1964:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.036556:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 46 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.036562:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.036568:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.036578:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.036579:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.036581:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.036596:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.036603:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 28 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.036611:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994332928:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.036645:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.036652:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 16 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.036660:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994333056:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.036680:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 46 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.036687:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 46 pid: 3148 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.036699:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994333184:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.036713:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.037492:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.037544:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860224 00000100:00100000:2.0:1746127010.037549:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860224 00000100:00100000:2.0:1746127010.037577:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860352 00000100:00100000:2.0:1746127010.037579:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860352 00000100:00100000:2.0:1746127010.037592:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22074 00000100:00100000:2.0:1746127010.037596:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991860224:12345-192.168.203.42@tcp:1:mirror_io.0 00000100:00100000:0.0:1746127010.037607:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991859584:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6693us (7105us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746127010.037615:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8864 00010000:00010000:2.0:1746127010.037616:0:9613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746127010.037623:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094819880 x1830945991859584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127010.037628:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746127010.037632:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094819880 with x1830945991859584 ext(4194304->4829183) 00010000:00010000:2.0:1746127010.037634:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 17 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.037637:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.037639:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.037640:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.037642:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.037650:0:29584:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746127010.037655:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094819880 00010000:00010000:2.0:1746127010.037657:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 17 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.037664:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 17 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.037672:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994333312:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.037713:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 44 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.037720:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 44 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.037728:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994333440:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.037747:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.037962:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22075 00000100:00100000:1.0:1746127010.037970:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991860352:12345-192.168.203.42@tcp:1:mirror_io.0 00010000:00010000:1.0:1746127010.037989:0:16295:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.037999:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.038017:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.038025:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 7 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.038031:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.038032:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.038034:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.038054:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 7 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.038061:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 7 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.038071:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994333568:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127010.038101:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.038108:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 10 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.038115:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994333696:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127010.038163:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 27 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.038170:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 27 pid: 9612 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.038178:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012153d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994333824:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127010.038192:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.038500:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.038527:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.038539:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860608 00000100:00100000:0.0:1746127010.038542:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860608 00002000:00100000:0.0:1746127010.038569:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1654784->2097151) req@ffff88009481b800 x1830945991860608/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.038577:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481b800 with x1830945991860608 ext(1654784->2097151) 00010000:00010000:0.0:1746127010.038583:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 28 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.038592:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 28 pid: 9613 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127010.038598:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009481b800 00000100:00100000:0.0:1746127010.038609:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1976 00000100:00100000:0.0:1746127010.038615:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991860608:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127010.038790:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860480 00000100:00100000:2.0:1746127010.038794:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860480 00010000:00010000:2.0:1746127010.038816:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 18 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.038836:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10396 00000100:00100000:2.0:1746127010.038841:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991860480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.038850:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.038871:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 18 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.038880:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 18 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.038899:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.038918:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991860480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.038923:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10396 00000100:00100000:3.0:1746127010.038928:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994332288:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.038938:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665da00/0x34dc807b6efb01c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d2a expref: 17 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.038944:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994332416:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.038952:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994332544:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.038958:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994332672:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.038962:0:9611:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.038974:0:1507:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.039047:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994332800:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127010.039058:0:3542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746127010.039073:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746127010.041493:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.041520:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.041538:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860864 00000100:00100000:2.0:1746127010.041545:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860864 00010000:00010000:2.0:1746127010.041576:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 29 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.041599:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991861120 00000100:00100000:2.0:1746127010.041601:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991861120 00000100:00100000:0.0:1746127010.041602:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127010.041611:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 17 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746127010.041617:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991861248 00000100:00100000:0.0:1746127010.041619:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991861248 00000100:00100000:2.0:1746127010.041627:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10397 00000100:00100000:2.0:1746127010.041633:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991860864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.041633:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 45 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.041647:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127010.041654:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10398 00000100:00100000:0.0:1746127010.041659:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991861120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.041665:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.041666:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 29 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746127010.041673:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 17 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.041677:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 29 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.041752:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994332928:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.041762:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994333056:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.041770:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994333184:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127010.041836:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10399 00000100:00100000:1.0:1746127010.041846:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991861248:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.041854:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.041863:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 45 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.041871:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 45 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.041889:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099158400/0x34dc807b6efae7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c20 expref: 45 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.041910:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.041942:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991861248:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.041948:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10399 00010000:00010000:0.0:1746127010.042360:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 17 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746127010.042380:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665ce00/0x34dc807b6efb03f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d3f expref: 17 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746127010.042395:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127010.042406:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f121000/0x34dc807b6efafd6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d00 expref: 29 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.042416:0:1964:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.042426:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.042445:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2026:x1830945991860864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 811us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.042451:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10397 00000100:00100000:0.0:1746127010.042663:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991861120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1002us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.042669:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10398 00000100:00100000:0.0:1746127010.043276:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.043308:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.043505:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860992 00000100:00100000:2.0:1746127010.043510:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860992 00010000:00010000:2.0:1746127010.043528:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 28 pid: 9612 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.043760:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10400 00000100:00100000:2.0:1746127010.043766:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2029:x1830945991860992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.043776:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.043789:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 28 pid: 9612 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.043797:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 28 pid: 9612 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.043812:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96400/0x34dc807b6efae9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c2e expref: 28 pid: 9612 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.043891:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.043893:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.043897:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.043910:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.043929:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.043950:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2029:x1830945991860992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 185us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.043955:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10400 00000100:00100000:3.0:1746127010.044365:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991860736 00000100:00100000:3.0:1746127010.044371:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991860736 00002000:00100000:3.0:1746127010.044403:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1077247) req@ffff88009481a680 x1830945991860736/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.044411:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481a680 with x1830945991860736 ext(1048576->1077247) 00010000:00010000:3.0:1746127010.044418:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.044428:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127010.044434:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009481a680 00000100:00100000:3.0:1746127010.044455:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1977 00000100:00100000:0.0:1746127010.044457:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.044459:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991860736:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:2.0:1746127010.044520:0:1507:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044528:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044547:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044554:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044561:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044568:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995eb800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127010.044571:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044584:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044593:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.044598:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb077 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.044723:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994333568:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.044833:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994333312:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.044841:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994333440:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.044855:0:9613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.044870:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991861376 00000100:00100000:3.0:1746127010.044873:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991861376 00010000:00010000:3.0:1746127010.044884:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 44 pid: 3148 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.044908:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10401 00000100:00100000:3.0:1746127010.044912:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2029:x1830945991861376:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.044920:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.044927:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 44 pid: 3148 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.044939:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 44 pid: 3148 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.044950:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efafc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ce4 expref: 44 pid: 3148 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.044962:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.044964:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.044967:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.044973:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.044980:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991859712:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 9180us (11952us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127010.044985:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.044989:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22071 00000100:00100000:3.0:1746127010.044997:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2029:x1830945991861376:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 85us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.045002:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10401 00010000:00010000:3.0:1746127010.045033:0:1964:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.045041:0:1964:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.045084:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c5bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994333696:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.045091:0:1964:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.045102:0:1964:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.045108:0:1964:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.045113:0:1964:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127010.045116:0:1964:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.045119:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012153d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994333824:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.045122:0:1964:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.045150:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.045172:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.045182:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991861504 00000100:00100000:1.0:1746127010.045185:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991861504 00010000:00010000:1.0:1746127010.045195:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.045208:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10402 00000100:00100000:1.0:1746127010.045213:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991861504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.045220:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.045228:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045235:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045245:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665c800/0x34dc807b6efb02a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d46 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045254:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.045264:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991861504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 52us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.045269:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10402 00000100:00100000:1.0:1746127010.045291:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.045300:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991861632 00000100:00100000:1.0:1746127010.045302:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991861632 00010000:00010000:3.0:1746127010.045304:0:1964:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.045310:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb08c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.045310:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 11 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.045335:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10403 00000100:00100000:3.0:1746127010.045340:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991860096:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 8810us (9221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.045340:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991861632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127010.045346:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22073 00010000:00010000:1.0:1746127010.045347:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.045355:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 11 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045362:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 11 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045375:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb038 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d4d expref: 11 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045384:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.045397:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991861632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.045402:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10403 00000100:00100000:1.0:1746127010.045436:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.045446:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991861760 00000100:00100000:1.0:1746127010.045449:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991861760 00010000:00010000:1.0:1746127010.045459:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 8 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.045485:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10404 00000100:00100000:1.0:1746127010.045490:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2029:x1830945991861760:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.045497:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.045502:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 8 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045513:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 8 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045524:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9800/0x34dc807b6efaf43 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c9e expref: 8 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.045532:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.045545:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2029:x1830945991861760:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.045550:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10404 00000100:00100000:0.0:1746127010.045853:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991860608:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7236us (7323us total) trans 17179875666 rc 0/0 00000100:00100000:0.0:1746127010.045860:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1976 00002000:00100000:0.0:1746127010.045867:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1654784->2097151) req@ffff88009481b800 x1830945991860608/t17179875666(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/448 e 0 to 0 dl 1746127021 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.045880:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481b800 with x1830945991860608 ext(1654784->2097151) 00010000:00010000:0.0:1746127010.045886:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 32 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.045894:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 32 pid: 9613 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127010.045900:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009481b800 00000100:00100000:0.0:1746127010.047313:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.047628:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862016 00000100:00100000:3.0:1746127010.047633:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862016 00000100:00100000:3.0:1746127010.047673:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22076 00000100:00100000:3.0:1746127010.047680:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991862016:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.047695:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.047711:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d69 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127010.047729:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c89f, atime: 0x6813c89f, ctime: 0x6813c89f, blocks: 0x7f8 00010000:00010000:3.0:1746127010.047745:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.047747:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.047755:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 44 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.047768:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 44 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.047776:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82800, rc 0) 00000100:00100000:3.0:1746127010.047818:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991862016:12345-192.168.203.42@tcp:101:cat.0 Request processed in 137us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.047823:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22076 00000100:00100000:0.0:1746127010.048060:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.048088:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.048101:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.048113:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.048146:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862272 00000100:00100000:0.0:1746127010.048149:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862272 00000100:00100000:0.0:1746127010.048165:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862528 00000100:00100000:0.0:1746127010.048166:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862528 00000100:00100000:0.0:1746127010.048174:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862144 00000100:00100000:0.0:1746127010.048176:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862144 00000100:00100000:0.0:1746127010.048186:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22077 00000100:00100000:0.0:1746127010.048189:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991862272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127010.048196:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.048205:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f121000/0x34dc807b6efb0a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d77 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127010.048241:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994333952:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127010.048293:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.048339:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.048366:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.048373:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862400 00000100:00100000:2.0:1746127010.048376:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862400 00000100:00100000:2.0:1746127010.048393:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862656 00000100:00100000:2.0:1746127010.048395:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862656 00000100:00100000:2.0:1746127010.048404:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22078 00000100:00100000:2.0:1746127010.048409:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991862528:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.048415:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.048422:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb9de00/0x34dc807b6efb0af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d85 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.048432:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.048438:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9de00/0x34dc807b6efb0af lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d85 expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.048450:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9de00/0x34dc807b6efb0af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d85 expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.048458:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9de00, rc 0) 00000100:00100000:2.0:1746127010.048478:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991862528:12345-192.168.203.42@tcp:101:cat.0 Request processed in 69us (389us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.048483:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22078 00000100:00100000:2.0:1746127010.048492:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22079 00000100:00100000:2.0:1746127010.048496:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991862144:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.048501:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.048507:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb9cc00/0x34dc807b6efb0b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d70 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.048526:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994334080:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127010.048545:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.048559:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22080 00000100:00100000:2.0:1746127010.048564:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991862400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.048570:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.048576:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d7e expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127010.048588:0:11152:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c8a0, atime: 0x6813c89f, ctime: 0x6813c8a0, blocks: 0x800 00010000:00010000:2.0:1746127010.048595:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.048596:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.048602:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 45 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.048611:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 45 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.048618:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9d000, rc 0) 00000100:00100000:2.0:1746127010.048633:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991862400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 68us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.048638:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22080 00000100:00100000:2.0:1746127010.048648:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22081 00000100:00100000:2.0:1746127010.048653:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991862656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.048658:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.048663:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb9da00/0x34dc807b6efb0c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d8c expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.048673:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.048677:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9da00/0x34dc807b6efb0c4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d8c expref: 39 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.048684:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9da00/0x34dc807b6efb0c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d8c expref: 39 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.048691:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9da00, rc 0) 00000100:00100000:2.0:1746127010.048704:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991862656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 51us (338us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.048710:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22081 00000100:00100000:3.0:1746127010.048764:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991861888 00000100:00100000:3.0:1746127010.048767:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991861888 00010000:00010000:3.0:1746127010.048780:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 38 pid: 9612 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.048797:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10405 00000100:00100000:3.0:1746127010.048802:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991861888:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.048810:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.048821:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 38 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.048835:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 38 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.048848:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c644800/0x34dc807b6efaed3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c66 expref: 38 pid: 9612 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.048856:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.048858:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.048861:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.048868:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.048882:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.048898:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991861888:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 96us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.048903:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10405 00010000:00010000:1.0:1746127010.049053:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.049061:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.049076:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.049082:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.049089:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127010.049163:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127010.049221:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995ea800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127010.049225:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.049230:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862784 00000100:00100000:2.0:1746127010.049232:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862784 00010000:00010000:1.0:1746127010.049232:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.049243:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.049244:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 37 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.049249:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995ea800/0x34dc807b6efb09a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.049258:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10406 00000100:00100000:2.0:1746127010.049262:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991862784:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.049269:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.049277:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 37 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.049283:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991860352:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 11315us (11794us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127010.049285:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 37 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.049289:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22075 00010000:00010000:2.0:1746127010.049294:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.049296:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.049298:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.049304:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.049317:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.049327:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991862784:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.049327:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991860736:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4868us (6019us total) trans 17179875667 rc 0/0 00000100:00100000:2.0:1746127010.049332:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10406 00000100:00100000:1.0:1746127010.049335:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1977 00002000:00100000:1.0:1746127010.049342:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1077247) req@ffff88009481a680 x1830945991860736/t17179875667(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/448 e 0 to 0 dl 1746127021 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127010.049345:0:9611:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746127010.049351:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481a680 with x1830945991860736 ext(1048576->1077247) 00010000:00010000:2.0:1746127010.049356:0:9611:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.049356:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 35 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.049366:0:9611:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.049369:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 35 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.049372:0:9611:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127010.049375:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009481a680 00010000:00010000:2.0:1746127010.049378:0:9611:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.049382:0:9611:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd03200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127010.049384:0:9611:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.049390:0:9611:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.049398:0:9611:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.049404:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03200/0x34dc807b6efb07e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.049623:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991859840:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 13825us (15647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.049630:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22070 00000100:00100000:0.0:1746127010.050951:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.051033:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991862912 00000100:00100000:3.0:1746127010.051038:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991862912 00010000:00010000:3.0:1746127010.051059:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.051081:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10407 00000100:00100000:3.0:1746127010.051086:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991862912:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.051095:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.051109:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.051118:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.051151:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665c200/0x34dc807b6efaff9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d1c expref: 45 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.051162:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.051163:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.051166:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.051173:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.051187:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127010.051198:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051204:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051216:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051222:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051231:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051236:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009450cc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127010.051239:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051244:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051253:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.051262:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efb093 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.051481:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2029:x1830945991862912:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 393us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.051481:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991860224:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 13883us (14991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.051487:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10407 00000100:00100000:0.0:1746127010.051487:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22074 00000100:00100000:1.0:1746127010.052269:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9612:1830945994333952:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127010.052296:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f121000/0x34dc807b6efb0a8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d77 expref: 34 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.052307:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f121000/0x34dc807b6efb0a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d77 expref: 34 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.052317:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f121000, rc 0) 00000100:00100000:1.0:1746127010.052354:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991862272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4162us (4293us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127010.052360:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22077 00010000:00010000:3.0:1746127010.052733:0:3148:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff880094e6ea00 x1830945994334080) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 32 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.052750:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099159c00/0x34dc807b6efaf74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cb3 expref: 32 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.052759:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994334080:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.052775:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9cc00/0x34dc807b6efb0b6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d70 expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.052783:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9cc00/0x34dc807b6efb0b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d70 expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.052793:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb9cc00, rc 0) 00000100:00100000:3.0:1746127010.052812:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991862144:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4315us (4698us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.052818:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22079 00000100:00100000:0.0:1746127010.053163:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.053482:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991863040 00000100:00100000:3.0:1746127010.053487:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991863040 00010000:00010000:3.0:1746127010.053507:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.053525:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10408 00000100:00100000:3.0:1746127010.053531:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991863040:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.053540:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.053548:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.053559:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.053573:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df600/0x34dc807b6efafba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53cdd expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.053587:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.053589:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.053593:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.053600:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.053627:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127010.053669:0:3542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053677:0:3542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053689:0:3542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053696:0:3542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053703:0:3542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053709:0:3542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f120400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127010.053713:0:3542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053719:0:3542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053728:0:3542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.053733:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f120400/0x34dc807b6efb085 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.053787:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2026:x1830945991859968:12345-192.168.203.42@tcp:1:mirror_io.0 Request processed in 17780us (18665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.053793:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22072 00000100:00100000:3.0:1746127010.053833:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991863040:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 302us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.053839:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10408 00000100:00100000:0.0:1746127010.055105:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.055361:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.055419:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991863168 00000100:00100000:1.0:1746127010.055424:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991863168 00000100:00100000:1.0:1746127010.055453:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22082 00000100:00100000:1.0:1746127010.055459:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4548:x1830945991863168:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127010.055475:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.055492:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d93 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127010.055515:0:3542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c8a0, atime: 0x6813c8a0, ctime: 0x6813c8a0, blocks: 0x14e0 00010000:00010000:1.0:1746127010.055530:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.055532:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.055538:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 45 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.055551:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 45 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.055560:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eaa00, rc 0) 00000100:00100000:1.0:1746127010.055589:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4548:x1830945991863168:12345-192.168.203.42@tcp:101:cat.0 Request processed in 130us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.055594:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22082 00000100:00100000:3.0:1746127010.055664:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991863424 00000100:00100000:3.0:1746127010.055668:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991863424 00000100:00100000:3.0:1746127010.055918:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17380 00000100:00100000:3.0:1746127010.055924:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4551:x1830945991863424:12345-192.168.203.42@tcp:36:mirror_io.0 00010000:00010000:3.0:1746127010.055958:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.055976:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d000/0x34dc807b6efb070 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d62 expref: 10 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.055988:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.055992:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127010.056022:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.056032:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056041:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056047:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056052:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 34 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056057:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.056083:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 34 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056093:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 34 pid: 10958 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.056105:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334208:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.056205:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056213:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 18 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.056220:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334336:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.056244:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056252:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 34 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.056259:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334464:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.056278:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 18 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.056285:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 18 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.056292:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334592:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.056307:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.058076:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.058098:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334208:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.058108:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334336:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.058115:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334464:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127010.058193:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.058207:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.058358:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.058379:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991863552 00000100:00100000:0.0:1746127010.058383:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.058386:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991863552 00000100:00100000:0.0:1746127010.058399:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991864064 00000100:00100000:0.0:1746127010.058401:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991864064 00000100:00100000:2.0:1746127010.058417:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991863936 00010000:00010000:0.0:1746127010.058418:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 19 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.058419:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991863936 00000100:00100000:2.0:1746127010.058427:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991863680 00000100:00100000:2.0:1746127010.058429:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991863680 00000100:00100000:0.0:1746127010.058434:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991863808 00000100:00100000:0.0:1746127010.058436:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991863808 00000100:00100000:2.0:1746127010.058442:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22083 00010000:00010000:0.0:1746127010.058444:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 35 pid: 10958 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.058447:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991863552:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127010.058455:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10409 00000100:00100000:0.0:1746127010.058458:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991864064:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.058462:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.058470:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.058474:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 19 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.058479:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53d9a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.058482:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 19 pid: 13448 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746127010.058498:0:3542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c8a0, atime: 0x6813c8a0, ctime: 0x6813c8a0, blocks: 0x800 00010000:00010000:0.0:1746127010.058499:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc000/0x34dc807b6efae24 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53bfd expref: 19 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.058509:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.058511:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.058513:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.058515:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127010.058519:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.058523:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127010.058530:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.058538:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03e00, rc 0) 00000100:00100000:2.0:1746127010.058552:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991863552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 106us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.058552:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991864064:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 92us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.058557:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22083 00000100:00100000:0.0:1746127010.058557:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10409 00000100:00100000:2.0:1746127010.058569:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22084 00000100:00100000:0.0:1746127010.058569:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10410 00000100:00100000:2.0:1746127010.058573:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991863936:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127010.058573:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991863808:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.058578:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.058579:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.058582:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 35 pid: 10958 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.058585:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53da8 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.058590:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 35 pid: 10958 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746127010.058593:0:3542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c8a0, atime: 0x6813c89f, ctime: 0x6813c8a0, blocks: 0x1008 00010000:00010000:2.0:1746127010.058599:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.058600:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.058600:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fcc00/0x34dc807b6efaea2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c35 expref: 35 pid: 10958 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.058603:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.058608:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127010.058610:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127010.058612:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.058616:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127010.058618:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd03800, rc 0) 00000100:00100000:2.0:1746127010.058628:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991863936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.058628:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991863808:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.058632:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22084 00000100:00100000:0.0:1746127010.058632:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10410 00000100:00100000:2.0:1746127010.058640:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22085 00000100:00100000:2.0:1746127010.058644:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991863680:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.058649:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127010.058657:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.058668:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991864192 00000100:00100000:0.0:1746127010.058671:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991864192 00010000:00010000:0.0:1746127010.058679:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 34 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.058693:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10411 00000100:00100000:0.0:1746127010.058707:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991864192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.058714:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.058718:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 34 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.058724:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 34 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.058733:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97000/0x34dc807b6efaf5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ca5 expref: 34 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.058742:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127010.058745:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.058749:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127010.058763:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991864192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 66us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.058768:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10411 00000100:00100000:3.0:1746127010.059038:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994334592:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.059062:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:0.0:1746127010.059428:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127010.059484:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53da1 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.059493:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991864320 00002000:00010000:2.0:1746127010.059497:0:3542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c8a0, atime: 0x6813c89f, ctime: 0x6813c8a0, blocks: 0x808 00000100:00100000:1.0:1746127010.059497:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991864320 00010000:00010000:2.0:1746127010.059506:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.059508:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.059513:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.059513:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 18 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.059523:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127010.059528:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10412 00010000:00010000:2.0:1746127010.059530:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd02e00, rc 0) 00000100:00100000:1.0:1746127010.059533:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991864320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.059540:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.059544:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 18 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.059552:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991863680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 907us (1344us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127010.059552:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 18 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.059557:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22085 00010000:00010000:1.0:1746127010.059568:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db3b800/0x34dc807b6efaf0b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53c89 expref: 18 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.059576:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.059579:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127010.059585:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127010.059591:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127010.059722:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127010.059872:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.059878:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000040:00080000:3.0:1746127010.060144:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1435, 88 off133888 00000004:00080000:3.0:1746127010.060153:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905102023201ns, next at 847916292410ns, rc = 0 00000100:00100000:1.0:1746127010.060251:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991864320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 716us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.060258:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10412 00000040:00080000:3.0:1746127010.060594:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1449, 88 off135208 00000004:00080000:3.0:1746127010.060600:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905102470901ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127010.060631:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1450, 88 off135296 00000004:00080000:3.0:1746127010.060634:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905102504608ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127010.060643:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1436, 88 off133976 00000004:00080000:3.0:1746127010.060646:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905102516396ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061300:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1437, 88 off134064 00000004:00080000:3.0:1746127010.061308:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905103178187ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061317:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1451, 88 off135384 00000004:00080000:3.0:1746127010.061320:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905103190444ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127010.061342:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1452, 88 off135472 00000004:00080000:3.0:1746127010.061345:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905103215741ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127010.061352:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1453, 88 off135560 00000004:00080000:3.0:1746127010.061354:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905103224909ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127010.061361:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1438, 88 off134152 00000004:00080000:3.0:1746127010.061363:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905103234100ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061370:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1454, 88 off135648 00000004:00080000:3.0:1746127010.061372:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905103242890ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127010.061379:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1439, 88 off134240 00000004:00080000:3.0:1746127010.061381:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905103251817ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061388:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1455, 88 off135736 00000004:00080000:3.0:1746127010.061390:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905103260615ns, next at 895431202182ns, rc = 0 00000040:00080000:3.0:1746127010.061396:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1440, 88 off134328 00000004:00080000:3.0:1746127010.061399:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905103269765ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061406:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1441, 88 off134416 00000004:00080000:3.0:1746127010.061409:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905103280219ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061417:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1442, 88 off134504 00000004:00080000:3.0:1746127010.061420:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905103290831ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061427:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1443, 88 off134592 00000004:00080000:3.0:1746127010.061429:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905103300099ns, next at 847916292410ns, rc = 0 00000040:00080000:3.0:1746127010.061437:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1456, 88 off135824 00000004:00080000:3.0:1746127010.061440:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905103310375ns, next at 895431202182ns, rc = 0 00000100:00100000:2.0:1746127010.062155:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.062497:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991864576 00000100:00100000:0.0:1746127010.062504:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991864576 00002000:00100000:0.0:1746127010.062541:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff880094e6f480 x1830945991864576/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.062550:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6f480 with x1830945991864576 ext(4825088->4829183) 00002000:00010000:0.0:1746127010.062555:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6f480 00000100:00100000:0.0:1746127010.062580:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8865 00000100:00100000:0.0:1746127010.062585:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991864576:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.062704:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991864576:12345-192.168.203.42@tcp:3:cat.0 Request processed in 118us (575us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127010.062709:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8865 00002000:00100000:0.0:1746127010.062714:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff880094e6f480 x1830945991864576/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.062720:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6f480 with x1830945991864576 ext(4825088->4829183) 00002000:00010000:0.0:1746127010.062723:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6f480 00000001:00080000:1.0:1746127010.065572:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938345 is committed 00000004:00080000:1.0:1746127010.065581:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1430 committed 00000004:00080000:1.0:1746127010.065770:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1417 committed 00000004:00080000:1.0:1746127010.065872:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1416 committed 00000004:00080000:1.0:1746127010.065875:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1415 committed 00000004:00080000:1.0:1746127010.065876:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1414 committed 00000004:00080000:1.0:1746127010.065878:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1429 committed 00000004:00080000:1.0:1746127010.065880:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1413 committed 00000004:00080000:1.0:1746127010.065881:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1428 committed 00000004:00080000:1.0:1746127010.065882:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1412 committed 00000004:00080000:1.0:1746127010.065884:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1427 committed 00000004:00080000:1.0:1746127010.065885:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1426 committed 00000004:00080000:1.0:1746127010.065886:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1425 committed 00000004:00080000:1.0:1746127010.065889:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1411 committed 00000004:00080000:1.0:1746127010.065890:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1410 committed 00000004:00080000:1.0:1746127010.065892:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1424 committed 00000004:00080000:1.0:1746127010.065893:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1423 committed 00000004:00080000:1.0:1746127010.065895:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1409 committed 00000001:00080000:1.0:1746127010.065903:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938342 is committed 00000001:00080000:1.0:1746127010.065908:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938341 is committed 00000004:00010000:3.0:1746127010.066061:0:13448:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d22dc00 reply state ffff880096509400 transno 8589938345 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.066084:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.066092:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.066094:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746127010.066099:0:13448:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746127010.066199:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994334976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127010.066258:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.066258:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994334848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127010.066297:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994335488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.066308:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.066424:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994334720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.066489:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994334976 00000100:00100000:0.0:1746127010.066495:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994334976 00000100:00100000:0.0:1746127010.066523:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994334848 00000100:00100000:0.0:1746127010.066525:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994334848 00000100:00100000:0.0:1746127010.066538:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22086 00000100:00100000:0.0:1746127010.066545:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994334976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127010.066636:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127010.066638:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.066640:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127010.066641:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.066643:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746127010.066706:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.066724:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994335488 00000100:00100000:2.0:1746127010.066728:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994335488 00000100:00100000:1.0:1746127010.066824:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994335360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.066828:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3782:x1830945994334976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 285us (571us total) trans 21474842941 rc 0/0 00000100:00100000:0.0:1746127010.066834:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22086 00000100:00100000:1.0:1746127010.066839:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746127010.066906:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22e680/2, rc 0, transno 21474842941 00000100:00100000:3.0:1746127010.066916:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994334976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127010.066925:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994336000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.067029:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994335872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.067047:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.067067:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994335360 00000100:00100000:0.0:1746127010.067070:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994335360 00000100:00100000:0.0:1746127010.067089:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22087 00000100:00100000:0.0:1746127010.067093:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3785:x1830945994334848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.067102:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22088 00000100:00100000:3.0:1746127010.067109:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22089 00000100:00100000:2.0:1746127010.067109:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3782:x1830945994335488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127010.067118:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3785:x1830945994335360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127010.067159:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127010.067162:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.067163:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.067165:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.067167:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746127010.067179:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3782:x1830945994335488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (473us total) trans 21474842942 rc 0/0 00000100:00100000:0.0:1746127010.067182:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3785:x1830945994334848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (875us total) trans 17179875668 rc 0/0 00000100:00100000:2.0:1746127010.067184:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22088 00000100:00100000:0.0:1746127010.067186:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22087 00000100:00100000:3.0:1746127010.067245:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3785:x1830945994335360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (404us total) trans 21474842943 rc 0/0 00000100:00100000:3.0:1746127010.067252:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22089 00010000:00080000:3.0:1746127010.067301:0:13448:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746127010.067312:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4551:x1830945991863424:12345-192.168.203.42@tcp:36:mirror_io.0 Request processed in 11387us (11949us total) trans 8589938345 rc 0/0 00000100:00100000:3.0:1746127010.067318:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17380 00010000:00010000:0.0:1746127010.067349:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.067357:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.067362:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.067367:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127010.067370:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.067376:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.067387:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127010.067389:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127010.067392:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.067397:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82400/0x34dc807b6efb0d2 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127010.067462:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994336384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127010.067542:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994335872 00000100:00100000:3.0:1746127010.067547:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994335872 00000100:00100000:3.0:1746127010.067566:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22090 00000100:00100000:3.0:1746127010.067570:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3785:x1830945994335872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127010.067629:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127010.067632:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:3.0:1746127010.067634:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127010.067636:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:3.0:1746127010.067637:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746127010.067658:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3785:x1830945994335872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (610us total) trans 17179875669 rc 0/0 00000100:00100000:3.0:1746127010.067663:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22090 00000100:00100000:2.0:1746127010.067687:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.067706:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994335232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.067719:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.067737:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.067744:0:3785:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875663 gen 2 00000004:00080000:1.0:1746127010.067748:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a7b480, transno 17179875623 00000004:00080000:1.0:1746127010.067754:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d1180, transno 17179875624 00000004:00080000:1.0:1746127010.067756:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b9aa00, transno 17179875625 00000100:00100000:2.0:1746127010.067757:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994335744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127010.067758:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d2a00, transno 17179875626 00000004:00080000:1.0:1746127010.067760:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b98a80, transno 17179875627 00000004:00080000:1.0:1746127010.067762:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009da74a80, transno 17179875628 00000004:00080000:1.0:1746127010.067764:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009da74000, transno 17179875629 00000004:00080000:1.0:1746127010.067766:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a78a80, transno 17179875630 00000004:00080000:1.0:1746127010.067768:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74a80, transno 17179875631 00000100:00100000:2.0:1746127010.067770:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746127010.067771:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a75500, transno 17179875632 00000004:00080000:1.0:1746127010.067773:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a77b80, transno 17179875633 00000004:00080000:1.0:1746127010.067776:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a75180, transno 17179875634 00000004:00080000:1.0:1746127010.067778:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099196300, transno 17179875635 00000004:00080000:1.0:1746127010.067781:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a77480, transno 17179875636 00000004:00080000:1.0:1746127010.067783:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74e00, transno 17179875637 00000004:00080000:1.0:1746127010.067785:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a77800, transno 17179875638 00000004:00080000:1.0:1746127010.067787:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b99f80, transno 17179875644 00000004:00080000:1.0:1746127010.067789:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b99180, transno 17179875645 00000004:00080000:1.0:1746127010.067791:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b9b480, transno 17179875646 00000004:00080000:1.0:1746127010.067793:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b9b800, transno 17179875647 00000004:00080000:1.0:1746127010.067795:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c429c00, transno 17179875648 00000004:00080000:1.0:1746127010.067797:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b99c00, transno 17179875649 00000004:00080000:1.0:1746127010.067799:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c42ad80, transno 17179875650 00000004:00080000:1.0:1746127010.067801:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c42aa00, transno 17179875651 00000004:00080000:1.0:1746127010.067803:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094824000, transno 17179875656 00000004:00080000:1.0:1746127010.067804:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094826300, transno 17179875657 00000100:00100000:0.0:1746127010.067804:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994334720 00000004:00080000:1.0:1746127010.067806:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2300, transno 17179875658 00000100:00100000:0.0:1746127010.067807:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994334720 00000004:00080000:1.0:1746127010.067808:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1f80, transno 17179875659 00000004:00080000:1.0:1746127010.067810:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba56a00, transno 17179875660 00000004:00080000:1.0:1746127010.067812:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0a80, transno 17179875661 00000004:00080000:1.0:1746127010.067814:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0700, transno 17179875662 00000004:00080000:1.0:1746127010.067816:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1c00, transno 17179875663 00000100:00100000:0.0:1746127010.067820:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994336384 00000100:00100000:1.0:1746127010.067821:0:3785:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880094e6ea00 x1830945994334848/t17179875668(17179875668) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127026 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:0.0:1746127010.067821:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994336384 00000100:00100000:0.0:1746127010.067829:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994335232 00000100:00100000:0.0:1746127010.067831:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994335232 00000100:00100000:0.0:1746127010.067837:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994335744 00000100:00100000:0.0:1746127010.067839:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994335744 00000100:00100000:0.0:1746127010.067849:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22091 00000100:00100000:0.0:1746127010.067853:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3784:x1830945994334720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127010.067897:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127010.067900:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127010.067901:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127010.067903:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127010.067905:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746127010.067923:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22092 00000100:00100000:0.0:1746127010.067923:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3784:x1830945994334720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (237us total) trans 21474842944 rc 0/0 00000100:00100000:0.0:1746127010.067929:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22091 00000100:00100000:3.0:1746127010.067930:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3785:x1830945994336384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127010.067938:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22093 00000100:00100000:0.0:1746127010.067942:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3784:x1830945994335232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127010.067981:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746127010.067983:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746127010.067983:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127010.067984:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127010.067986:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127010.067986:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127010.067987:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00002000:00010000:3.0:1746127010.067988:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127010.067989:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:3.0:1746127010.067991:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746127010.068021:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3784:x1830945994335232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (283us total) trans 21474842945 rc 0/0 00000100:00100000:0.0:1746127010.068026:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22093 00000100:00100000:3.0:1746127010.068029:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3785:x1830945994336384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (309us total) trans 17179875670 rc 0/0 00000100:00100000:3.0:1746127010.068035:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22092 00000100:00100000:0.0:1746127010.068039:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22094 00000100:00100000:0.0:1746127010.068043:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3784:x1830945994335744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127010.068078:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:0.0:1746127010.068080:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127010.068082:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127010.068083:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127010.068085:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:0.0:1746127010.068103:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3784:x1830945994335744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (331us total) trans 21474842946 rc 0/0 00000100:00100000:0.0:1746127010.068107:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22094 00000004:00080000:1.0:1746127010.068158:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e6ea00/2, rc 0, transno 17179875668 00000100:00100000:1.0:1746127010.068162:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994334848:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127010.068176:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f3480/2, rc 0, transno 21474842943 00000100:00100000:1.0:1746127010.068179:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994335360:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127010.068192:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e6f100/2, rc 0, transno 17179875669 00000100:00100000:1.0:1746127010.068194:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994335872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127010.068200:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8ee8e00/2, rc 0, transno 17179875670 00000100:00100000:1.0:1746127010.068202:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994336384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.068206:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746127010.068209:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994336768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.068227:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.068245:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994335104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.068258:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.068267:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994335616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.068278:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.068285:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994336128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.068295:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.068303:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994336640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.068313:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.068335:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994336768 00000100:00100000:1.0:1746127010.068337:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994336768 00000100:00100000:1.0:1746127010.068348:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994335104 00000100:00100000:1.0:1746127010.068349:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994335104 00000100:00100000:1.0:1746127010.068356:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994335616 00000100:00100000:1.0:1746127010.068358:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994335616 00000100:00100000:1.0:1746127010.068364:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994336128 00000100:00100000:1.0:1746127010.068365:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994336128 00000100:00100000:1.0:1746127010.068370:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994336640 00000100:00100000:1.0:1746127010.068372:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994336640 00000100:00100000:1.0:1746127010.068378:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22095 00000100:00100000:1.0:1746127010.068381:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3785:x1830945994336768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.068398:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994336256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.068418:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.068434:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3785:x1830945994336768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (206us total) trans 21474842947 rc 0/0 00000004:00080000:2.0:1746127010.068439:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22f480/2, rc 0, transno 21474842944 00000100:00100000:2.0:1746127010.068442:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994334720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.068442:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22095 00000004:00080000:2.0:1746127010.068447:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f1f80/2, rc 0, transno 21474842945 00000100:00100000:1.0:1746127010.068449:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994336256 00000100:00100000:2.0:1746127010.068450:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994335232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.068451:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994336256 00000004:00080000:2.0:1746127010.068455:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c429880/2, rc 0, transno 21474842946 00000100:00100000:2.0:1746127010.068458:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994335744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.068459:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22096 00000100:00100000:1.0:1746127010.068463:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3783:x1830945994335104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.068471:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.068482:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994336512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.068497:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746127010.068497:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:1.0:1746127010.068499:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:1.0:1746127010.068501:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127008 -> 1746127008 00002000:00010000:1.0:1746127010.068503:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:1.0:1746127010.068505:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000004:00080000:2.0:1746127010.068508:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c428700/2, rc 0, transno 21474842942 00000100:00100000:2.0:1746127010.068510:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994335488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127010.068516:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994336000 00000100:00100000:3.0:1746127010.068520:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994336000 00000100:00100000:1.0:1746127010.068521:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3783:x1830945994335104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (262us total) trans 21474842948 rc 0/0 00000100:00100000:1.0:1746127010.068526:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22096 00000100:00100000:3.0:1746127010.068533:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994336512 00000100:00100000:3.0:1746127010.068535:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994336512 00000100:00100000:1.0:1746127010.068535:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22097 00000100:00100000:1.0:1746127010.068539:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3783:x1830945994335616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127010.068545:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22098 00000100:00100000:3.0:1746127010.068549:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3783:x1830945994336128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127010.068569:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127010.068571:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127010.068573:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127010.068575:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127010.068576:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00002000:00010000:3.0:1746127010.068593:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746127010.068593:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3783:x1830945994335616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (313us total) trans 21474842949 rc 0/0 00002000:00010000:3.0:1746127010.068595:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127010.068597:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00000100:00100000:1.0:1746127010.068597:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22097 00002000:00010000:3.0:1746127010.068599:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127010.068600:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:1.0:1746127010.068605:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22099 00000100:00100000:1.0:1746127010.068609:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994336640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127010.068623:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994336128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (327us total) trans 17179875671 rc 0/0 00000100:00100000:3.0:1746127010.068628:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22098 00000100:00100000:3.0:1746127010.068639:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22100 00000100:00100000:3.0:1746127010.068643:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3784:x1830945994336256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127010.068657:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22101 00000100:00100000:3.0:1746127010.068661:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994336000:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127010.068674:0:8233:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 32 done 00000100:00100000:1.0:1746127010.069354:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3783:x1830945994336640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 743us (1039us total) trans 17179875672 rc 0/0 00000100:00100000:1.0:1746127010.069361:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22099 00000100:00100000:1.0:1746127010.069372:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22102 00000100:00100000:1.0:1746127010.069377:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994336512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127010.069398:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3784:x1830945994336256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 754us (978us total) trans 17179875673 rc 0/0 00000100:00100000:3.0:1746127010.069404:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22100 00000004:00080000:2.0:1746127010.069410:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8ee8700/2, rc 0, transno 17179875673 00000100:00100000:2.0:1746127010.069414:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994336256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.069436:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994336512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (938us total) trans 17179875674 rc 0/0 00000004:00080000:2.0:1746127010.069439:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8ee8000/2, rc 0, transno 17179875674 00000100:00100000:2.0:1746127010.069441:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994336512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.069441:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22102 00002000:00010000:3.0:1746127010.069451:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127010.069453:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:3.0:1746127010.069455:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:3.0:1746127010.069457:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:3.0:1746127010.069459:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000004:00080000:1.0:1746127010.069460:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4cf480/2, rc 0, transno 21474842948 00000100:00100000:1.0:1746127010.069463:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994335104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127010.069470:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c42b800/2, rc 0, transno 21474842949 00000100:00100000:1.0:1746127010.069472:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c42b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994335616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127010.069479:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e6c700/2, rc 0, transno 17179875671 00000100:00100000:3.0:1746127010.069482:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994336000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 820us (1010us total) trans 17179875675 rc 0/0 00000100:00100000:1.0:1746127010.069482:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994336128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127010.069487:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22101 00000004:00080000:1.0:1746127010.069487:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8ee9500/2, rc 0, transno 17179875672 00000100:00100000:1.0:1746127010.069489:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994336640:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127010.069510:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c428a80/2, rc 0, transno 21474842947 00000100:00100000:1.0:1746127010.069513:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994336768:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127010.069615:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e6dc00/2, rc 0, transno 17179875675 00000100:00100000:2.0:1746127010.069619:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994336000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127010.069635:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.069845:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991864704 00000100:00100000:0.0:1746127010.069850:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991864704 00000100:00100000:0.0:1746127010.069887:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17381 00000100:00100000:0.0:1746127010.069892:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4551:x1830945991864704:12345-192.168.203.42@tcp:101:mirror_io.0 00010000:00010000:0.0:1746127010.069904:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.069916:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53daf expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.069952:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.069962:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.069975:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127010.069977:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127010.069980:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f121000, rc 0) 00000100:00100000:0.0:1746127010.070029:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4551:x1830945991864704:12345-192.168.203.42@tcp:101:mirror_io.0 Request processed in 136us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.070033:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17381 00000100:00100000:0.0:1746127010.073619:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.074328:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991864832 00000100:00100000:1.0:1746127010.074336:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991864832 00000100:00100000:1.0:1746127010.074385:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1037 00000100:00100000:1.0:1746127010.074392:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4551:x1830945991864832:12345-192.168.203.42@tcp:103:mirror_io.0 00010000:00010000:1.0:1746127010.074402:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.074425:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb062 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d5b expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.074452:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.074457:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.074501:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4551:x1830945991864832:12345-192.168.203.42@tcp:103:mirror_io.0 Request processed in 109us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.074508:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1037 00000100:00100000:0.0:1746127010.075635:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.075707:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991865088 00000100:00100000:2.0:1746127010.075711:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991865088 00000100:00100000:2.0:1746127010.075735:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6648 00000100:00100000:2.0:1746127010.075904:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4551:x1830945991865088:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:2.0:1746127010.076063:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4551:x1830945991865088:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 322us (429us total) trans 8589938346 rc 0/0 00000100:00100000:2.0:1746127010.076069:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6648 00000100:00100000:0.0:1746127010.077355:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.077416:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991865344 00000100:00100000:3.0:1746127010.077424:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991865344 00000100:00100000:3.0:1746127010.077458:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6649 00000100:00100000:3.0:1746127010.077465:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4551:x1830945991865344:12345-192.168.203.42@tcp:35:mirror_io.0 00000100:00100000:3.0:1746127010.077640:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4551:x1830945991865344:12345-192.168.203.42@tcp:35:mirror_io.0 Request processed in 174us (290us total) trans 8589938347 rc 0/0 00000100:00100000:3.0:1746127010.077646:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6649 00000100:00100000:0.0:1746127010.101265:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.101442:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991865600 00000100:00100000:2.0:1746127010.101451:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991865600 00000100:00100000:2.0:1746127010.101499:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17382 00000100:00100000:2.0:1746127010.101505:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4556:x1830945991865600:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.101871:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.101896:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093605e00/0x34dc807b6efb0f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53db6 expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.101978:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.101992:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102002:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102028:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102033:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102038:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102171:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9600/0x34dc807b6efb10a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102183:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9600/0x34dc807b6efb10a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102188:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9600/0x34dc807b6efb10a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127010.102197:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127010.102269:0:10958:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102274:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102279:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102284:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102290:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093605800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127010.102294:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102300:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102310:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127010.102312:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127010.102316:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102320:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093605800/0x34dc807b6efb0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102355:0:10958:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102361:0:10958:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102365:0:10958:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102368:0:10958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88006f3e9c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127010.102370:0:10958:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102374:0:10958:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102379:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58a600) 00010000:00010000:2.0:1746127010.102381:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127010.102383:0:10958:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102387:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9c00/0x34dc807b6efb103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.102422:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093605e00/0x34dc807b6efb0f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53db6 expref: 11 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.102431:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9600/0x34dc807b6efb10a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53db6 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.102437:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.102439:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127010.102441:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e9600, rc 0) 00000100:00100000:2.0:1746127010.102500:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4556:x1830945991865600:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 994us (1245us total) trans 8589938348 rc 0/0 00000100:00100000:2.0:1746127010.102506:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17382 00000100:00100000:0.0:1746127010.106259:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.106319:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991865856 00000100:00100000:2.0:1746127010.106328:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991865856 00000100:00100000:2.0:1746127010.106377:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17383 00000100:00100000:2.0:1746127010.106384:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4556:x1830945991865856:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.106408:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.106412:0:10958:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746127010.106437:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e9600/0x34dc807b6efb10a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53db6 expref: 10 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.106454:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.106458:0:10958:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127010.106469:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8400/0x34dc807b6efb118 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53dbd expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.106517:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.106530:0:10958:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.106536:0:10958:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.106566:0:10958:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.106582:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 8 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.106593:0:10958:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994336896:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.106682:0:10958:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.110419:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.110538:0:10958:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10958:1830945994336896:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.110566:0:10958:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:1.0:1746127010.110636:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991865984 00000100:00100000:1.0:1746127010.110642:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991865984 00010000:00010000:1.0:1746127010.110674:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.110698:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10413 00000100:00100000:1.0:1746127010.110704:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991865984:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.110718:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.110724:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.110734:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.110755:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121000/0x34dc807b6efb0ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53daf expref: 9 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.110772:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.110776:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127010.110790:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127010.111091:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10958 initiator: MDT0 00010000:00010000:1.0:1746127010.111119:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127010.111160:0:10958:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127010.111166:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000100:00100000:1.0:1746127010.111185:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991865984:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 480us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.111191:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10413 00000040:00080000:2.0:1746127010.111894:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1444, 88 off134680 00000004:00080000:2.0:1746127010.111901:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905153770570ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.112316:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1457, 88 off135912 00000004:00080000:2.0:1746127010.112321:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905154191752ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127010.112444:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1458, 88 off136000 00000004:00080000:2.0:1746127010.112449:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905154319461ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127010.112458:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1445, 88 off134768 00000004:00080000:2.0:1746127010.112461:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154331497ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.112470:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1446, 88 off134856 00000004:00080000:2.0:1746127010.112473:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154343551ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.112481:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1459, 88 off136088 00000004:00080000:2.0:1746127010.112483:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905154354105ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127010.112491:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1460, 88 off136176 00000004:00080000:2.0:1746127010.112493:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905154364035ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127010.112501:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1461, 88 off136264 00000004:00080000:2.0:1746127010.112503:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905154374008ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127010.112510:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1447, 88 off134944 00000004:00080000:2.0:1746127010.112513:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154383536ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.112520:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1462, 88 off136352 00000004:00080000:2.0:1746127010.112522:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905154392618ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127010.112529:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1448, 88 off135032 00000004:00080000:2.0:1746127010.112531:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154401578ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.112538:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1463, 88 off136440 00000004:00080000:2.0:1746127010.112542:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905154412466ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127010.112548:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1449, 88 off135120 00000004:00080000:2.0:1746127010.112551:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154421868ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.112657:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1450, 88 off135208 00000004:00080000:2.0:1746127010.112661:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154531608ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.113103:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1451, 88 off135296 00000004:00080000:2.0:1746127010.113107:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154978033ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.113116:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1452, 88 off135384 00000004:00080000:2.0:1746127010.113119:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 905154989331ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127010.113143:0:10958:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1464, 88 off136528 00000004:00080000:2.0:1746127010.113147:0:10958:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 905155017925ns, next at 895431202182ns, rc = 0 00000100:00100000:0.0:1746127010.115152:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000001:00080000:1.0:1746127010.115259:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938349 is committed 00000004:00080000:1.0:1746127010.115267:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1438 committed 00000004:00080000:1.0:1746127010.115288:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1426 committed 00000004:00080000:1.0:1746127010.115299:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1425 committed 00000004:00080000:1.0:1746127010.115301:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1424 committed 00000004:00080000:1.0:1746127010.115303:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1423 committed 00000004:00080000:1.0:1746127010.115305:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1437 committed 00000004:00080000:1.0:1746127010.115306:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1422 committed 00000004:00080000:1.0:1746127010.115308:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1436 committed 00000004:00080000:1.0:1746127010.115309:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1421 committed 00000004:00080000:1.0:1746127010.115311:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1435 committed 00000004:00080000:1.0:1746127010.115312:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1434 committed 00000004:00080000:1.0:1746127010.115314:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1433 committed 00000004:00080000:1.0:1746127010.115315:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1420 committed 00000004:00080000:1.0:1746127010.115317:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1419 committed 00000004:00080000:1.0:1746127010.115318:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1432 committed 00000004:00080000:1.0:1746127010.115319:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1431 committed 00000004:00080000:1.0:1746127010.115321:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1418 committed 00000001:00080000:1.0:1746127010.115328:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938347 is committed 00000100:00100000:3.0:1746127010.115386:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991866240 00000100:00100000:3.0:1746127010.115395:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991866240 00000100:00100000:3.0:1746127010.115443:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17384 00000100:00100000:3.0:1746127010.115450:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4559:x1830945991866240:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.115470:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.115488:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6efb126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53dc4 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.115561:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.115572:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337152:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746127010.115574:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115585:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115598:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115604:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115609:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.115619:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.115644:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.115659:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.115667:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337152 00000100:00100000:0.0:1746127010.115670:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337152 00000100:00100000:2.0:1746127010.115676:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.115692:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337664 00000100:00100000:0.0:1746127010.115694:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337664 00010000:00010000:3.0:1746127010.115698:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115705:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127010.115706:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22103 00010000:00010000:3.0:1746127010.115711:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127010.115711:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994337152:12345-0@lo:2:osp-syn-1-0.0 00000004:00200000:3.0:1746127010.115719:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127010.115778:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115784:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115790:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115794:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009450d800 already unused, calling callback (ffffffffa0f14690) 00002000:00010000:0.0:1746127010.115797:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00010000:00010000:3.0:1746127010.115798:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00002000:00010000:0.0:1746127010.115800:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.115802:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00010000:00010000:3.0:1746127010.115804:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00002000:00010000:0.0:1746127010.115804:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.115805:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00010000:00010000:3.0:1746127010.115814:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.115816:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746127010.115820:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115824:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb13b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127010.115833:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3782:x1830945994337152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (214us total) trans 17179875676 rc 0/0 00000100:00100000:2.0:1746127010.115835:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.115839:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22103 00010000:00010000:3.0:1746127010.115843:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115848:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.115850:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.115851:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338176 00010000:00010000:3.0:1746127010.115852:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127010.115853:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338176 00010000:00010000:3.0:1746127010.115857:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115861:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127010.115863:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.115865:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.115866:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22104 00010000:00010000:3.0:1746127010.115868:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127010.115870:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994337664:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746127010.115874:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127010.115876:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127010.115878:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115882:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb12d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115888:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00000004:00080000:2.0:1746127010.115894:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d2a00/2, rc 0, transno 17179875676 00010000:00010000:3.0:1746127010.115896:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.115898:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337152:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746127010.115901:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.115905:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82e00 already unused, calling callback (ffffffffa0f14690) 00000100:00100000:2.0:1746127010.115905:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00010000:00010000:3.0:1746127010.115907:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00002000:00010000:0.0:1746127010.115907:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00000100:00100000:2.0:1746127010.115910:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337280:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127010.115910:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00010000:00010000:3.0:1746127010.115911:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00002000:00010000:0.0:1746127010.115912:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127010.115914:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127010.115915:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:2.0:1746127010.115929:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.115934:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3782:x1830945994337664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (273us total) trans 17179875677 rc 0/0 00000100:00100000:0.0:1746127010.115939:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22104 00000100:00100000:2.0:1746127010.115942:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.115955:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.115965:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.115975:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.115984:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.115995:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746127010.116022:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b99180/2, rc 0, transno 17179875677 00000100:00100000:2.0:1746127010.116025:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.116034:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338688 00000100:00100000:1.0:1746127010.116038:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338688 00000100:00100000:2.0:1746127010.116039:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.116054:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337280 00000100:00100000:1.0:1746127010.116055:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337280 00000100:00100000:1.0:1746127010.116060:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337792 00000100:00100000:1.0:1746127010.116062:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337792 00000100:00100000:1.0:1746127010.116066:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338304 00000100:00100000:1.0:1746127010.116068:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338304 00000100:00100000:1.0:1746127010.116074:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338816 00000100:00100000:1.0:1746127010.116075:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338816 00000100:00100000:1.0:1746127010.116084:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22105 00000100:00100000:0.0:1746127010.116087:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22106 00000100:00100000:1.0:1746127010.116088:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3782:x1830945994338176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.116091:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.116091:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3782:x1830945994338688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.116100:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.116112:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.116118:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.116148:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.116156:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337408 00000100:00100000:2.0:1746127010.116157:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.116159:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337408 00002000:00010000:1.0:1746127010.116166:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127010.116169:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00000100:00100000:0.0:1746127010.116169:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337920 00000100:00100000:0.0:1746127010.116170:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337920 00000100:00100000:2.0:1746127010.116171:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746127010.116171:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:1.0:1746127010.116172:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:1.0:1746127010.116174:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127010.116176:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338432 00000100:00100000:0.0:1746127010.116178:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338432 00000100:00100000:2.0:1746127010.116180:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746127010.116183:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127010.116183:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338944 00000100:00100000:0.0:1746127010.116185:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338944 00000100:00100000:0.0:1746127010.116192:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22107 00000100:00100000:2.0:1746127010.116195:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.116196:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3782:x1830945994337280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.116200:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3782:x1830945994338176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (366us total) trans 21474842950 rc 0/0 00000100:00100000:2.0:1746127010.116203:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127010.116205:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22105 00000100:00100000:1.0:1746127010.116212:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337024 00000100:00100000:2.0:1746127010.116213:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.116214:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337024 00000100:00100000:2.0:1746127010.116218:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.116223:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994337536 00000100:00100000:1.0:1746127010.116224:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994337536 00000100:00100000:2.0:1746127010.116229:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127010.116230:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338048 00000100:00100000:1.0:1746127010.116232:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338048 00000100:00100000:2.0:1746127010.116234:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338560:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127010.116235:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127010.116237:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.116239:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00000100:00100000:1.0:1746127010.116240:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22108 00002000:00010000:0.0:1746127010.116240:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.116242:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746127010.116243:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994337792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.116244:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.116259:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994338560 00000100:00100000:0.0:1746127010.116261:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994337280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (330us total) trans 17179875678 rc 0/0 00000100:00100000:2.0:1746127010.116262:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994338560 00000100:00100000:0.0:1746127010.116265:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22107 00000100:00100000:0.0:1746127010.116275:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22109 00000100:00100000:2.0:1746127010.116279:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22110 00000100:00100000:0.0:1746127010.116280:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3782:x1830945994338304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.116284:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3782:x1830945994338816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.116289:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994337792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (333us total) trans 17179875679 rc 0/0 00000100:00100000:1.0:1746127010.116297:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22108 00000100:00100000:1.0:1746127010.116305:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22111 00000100:00100000:1.0:1746127010.116309:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994337408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127010.116315:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127010.116317:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.116319:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.116320:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.116322:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00002000:00010000:2.0:1746127010.116335:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746127010.116337:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00000100:00100000:0.0:1746127010.116337:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3782:x1830945994338304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (361us total) trans 21474842952 rc 0/0 00002000:00010000:2.0:1746127010.116339:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127010.116341:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127010.116341:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127010.116343:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00002000:00010000:1.0:1746127010.116343:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127010.116345:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00000100:00100000:0.0:1746127010.116345:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22109 00002000:00010000:1.0:1746127010.116347:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127010.116349:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746127010.116354:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22112 00000100:00100000:0.0:1746127010.116357:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994337920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.116363:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3782:x1830945994338816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (366us total) trans 21474842953 rc 0/0 00000100:00100000:2.0:1746127010.116368:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22110 00000100:00100000:1.0:1746127010.116368:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994337408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (276us total) trans 17179875680 rc 0/0 00000100:00100000:1.0:1746127010.116372:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22111 00000100:00100000:2.0:1746127010.116379:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22113 00000100:00100000:1.0:1746127010.116382:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22114 00000100:00100000:2.0:1746127010.116383:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3784:x1830945994338432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127010.116386:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3784:x1830945994338944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.116403:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994337920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (290us total) trans 17179875681 rc 0/0 00000100:00100000:0.0:1746127010.116408:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22112 00000100:00100000:0.0:1746127010.116417:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22115 00002000:00010000:2.0:1746127010.116419:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00000100:00100000:0.0:1746127010.116420:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994337024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127010.116422:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127010.116423:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127010.116425:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00000004:00080000:1.0:1746127010.116426:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b9aa00/2, rc 0, transno 17179875678 00002000:00010000:2.0:1746127010.116427:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:1.0:1746127010.116429:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127010.116436:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b9b480/2, rc 0, transno 17179875679 00000100:00100000:1.0:1746127010.116438:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994337792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127010.116445:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994338432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (297us total) trans 21474842954 rc 0/0 00000004:00080000:1.0:1746127010.116445:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c05500/2, rc 0, transno 21474842952 00000100:00100000:2.0:1746127010.116450:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22113 00000100:00100000:1.0:1746127010.116452:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338304:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127010.116453:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127010.116455:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127008 -> 1746127008 00002000:00010000:0.0:1746127010.116457:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127008 -> 1746127008 00000004:00080000:1.0:1746127010.116458:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a74a80/2, rc 0, transno 21474842953 00002000:00010000:0.0:1746127010.116458:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127008 -> 1746127008 00000100:00100000:2.0:1746127010.116460:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22116 00002000:00010000:0.0:1746127010.116460:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746127010.116461:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.116465:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994337536:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127010.116466:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c05180/2, rc 0, transno 21474842950 00000100:00100000:1.0:1746127010.116469:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.116476:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994337024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (280us total) trans 17179875682 rc 0/0 00000100:00100000:0.0:1746127010.116480:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22115 00000100:00100000:1.0:1746127010.116484:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22117 00000100:00100000:1.0:1746127010.116488:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3784:x1830945994338048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.116490:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22118 00000100:00100000:0.0:1746127010.116493:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3784:x1830945994338560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.116517:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994337536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (303us total) trans 17179875683 rc 0/0 00000100:00100000:2.0:1746127010.116521:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22116 00000100:00100000:0.0:1746127010.116536:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994338560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (290us total) trans 21474842957 rc 0/0 00000100:00100000:0.0:1746127010.116540:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22118 00000004:00080000:2.0:1746127010.116541:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801303d1180/2, rc 0, transno 17179875682 00000100:00100000:2.0:1746127010.116544:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127010.116549:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b99f80/2, rc 0, transno 17179875683 00000100:00100000:2.0:1746127010.116552:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337536:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127010.116558:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd64700/2, rc 0, transno 21474842957 00000100:00100000:2.0:1746127010.116561:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338560:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127010.116567:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b98a80/2, rc 0, transno 17179875680 00000100:00100000:2.0:1746127010.116569:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337408:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127010.116575:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b9b800/2, rc 0, transno 17179875681 00000100:00100000:2.0:1746127010.116577:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994337920:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127010.116582:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd64e00/2, rc 0, transno 21474842954 00000100:00100000:2.0:1746127010.116585:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127010.116589:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746127010.116594:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994339072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127010.116600:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3782:x1830945994338688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 508us (734us total) trans 21474842951 rc 0/0 00000100:00100000:0.0:1746127010.116604:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22106 00000100:00100000:2.0:1746127010.116611:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127010.116627:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994339072 00000100:00100000:0.0:1746127010.116631:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994339072 00000100:00100000:0.0:1746127010.116644:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22119 00000100:00100000:0.0:1746127010.116648:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994339072:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746127010.116662:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 13 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.116670:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.116673:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746127010.116684:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8400/0x34dc807b6efb118 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 13 pid: 10958 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746127010.116694:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662ef00) 00010000:00010000:3.0:1746127010.116696:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127010.116696:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 12 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.116700:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.116705:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82e00/0x34dc807b6efb134 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.116714:0:10958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.116716:0:10958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746127010.116717:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8000, rc 0) 00010000:00010000:3.0:1746127010.116738:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6efb126 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dc4 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.116743:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6efb126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dc4 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.116750:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b83400, rc 0) 00000100:00100000:2.0:1746127010.116750:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4556:x1830945991865856:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10367us (10502us total) trans 8589938349 rc 0/0 00000100:00100000:2.0:1746127010.116756:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17383 00000100:00100000:3.0:1746127010.116767:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4559:x1830945991866240:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1318us (1643us total) trans 8589938350 rc 301/301 00000100:00100000:3.0:1746127010.116772:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17384 00000100:00100000:0.0:1746127010.116804:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994339072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (188us total) trans 21474842958 rc 0/0 00000100:00100000:0.0:1746127010.116809:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22119 00000004:00080000:1.0:1746127010.117114:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd64000/2, rc 0, transno 21474842951 00000100:00100000:1.0:1746127010.117118:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994338688:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127010.117176:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:1.0:1746127010.117178:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127010.117180:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127010.117182:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127010.117183:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:1.0:1746127010.117203:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994338944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 816us (1030us total) trans 21474842955 rc 0/0 00000100:00100000:1.0:1746127010.117208:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22114 00002000:00010000:0.0:1746127010.117335:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127010.117337:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127010.117339:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127010.117341:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127007 -> 1746127007 00002000:00010000:0.0:1746127010.117343:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746127010.117362:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3784:x1830945994338048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 874us (1132us total) trans 21474842956 rc 0/0 00000100:00100000:0.0:1746127010.117366:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22117 00000004:00080000:2.0:1746127010.117469:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a77b80/2, rc 0, transno 21474842958 00000100:00100000:2.0:1746127010.117473:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994339072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127010.117479:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c07100/2, rc 0, transno 21474842956 00000100:00100000:2.0:1746127010.117481:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338048:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127010.117486:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a75500/2, rc 0, transno 21474842955 00000100:00100000:2.0:1746127010.117489:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994338944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127010.120619:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.120673:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.120718:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991866624 00000100:00100000:1.0:1746127010.120726:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991866624 00000100:00100000:0.0:1746127010.120731:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991866496 00000100:00100000:0.0:1746127010.120735:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991866496 00000100:00100000:1.0:1746127010.120765:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22120 00000100:00100000:0.0:1746127010.120770:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6650 00000100:00100000:1.0:1746127010.120771:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4556:x1830945991866624:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:0.0:1746127010.120775:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4559:x1830945991866496:12345-192.168.203.42@tcp:35:cat.0 00010000:00010000:1.0:1746127010.120786:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.120804:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53dcb expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.120827:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.120834:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.120835:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.120838:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1400832->1511423] (req 1400832->1511423) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 8 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.120866:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.120877:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 31 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.120888:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994339200:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127010.120956:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.121492:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4559:x1830945991866496:12345-192.168.203.42@tcp:35:cat.0 Request processed in 714us (995us total) trans 8589938351 rc 0/0 00000100:00100000:0.0:1746127010.121498:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6650 00000100:00100000:1.0:1746127010.122687:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994339200:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127010.122714:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1400832->1511423] (req 1400832->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 8 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.122728:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bd600, rc 0) 00000100:00100000:1.0:1746127010.122771:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4556:x1830945991866624:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2000us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.122778:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22120 00000100:00100000:0.0:1746127010.123054:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.123548:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.123566:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991866752 00000100:00100000:1.0:1746127010.123572:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991866752 00010000:00010000:1.0:1746127010.123593:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.123614:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10414 00000100:00100000:1.0:1746127010.123619:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991866752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.123629:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.123647:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.123656:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.123676:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd02e00/0x34dc807b6efb0e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da1 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.123697:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.123698:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127010.123704:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991866880 00010000:00010000:1.0:1746127010.123704:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 7 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.123709:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991866880 00010000:00010000:1.0:1746127010.123711:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 7 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.123734:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 7 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.123743:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994339328:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127010.123744:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17385 00000100:00100000:3.0:1746127010.123750:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4559:x1830945991866880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.123768:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.123781:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb150 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53dd2 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.123790:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00010000:00010000:3.0:1746127010.123857:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.123869:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.123878:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:3.0:1746127010.123902:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127010.123906:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127010.123921:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.123940:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb150 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 13 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.123960:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.123967:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.123970:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127010.123973:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450dc00, rc 0) 00000100:00100000:3.0:1746127010.123993:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4559:x1830945991866880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 244us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.123999:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17385 00000100:00100000:1.0:1746127010.125268:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994339328:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127010.125284:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.125326:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991866752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1706us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.125333:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10414 00000100:00100000:0.0:1746127010.126339:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.126368:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.126382:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991867136 00000100:00100000:2.0:1746127010.126389:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991867136 00000100:00100000:1.0:1746127010.126403:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991867264 00000100:00100000:1.0:1746127010.126406:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991867264 00000100:00100000:0.0:1746127010.126423:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:2.0:1746127010.126428:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1400832->1404927) req@ffff880130a74e00 x1830945991867136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.126438:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a74e00 with x1830945991867136 ext(1400832->1404927) 00002000:00010000:2.0:1746127010.126442:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a74e00 00000100:00100000:2.0:1746127010.126464:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8866 00000100:00100000:2.0:1746127010.126471:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991867136:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127010.126559:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991867392 00000100:00100000:3.0:1746127010.126563:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991867392 00000100:00100000:3.0:1746127010.126592:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22121 00000100:00100000:2.0:1746127010.126596:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2026:x1830945991867136:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 126us (259us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127010.126597:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2027:x1830945991867264:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127010.126601:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8866 00002000:00100000:2.0:1746127010.126605:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1400832->1404927) req@ffff880130a74e00 x1830945991867136/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746127010.126606:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746127010.126611:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a74e00 with x1830945991867136 ext(1400832->1404927) 00002000:00010000:2.0:1746127010.126614:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a74e00 00010000:00010000:3.0:1746127010.126622:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53dd9 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.126639:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.126641:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.126648:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.126662:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 28 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.126671:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450ce00, rc 0) 00000100:00100000:3.0:1746127010.126693:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2027:x1830945991867264:12345-192.168.203.42@tcp:101:cat.0 Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.126698:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22121 00000100:00100000:3.0:1746127010.126708:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22122 00000100:00100000:3.0:1746127010.126712:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991867392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.126720:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.126728:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53de0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.126739:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.126741:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.126745:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.126754:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 9 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.126760:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d800, rc 0) 00000100:00100000:3.0:1746127010.127493:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991867392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 776us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.127500:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22122 00000100:00100000:0.0:1746127010.127658:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.128568:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.128610:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.128664:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991867648 00000100:00100000:3.0:1746127010.128671:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991867648 00000100:00100000:3.0:1746127010.128695:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991867520 00000100:00100000:3.0:1746127010.128697:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991867520 00000100:00100000:3.0:1746127010.128706:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991867776 00000100:00100000:3.0:1746127010.128708:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991867776 00000100:00100000:3.0:1746127010.128722:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22123 00000100:00100000:3.0:1746127010.128728:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991867648:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.128742:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.128756:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53dee expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.128779:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.128780:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.128786:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.128799:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.128809:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82600, rc 0) 00000100:00100000:3.0:1746127010.128838:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991867648:12345-192.168.203.42@tcp:101:cat.0 Request processed in 110us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.128843:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22123 00000100:00100000:3.0:1746127010.128854:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22124 00000100:00100000:3.0:1746127010.128858:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991867520:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.128862:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127010.128865:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22125 00010000:00010000:3.0:1746127010.128868:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53de7 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127010.128873:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991867776:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.128878:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.128880:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.128881:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.128883:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 30 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.128891:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 30 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.128891:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53df5 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.128901:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b83600, rc 0) 00010000:00010000:0.0:1746127010.128904:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.128905:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.128910:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127010.128915:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991867520:12345-192.168.203.42@tcp:101:cat.0 Request processed in 56us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.128919:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22124 00010000:00010000:0.0:1746127010.128921:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 10 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.128928:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e8e6c00, rc 0) 00000100:00100000:0.0:1746127010.128946:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2027:x1830945991867776:12345-192.168.203.42@tcp:101:cat.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.128952:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22125 00000100:00100000:0.0:1746127010.130610:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.131791:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991868032 00000100:00100000:2.0:1746127010.131801:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991868032 00002000:00100000:2.0:1746127010.131843:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1507328->1511423) req@ffff88009c4cc000 x1830945991868032/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.131852:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc000 with x1830945991868032 ext(1507328->1511423) 00002000:00010000:2.0:1746127010.131857:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cc000 00000100:00100000:2.0:1746127010.132416:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8867 00000100:00100000:2.0:1746127010.132425:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991868032:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127010.132615:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2028:x1830945991868032:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 191us (2009us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127010.132622:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8867 00002000:00100000:2.0:1746127010.132629:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1507328->1511423) req@ffff88009c4cc000 x1830945991868032/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.132635:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4cc000 with x1830945991868032 ext(1507328->1511423) 00002000:00010000:2.0:1746127010.132639:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4cc000 00000100:00100000:0.0:1746127010.135042:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.135168:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991868288 00000100:00100000:1.0:1746127010.135176:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991868288 00000100:00100000:1.0:1746127010.135226:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6651 00000100:00100000:1.0:1746127010.135234:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4556:x1830945991868288:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127010.135452:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4556:x1830945991868288:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 219us (417us total) trans 8589938352 rc 0/0 00000100:00100000:1.0:1746127010.135459:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6651 00000100:00100000:0.0:1746127010.138401:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.138652:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.138679:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.138711:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.138774:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991868544 00000100:00100000:3.0:1746127010.138783:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991868544 00002000:00100000:3.0:1746127010.138826:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012d22c380 x1830945991868544/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.138836:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c380 with x1830945991868544 ext(0->1048575) 00002000:00010000:3.0:1746127010.138840:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22c380 00000100:00100000:3.0:1746127010.138968:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991868800 00000100:00100000:3.0:1746127010.138970:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991868800 00002000:00100000:3.0:1746127010.138982:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012d22c000 x1830945991868800/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.138989:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c000 with x1830945991868800 ext(1048576->2097151) 00002000:00010000:3.0:1746127010.138991:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22c000 00000100:00100000:1.0:1746127010.139020:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991869056 00000100:00100000:1.0:1746127010.139024:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991869056 00002000:00100000:1.0:1746127010.139038:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012d22ca80 x1830945991869056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 504/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.139043:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22ca80 with x1830945991869056 ext(1048576->2097151) 00002000:00010000:1.0:1746127010.139046:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22ca80 00000100:00100000:1.0:1746127010.139053:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991869312 00000100:00100000:1.0:1746127010.139055:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991869312 00002000:00100000:1.0:1746127010.139061:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012d22c700 x1830945991869312/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.139066:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c700 with x1830945991869312 ext(1048576->2097151) 00002000:00010000:1.0:1746127010.139068:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22c700 00000100:00100000:1.0:1746127010.139089:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8868 00000100:00100000:1.0:1746127010.139097:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2026:x1830945991868544:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.139845:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8869 00000100:00100000:1.0:1746127010.139853:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991868800:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.140602:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8870 00000100:00100000:0.0:1746127010.140612:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991869056:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127010.141205:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8871 00000100:00100000:2.0:1746127010.141245:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991869312:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.149540:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991868544:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10432us (11136us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127010.149552:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8868 00002000:00100000:1.0:1746127010.149563:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012d22c380 x1830945991868544/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.149572:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c380 with x1830945991868544 ext(0->1048575) 00002000:00010000:1.0:1746127010.149578:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22c380 00000100:00100000:1.0:1746127010.153567:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991868800:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13702us (14902us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127010.153581:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8869 00002000:00100000:1.0:1746127010.153593:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012d22c000 x1830945991868800/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.153602:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c000 with x1830945991868800 ext(1048576->2097151) 00002000:00010000:1.0:1746127010.153608:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22c000 00000100:00100000:2.0:1746127010.157292:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991869056:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16672us (18602us total) trans 0 rc 937984/937984 00000100:00100000:2.0:1746127010.157304:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8870 00002000:00100000:2.0:1746127010.157315:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88012d22ca80 x1830945991869056/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 504/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.157325:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22ca80 with x1830945991869056 ext(1048576->2097151) 00002000:00010000:2.0:1746127010.157331:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22ca80 00000100:00100000:2.0:1746127010.159831:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991869312:12345-192.168.203.42@tcp:3:cat.0 Request processed in 18610us (21110us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127010.159844:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8871 00002000:00100000:2.0:1746127010.159853:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012d22c700 x1830945991869312/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.159863:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c700 with x1830945991869312 ext(1048576->2097151) 00002000:00010000:2.0:1746127010.159869:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22c700 00000100:00100000:0.0:1746127010.174306:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.174363:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.174464:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991869568 00000100:00100000:3.0:1746127010.174475:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991869568 00002000:00100000:3.0:1746127010.174525:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012153d500 x1830945991869568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.174535:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153d500 with x1830945991869568 ext(2097152->4194303) 00002000:00010000:3.0:1746127010.174541:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153d500 00000100:00100000:3.0:1746127010.174571:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991869824 00000100:00100000:3.0:1746127010.174573:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991869824 00002000:00100000:3.0:1746127010.174589:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012153ca80 x1830945991869824/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.174595:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153ca80 with x1830945991869824 ext(2097152->4194303) 00002000:00010000:3.0:1746127010.174598:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012153ca80 00000100:00100000:3.0:1746127010.174611:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8872 00000100:00100000:3.0:1746127010.174617:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991869568:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.175490:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8873 00000100:00100000:1.0:1746127010.175500:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991869824:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.196649:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.196862:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2026:x1830945991869824:12345-192.168.203.42@tcp:3:cat.0 Request processed in 21363us (22496us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746127010.196874:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8873 00002000:00100000:0.0:1746127010.196886:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012153ca80 x1830945991869824/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.196896:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153ca80 with x1830945991869824 ext(2097152->4194303) 00002000:00010000:0.0:1746127010.196902:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012153ca80 00000100:00100000:3.0:1746127010.197466:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991870080 00000100:00100000:3.0:1746127010.197474:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991870080 00000100:00100000:3.0:1746127010.197546:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17386 00000100:00100000:3.0:1746127010.197553:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4562:x1830945991870080:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127010.197576:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.197593:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6efb181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53dfc expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.197664:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197677:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197687:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197700:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197705:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197710:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197804:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197813:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197818:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127010.197826:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127010.197894:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197900:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197906:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197911:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd02e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127010.197914:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197919:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197928:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127010.197931:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127010.197935:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.197939:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd02e00/0x34dc807b6efb188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.198939:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.198947:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.198952:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.198956:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009450c800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127010.198959:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.198964:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.198974:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e600) 00010000:00010000:3.0:1746127010.198976:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127010.198979:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.198983:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efb18f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.199036:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b83400/0x34dc807b6efb181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.199047:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.199053:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.199055:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127010.199058:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450cc00, rc 0) 00000100:00100000:3.0:1746127010.199107:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4562:x1830945991870080:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1554us (2468us total) trans 8589938353 rc 0/0 00000100:00100000:3.0:1746127010.199114:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17386 00000100:00100000:3.0:1746127010.206216:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991869568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 31587us (31909us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127010.206227:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8872 00002000:00100000:3.0:1746127010.206238:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012153d500 x1830945991869568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.206247:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012153d500 with x1830945991869568 ext(2097152->4194303) 00002000:00010000:3.0:1746127010.206252:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012153d500 00000100:00100000:0.0:1746127010.207965:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.209946:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991870208 00000100:00100000:2.0:1746127010.209959:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991870208 00000100:00100000:2.0:1746127010.210025:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22126 00000100:00100000:2.0:1746127010.210033:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4562:x1830945991870208:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.210052:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.210071:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e03 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.210103:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 9 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.210110:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127010.210111:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127010.210114:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.210160:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 9 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.210170:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 9 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.210181:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994339456:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.210270:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.215997:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.216301:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994339456:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.216335:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.216357:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dada00, rc 0) 00000100:00100000:2.0:1746127010.216403:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012153dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4562:x1830945991870208:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6370us (8443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.216411:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22126 00000100:00100000:3.0:1746127010.216476:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991870336 00000100:00100000:3.0:1746127010.216484:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991870336 00002000:00100000:3.0:1746127010.216531:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1400832->1511423) req@ffff88011dc60000 x1830945991870336/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.216541:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60000 with x1830945991870336 ext(1400832->1511423) 00010000:00010000:3.0:1746127010.216547:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 10 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.216560:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 10 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127010.216567:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011dc60000 00000100:00100000:3.0:1746127010.217546:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1978 00000100:00100000:3.0:1746127010.217554:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991870336:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127010.220606:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.220711:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991870336:12345-192.168.203.42@tcp:4:cat.0 Request processed in 3156us (4722us total) trans 17179875684 rc 0/0 00000100:00100000:3.0:1746127010.220719:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1978 00002000:00100000:3.0:1746127010.220729:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (1400832->1511423) req@ffff88011dc60000 x1830945991870336/t17179875684(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/448 e 0 to 0 dl 1746127021 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.220735:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60000 with x1830945991870336 ext(1400832->1511423) 00010000:00010000:3.0:1746127010.220743:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 12 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.220754:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 12 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127010.220759:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011dc60000 00000100:00100000:2.0:1746127010.220844:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991870464 00000100:00100000:2.0:1746127010.220850:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991870464 00000100:00100000:2.0:1746127010.220883:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22127 00000100:00100000:2.0:1746127010.220887:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991870464:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.220898:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.220911:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad000/0x34dc807b6efb1ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e0a expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.220949:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994339584:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127010.220999:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.225548:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.225640:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991870592 00000100:00100000:1.0:1746127010.225649:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991870592 00010000:00010000:1.0:1746127010.225687:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 14 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.225715:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10415 00000100:00100000:1.0:1746127010.225722:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991870592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.225739:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746127010.225755:0:7246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127007 -> 1746127008 00010000:00010000:1.0:1746127010.225762:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 14 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.225773:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 14 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.225799:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.225801:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.225809:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.225817:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.225847:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.225859:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994339712:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127010.225947:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746127010.226838:0:1964:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff88012cc9e680 x1830945994339584) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 14 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.226861:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800994bd600/0x34dc807b6efb149 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1511423) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dcb expref: 14 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.226884:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994339584:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127010.226913:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad000/0x34dc807b6efb1ab lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e0a expref: 13 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.226928:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dad000/0x34dc807b6efb1ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e0a expref: 13 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.226935:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad000, rc 0) 00000100:00100000:2.0:1746127010.226966:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991870464:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6078us (6366us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.226974:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22127 00000100:00100000:1.0:1746127010.229265:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994339712:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127010.229284:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127010.229317:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991870592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3595us (3780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.229327:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10415 00000100:00100000:0.0:1746127010.232200:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.232771:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991870848 00000100:00100000:3.0:1746127010.232780:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991870848 00002000:00100000:3.0:1746127010.232823:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (2084864->2088959) req@ffff88012ced5c00 x1830945991870848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.232833:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5c00 with x1830945991870848 ext(2084864->2088959) 00002000:00010000:3.0:1746127010.232838:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced5c00 00000100:00100000:3.0:1746127010.232856:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8874 00000100:00100000:3.0:1746127010.232862:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991870848:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127010.234280:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991870848:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 1411us (2082us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127010.234289:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8874 00002000:00100000:3.0:1746127010.234297:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa0:0x0] (2084864->2088959) req@ffff88012ced5c00 x1830945991870848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.234305:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5c00 with x1830945991870848 ext(2084864->2088959) 00002000:00010000:3.0:1746127010.234309:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced5c00 00000100:00100000:0.0:1746127010.235047:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.235489:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991871104 00000100:00100000:3.0:1746127010.235496:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991871104 00002000:00100000:3.0:1746127010.235524:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012ced7480 x1830945991871104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.235532:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced7480 with x1830945991871104 ext(4194304->4829183) 00002000:00010000:3.0:1746127010.235537:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced7480 00000100:00100000:3.0:1746127010.235559:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8875 00000100:00100000:3.0:1746127010.235565:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991871104:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.241889:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.241988:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991871232 00000100:00100000:2.0:1746127010.241997:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991871232 00000100:00100000:2.0:1746127010.242070:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22128 00000100:00100000:2.0:1746127010.242079:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4562:x1830945991871232:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.242097:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.242115:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e11 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.242179:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 46 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.242189:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.242196:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.242198:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.242201:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->1126399] (req 1048576->1126399) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.242236:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.242248:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 31 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.242260:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994339840:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.242342:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 46 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.242350:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 46 pid: 11152 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.242358:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994339968:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.242376:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.242838:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991871104:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7271us (7791us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127010.242849:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8875 00002000:00100000:3.0:1746127010.242858:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012ced7480 x1830945991871104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.242866:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced7480 with x1830945991871104 ext(4194304->4829183) 00002000:00010000:3.0:1746127010.242870:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced7480 00000100:00100000:2.0:1746127010.247332:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cc9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994339840:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.247348:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994339968:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.247386:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->1126399] (req 1048576->1126399) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.247404:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995eb800, rc 0) 00000100:00100000:2.0:1746127010.247461:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4562:x1830945991871232:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5382us (5581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.247472:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22128 00000100:00100000:0.0:1746127010.249240:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.249279:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.249744:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.249826:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991871360 00000100:00100000:1.0:1746127010.249835:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991871360 00010000:00010000:1.0:1746127010.249872:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746127010.250240:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.250275:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991871744 00000100:00100000:0.0:1746127010.250278:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991871744 00000100:00100000:0.0:1746127010.250299:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991871616 00000100:00100000:0.0:1746127010.250301:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991871616 00000100:00100000:0.0:1746127010.250318:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22129 00000100:00100000:0.0:1746127010.250324:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2027:x1830945991871744:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127010.250342:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.250358:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a46800/0x34dc807b6efb1b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e1f expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.250380:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.250390:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a46800/0x34dc807b6efb1b9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e1f expref: 32 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.250400:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a46800/0x34dc807b6efb1b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e1f expref: 32 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.250416:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46800, rc 0) 00000100:00100000:0.0:1746127010.250455:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2027:x1830945991871744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 130us (710us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127010.250461:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22129 00000100:00100000:0.0:1746127010.250473:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22130 00000100:00100000:0.0:1746127010.250478:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991871616:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127010.250485:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.250494:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efb1c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e18 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127010.250534:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094819c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994340096:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127010.250584:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.250772:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991871488 00000100:00100000:1.0:1746127010.250776:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991871488 00010000:00010000:1.0:1746127010.250790:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 46 pid: 11152 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.250905:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10416 00000100:00100000:2.0:1746127010.250913:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991871360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.250922:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.250944:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.250954:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.250970:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b83600/0x34dc807b6efb173 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de7 expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.250990:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.251022:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991871360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 110us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.251027:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10416 00000100:00100000:2.0:1746127010.251040:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10417 00000100:00100000:2.0:1746127010.251045:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991871488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.251051:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.251058:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 46 pid: 11152 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.251066:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 46 pid: 11152 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.251084:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9d000/0x34dc807b6efb0bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d7e expref: 46 pid: 11152 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.251092:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.251093:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.251100:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.251108:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.251144:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.251153:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994340224:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127010.251175:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.253542:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094819c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994340096:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127010.253574:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efb1c0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e18 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.253587:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a46a00/0x34dc807b6efb1c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e18 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.253598:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46a00, rc 0) 00000100:00100000:2.0:1746127010.254082:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991871616:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3602us (3839us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.254091:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22130 00000100:00100000:2.0:1746127010.254825:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994340224:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127010.254841:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.254865:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991871488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3820us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.254874:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10417 00000100:00100000:0.0:1746127010.258229:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.259227:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991872000 00000100:00100000:3.0:1746127010.259238:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991872000 00002000:00100000:3.0:1746127010.259283:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1122304->1126399) req@ffff88009481aa00 x1830945991872000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.259293:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481aa00 with x1830945991872000 ext(1122304->1126399) 00002000:00010000:3.0:1746127010.259298:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009481aa00 00000100:00100000:3.0:1746127010.259316:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8876 00000100:00100000:3.0:1746127010.259322:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991872000:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127010.259455:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991872000:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 132us (1235us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127010.259460:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8876 00002000:00100000:3.0:1746127010.259466:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1122304->1126399) req@ffff88009481aa00 x1830945991872000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.259472:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481aa00 with x1830945991872000 ext(1122304->1126399) 00002000:00010000:3.0:1746127010.259474:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009481aa00 00000100:00100000:3.0:1746127010.261471:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.261514:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.261576:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991872128 00000100:00100000:2.0:1746127010.261583:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991872128 00000100:00100000:0.0:1746127010.261723:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.261887:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991872512 00000100:00100000:3.0:1746127010.261890:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991872512 00000100:00100000:2.0:1746127010.261922:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991872256 00000100:00100000:2.0:1746127010.261924:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991872256 00000100:00100000:3.0:1746127010.261993:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6652 00000100:00100000:3.0:1746127010.262000:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4562:x1830945991872512:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127010.262213:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4562:x1830945991872512:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 213us (489us total) trans 8589938354 rc 0/0 00000100:00100000:3.0:1746127010.262218:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6652 00000100:00100000:0.0:1746127010.262406:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22131 00000100:00100000:2.0:1746127010.262461:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22132 00000100:00100000:2.0:1746127010.262466:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991872256:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.262476:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.262492:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8400/0x34dc807b6efb1c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e2d expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.262547:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994340352:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127010.262596:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.263686:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991872128:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.263699:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.263712:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc10c00/0x34dc807b6efb1ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e26 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.263750:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994340480:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.265279:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff23c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746127010.265367:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127007 -> 1746127008 00000100:00100000:2.0:1746127010.265387:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994340352:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127010.265416:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8400/0x34dc807b6efb1c7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e2d expref: 30 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.265427:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88006f3e8400/0x34dc807b6efb1c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e2d expref: 30 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.265444:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8400, rc 0) 00000100:00100000:2.0:1746127010.265474:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991872256:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3007us (3959us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.265481:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22132 00000100:00100000:3.0:1746127010.269918:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994340480:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.269953:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc10c00/0x34dc807b6efb1ce lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e26 expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.269966:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007dc10c00/0x34dc807b6efb1ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e26 expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.269991:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10c00, rc 0) 00000100:00100000:3.0:1746127010.270041:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991872128:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7628us (8576us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.270049:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22131 00000100:00100000:0.0:1746127010.300374:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.300417:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.300445:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.300470:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991872896 00000100:00100000:0.0:1746127010.300478:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991872896 00002000:00100000:0.0:1746127010.300524:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009481b100 x1830945991872896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.300535:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481b100 with x1830945991872896 ext(0->1048575) 00002000:00010000:0.0:1746127010.300540:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009481b100 00000100:00100000:0.0:1746127010.300570:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991873024 00000100:00100000:0.0:1746127010.300572:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991873024 00002000:00100000:0.0:1746127010.300583:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1126400->2097151) req@ffff880094819f80 x1830945991873024/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.300589:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094819f80 with x1830945991873024 ext(1126400->2097151) 00002000:00010000:0.0:1746127010.300593:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094819f80 00000100:00100000:0.0:1746127010.300602:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991873408 00000100:00100000:0.0:1746127010.300604:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991873408 00002000:00100000:0.0:1746127010.300614:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2084863) req@ffff88009481ad80 x1830945991873408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.300619:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481ad80 with x1830945991873408 ext(1048576->2084863) 00002000:00010000:0.0:1746127010.300622:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009481ad80 00000100:00100000:0.0:1746127010.300641:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8877 00000100:00100000:0.0:1746127010.300649:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991872896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.301245:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8878 00000100:00100000:1.0:1746127010.301254:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2028:x1830945991873024:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.301453:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.301636:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991873280 00000100:00100000:3.0:1746127010.301639:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991873280 00002000:00100000:3.0:1746127010.301659:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009481a300 x1830945991873280/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.301665:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481a300 with x1830945991873280 ext(1048576->2097151) 00002000:00010000:3.0:1746127010.301668:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009481a300 00000100:00100000:3.0:1746127010.301681:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8879 00000100:00100000:3.0:1746127010.301685:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991873408:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127010.302069:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8880 00000100:00100000:2.0:1746127010.302077:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991873280:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127010.314544:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2028:x1830945991872896:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13883us (14169us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127010.314559:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8877 00002000:00100000:2.0:1746127010.314571:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009481b100 x1830945991872896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.314581:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481b100 with x1830945991872896 ext(0->1048575) 00002000:00010000:2.0:1746127010.314587:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009481b100 00000100:00100000:3.0:1746127010.315288:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991873408:12345-192.168.203.42@tcp:3:cat.0 Request processed in 13599us (14839us total) trans 0 rc 1036288/1036288 00000100:00100000:3.0:1746127010.315300:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8879 00002000:00100000:3.0:1746127010.315305:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2084863) req@ffff88009481ad80 x1830945991873408/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.315313:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481ad80 with x1830945991873408 ext(1048576->2084863) 00002000:00010000:3.0:1746127010.315317:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009481ad80 00000100:00100000:1.0:1746127010.321209:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991873024:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19943us (20778us total) trans 0 rc 970752/970752 00000100:00100000:1.0:1746127010.321223:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8878 00002000:00100000:1.0:1746127010.321236:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1126400->2097151) req@ffff880094819f80 x1830945991873024/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 970752/970752 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.321246:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094819f80 with x1830945991873024 ext(1126400->2097151) 00002000:00010000:1.0:1746127010.321252:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094819f80 00000100:00100000:2.0:1746127010.325952:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991873280:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23864us (24486us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127010.325965:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8880 00002000:00100000:2.0:1746127010.325977:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009481a300 x1830945991873280/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.325987:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481a300 with x1830945991873280 ext(1048576->2097151) 00002000:00010000:2.0:1746127010.325993:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009481a300 00000100:00100000:0.0:1746127010.342641:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.343764:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.344051:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991873792 00000100:00100000:1.0:1746127010.344062:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991873792 00002000:00100000:1.0:1746127010.344111:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009481bb80 x1830945991873792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.344121:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481bb80 with x1830945991873792 ext(2097152->4194303) 00002000:00010000:1.0:1746127010.344126:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009481bb80 00000100:00100000:1.0:1746127010.344178:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991874048 00000100:00100000:1.0:1746127010.344181:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991874048 00002000:00100000:1.0:1746127010.344194:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009481b480 x1830945991874048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.344201:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481b480 with x1830945991874048 ext(2097152->4194303) 00002000:00010000:1.0:1746127010.344203:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009481b480 00000100:00100000:3.0:1746127010.344227:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8881 00000100:00100000:3.0:1746127010.344238:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991873792:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.344660:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8882 00000100:00100000:0.0:1746127010.344667:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991874048:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.378998:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.379583:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991874304 00000100:00100000:3.0:1746127010.379592:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991874304 00000100:00100000:3.0:1746127010.379645:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17387 00000100:00100000:3.0:1746127010.379653:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4570:x1830945991874304:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127010.379680:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.379698:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7600/0x34dc807b6efb1d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e34 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.379769:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379781:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379791:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379801:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379806:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379811:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379897:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7400/0x34dc807b6efb1ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379903:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7400/0x34dc807b6efb1ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379908:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7400/0x34dc807b6efb1ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127010.379914:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127010.379974:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379979:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379985:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379990:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbf7e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127010.379993:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.379998:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380016:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127010.380019:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127010.380024:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380032:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb1dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380058:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380063:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380067:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380071:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbf7c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127010.380073:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380077:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380083:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095eec700) 00010000:00010000:3.0:1746127010.380085:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127010.380086:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380090:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb1e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.380123:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7600/0x34dc807b6efb1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e34 expref: 16 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.380170:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7400/0x34dc807b6efb1ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e34 expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.380181:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.380183:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127010.380185:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7400, rc 0) 00000100:00100000:3.0:1746127010.380242:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4570:x1830945991874304:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 589us (1252us total) trans 8589938355 rc 0/0 00000100:00100000:3.0:1746127010.380248:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17387 00000100:00100000:1.0:1746127010.391416:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991874048:12345-192.168.203.42@tcp:3:cat.0 Request processed in 46741us (47644us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127010.391428:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8882 00002000:00100000:1.0:1746127010.391438:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009481b480 x1830945991874048/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.391448:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481b480 with x1830945991874048 ext(2097152->4194303) 00002000:00010000:1.0:1746127010.391453:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009481b480 00000100:00100000:0.0:1746127010.391751:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.392298:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991874432 00000100:00100000:2.0:1746127010.392307:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991874432 00000100:00100000:2.0:1746127010.392352:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1038 00000100:00100000:2.0:1746127010.392357:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991874432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.392370:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.392394:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7400/0x34dc807b6efb1ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e34 expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.392410:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000100:00100000:3.0:1746127010.392411:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009481bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991873792:12345-192.168.203.42@tcp:3:cat.0 Request processed in 48176us (49783us total) trans 0 rc 2097152/2097152 00010000:00010000:2.0:1746127010.392414:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.392419:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8881 00002000:00100000:3.0:1746127010.392424:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009481bb80 x1830945991873792/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127010.392427:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991874432:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 70us (678us total) trans 0 rc 0/0 00002000:00100000:3.0:1746127010.392431:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009481bb80 with x1830945991873792 ext(2097152->4194303) 00000100:00100000:2.0:1746127010.392432:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1038 00002000:00010000:3.0:1746127010.392435:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009481bb80 00000100:00100000:0.0:1746127010.406618:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.408700:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991874688 00000100:00100000:3.0:1746127010.408717:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991874688 00002000:00100000:3.0:1746127010.408778:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0ca80 x1830945991874688/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.408789:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ca80 with x1830945991874688 ext(4194304->4829183) 00002000:00010000:3.0:1746127010.408795:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ca80 00000100:00100000:3.0:1746127010.408841:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8883 00000100:00100000:3.0:1746127010.408848:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991874688:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127010.414601:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991874688:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5737us (7981us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127010.414617:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8883 00002000:00100000:3.0:1746127010.414631:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0ca80 x1830945991874688/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.414641:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0ca80 with x1830945991874688 ext(4194304->4829183) 00002000:00010000:3.0:1746127010.414647:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0ca80 00000100:00100000:0.0:1746127010.428122:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.428943:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991874816 00000100:00100000:3.0:1746127010.428953:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991874816 00000100:00100000:2.0:1746127010.429367:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22133 00000100:00100000:2.0:1746127010.429377:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4570:x1830945991874816:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.429396:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.429415:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e3b expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.429446:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 44 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.429454:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.429459:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.429461:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.429463:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4063232->4194303] (req 4063232->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.429499:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.429509:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.429520:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994340608:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.429637:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 44 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.429645:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 44 pid: 3542 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.429653:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994340736:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.429672:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.434494:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994340608:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.434797:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994340736:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.434941:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4063232->4194303] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.434960:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de0c400, rc 0) 00000100:00100000:2.0:1746127010.435026:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4570:x1830945991874816:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5649us (6913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.435038:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22133 00000100:00100000:0.0:1746127010.437490:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.437578:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991874944 00000100:00100000:1.0:1746127010.437587:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991874944 00010000:00010000:1.0:1746127010.437626:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746127010.438057:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.438261:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991875072 00000100:00100000:1.0:1746127010.438264:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991875072 00010000:00010000:1.0:1746127010.438279:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 45 pid: 3542 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.438802:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10418 00000100:00100000:0.0:1746127010.438810:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2028:x1830945991874944:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.438822:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.438843:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746127010.438854:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746127010.438878:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82600/0x34dc807b6efb16c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dee expref: 30 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.438898:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10419 00000100:00100000:3.0:1746127010.438905:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991875072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.438912:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.438918:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 45 pid: 3542 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.438926:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 45 pid: 3542 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.438939:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995eaa00/0x34dc807b6efb0cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d93 expref: 45 pid: 3542 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.438956:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.438958:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.438964:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.438971:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.439015:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.439026:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994340864:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127010.439085:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127010.439111:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991874944:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 302us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.439117:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10418 00000100:00100000:3.0:1746127010.439194:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.440925:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994340864:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127010.440945:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.441371:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991875072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2464us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.441381:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10419 00000100:00100000:2.0:1746127010.442569:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.442652:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991875328 00000100:00100000:3.0:1746127010.442660:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991875328 00002000:00100000:3.0:1746127010.442704:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4063232->4067327) req@ffff88012d3fce00 x1830945991875328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.442714:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fce00 with x1830945991875328 ext(4063232->4067327) 00002000:00010000:3.0:1746127010.442719:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fce00 00000100:00100000:3.0:1746127010.442748:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8884 00000100:00100000:3.0:1746127010.442754:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991875328:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127010.443147:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991875328:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 372us (562us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127010.443154:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8884 00002000:00100000:3.0:1746127010.443161:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4063232->4067327) req@ffff88012d3fce00 x1830945991875328/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.443174:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fce00 with x1830945991875328 ext(4063232->4067327) 00002000:00010000:3.0:1746127010.443177:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fce00 00000100:00100000:0.0:1746127010.446364:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.446534:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991875456 00000100:00100000:2.0:1746127010.446544:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991875456 00000100:00100000:2.0:1746127010.446600:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22134 00000100:00100000:2.0:1746127010.446608:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4570:x1830945991875456:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.446627:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.446646:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e42 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.446674:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.446683:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 12 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.446689:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.446691:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.446695:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 12 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.446726:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 12 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.446736:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 12 pid: 9611 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.446752:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994340992:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.446853:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.446861:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 31 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.446868:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994341120:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.446890:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.448635:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994340992:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.448647:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994341120:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.448676:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 12 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.448692:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006f3e8400, rc 0) 00000100:00100000:2.0:1746127010.448939:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4570:x1830945991875456:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2330us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.448948:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22134 00000100:00100000:0.0:1746127010.453103:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.453415:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991875584 00000100:00100000:3.0:1746127010.453424:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991875584 00010000:00010000:3.0:1746127010.453460:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 12 pid: 9611 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.453485:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10420 00000100:00100000:3.0:1746127010.453491:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991875584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.453503:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.453522:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 12 pid: 9611 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.453532:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 12 pid: 9611 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.453556:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e8e6c00/0x34dc807b6efb17a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53df5 expref: 12 pid: 9611 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.453581:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.453622:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991875584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 131us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.453627:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10420 00000100:00100000:0.0:1746127010.454200:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.454280:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991875712 00000100:00100000:2.0:1746127010.454284:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991875712 00010000:00010000:2.0:1746127010.454303:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.454319:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10421 00000100:00100000:2.0:1746127010.454325:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991875712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.454334:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.454344:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.454352:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.454365:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03800/0x34dc807b6efb0e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53da8 expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.454388:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.454390:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.454397:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.454405:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.454437:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.454449:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994341248:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127010.454509:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.458988:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994341248:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127010.459230:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.459291:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991875712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4963us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.459302:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10421 00000100:00100000:0.0:1746127010.460198:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.460791:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991875968 00000100:00100000:3.0:1746127010.460801:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991875968 00002000:00100000:3.0:1746127010.460848:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3481600->3485695) req@ffff880096631f80 x1830945991875968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.460858:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631f80 with x1830945991875968 ext(3481600->3485695) 00002000:00010000:3.0:1746127010.460863:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096631f80 00000100:00100000:3.0:1746127010.460890:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8885 00000100:00100000:3.0:1746127010.460897:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991875968:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127010.461203:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991875968:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 305us (1007us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127010.461210:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8885 00002000:00100000:3.0:1746127010.461215:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (3481600->3485695) req@ffff880096631f80 x1830945991875968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.461222:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096631f80 with x1830945991875968 ext(3481600->3485695) 00002000:00010000:3.0:1746127010.461224:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096631f80 00000100:00100000:0.0:1746127010.465050:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.465173:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991876224 00000100:00100000:3.0:1746127010.465183:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991876224 00000100:00100000:3.0:1746127010.465223:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6653 00000100:00100000:3.0:1746127010.465230:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4570:x1830945991876224:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127010.465521:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4570:x1830945991876224:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 290us (481us total) trans 8589938356 rc 0/0 00000100:00100000:3.0:1746127010.465528:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6653 00000100:00100000:0.0:1746127010.494386:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.494464:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991876480 00000100:00100000:3.0:1746127010.494474:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991876480 00000100:00100000:3.0:1746127010.494535:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17388 00000100:00100000:3.0:1746127010.494543:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4574:x1830945991876480:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127010.494579:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.494600:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7600/0x34dc807b6efb206 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e49 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.494697:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.494710:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 14 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.494716:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.494723:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.494751:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.494761:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 31 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.494771:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994341376:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.494885:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 14 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.494893:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 14 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.494901:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994341504:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.494918:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.501110:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.501175:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991876608 00000100:00100000:2.0:1746127010.501198:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991876608 00000100:00100000:2.0:1746127010.501244:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22135 00000100:00100000:2.0:1746127010.501252:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991876608:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.501269:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.501289:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d359400/0x34dc807b6efb214 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e50 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.501345:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994341632:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127010.501956:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.502196:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.502239:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991876736 00000100:00100000:2.0:1746127010.502244:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991876736 00000100:00100000:2.0:1746127010.502281:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22136 00000100:00100000:2.0:1746127010.502287:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991876736:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.502297:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.502308:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efb21b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e57 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.502338:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994341760:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127010.502496:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.503017:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.503088:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991876864 00000100:00100000:0.0:1746127010.503092:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991876864 00010000:00010000:0.0:1746127010.503113:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 32 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.503163:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10422 00000100:00100000:0.0:1746127010.503169:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991876864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.503178:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.503183:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 32 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.503194:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 32 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.503214:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127010.503218:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.503226:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127010.503231:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127010.503258:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991876864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.503264:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10422 00010000:00010000:3.0:1746127010.503331:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450cc00/0x34dc807b6efb196 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dfc expref: 31 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.503347:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994341376:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.503356:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994341504:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.503375:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127010.504817:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:2.0:1746127010.504882:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746127008 -> 1746127009 00000100:00100000:2.0:1746127010.504903:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994341632:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127010.504940:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d359400/0x34dc807b6efb214 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e50 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127010.504949:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991876992 00010000:00010000:2.0:1746127010.504952:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d359400/0x34dc807b6efb214 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e50 expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127010.504955:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991876992 00010000:00010000:2.0:1746127010.504965:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d359400, rc 0) 00010000:00010000:3.0:1746127010.504977:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 15 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.504998:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991876608:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3746us (3899us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.504999:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10423 00000100:00100000:2.0:1746127010.505013:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22135 00000100:00100000:3.0:1746127010.505015:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991876992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.505026:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.505031:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 15 pid: 7259 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.505040:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 15 pid: 7259 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746127010.505047:0:1964:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127008 -> 1746127009 00010000:00010000:3.0:1746127010.505055:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb157 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd2 expref: 15 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.505060:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994341760:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.505064:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.505068:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127010.505075:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efb21b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e57 expref: 30 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.505076:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.505083:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127010.505084:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dad000/0x34dc807b6efb21b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e57 expref: 30 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.505091:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dad000, rc 0) 00010000:00010000:3.0:1746127010.505100:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.505107:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2026:x1830945991876736:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2821us (2913us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.505112:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22136 00000100:00100000:3.0:1746127010.505118:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991876992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.505124:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10423 00010000:00010000:3.0:1746127010.505185:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127010.505191:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127010.505208:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127010.505322:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7600/0x34dc807b6efb206 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.505332:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.505338:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.505340:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127010.505342:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7c00, rc 0) 00000100:00100000:3.0:1746127010.505363:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4574:x1830945991876480:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10822us (10989us total) trans 8589938357 rc 0/0 00000100:00100000:3.0:1746127010.505369:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17388 00000100:00100000:0.0:1746127010.511672:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.511765:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991877120 00000100:00100000:3.0:1746127010.511775:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991877120 00000100:00100000:3.0:1746127010.511818:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17389 00000100:00100000:3.0:1746127010.511825:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4574:x1830945991877120:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127010.511851:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.511870:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e5e expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.511925:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.511936:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.511951:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.511954:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127010.511957:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7e00, rc 0) 00000100:00100000:3.0:1746127010.512017:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4574:x1830945991877120:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 192us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.512022:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17389 00000100:00100000:0.0:1746127010.517063:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.517493:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991877248 00000100:00100000:2.0:1746127010.517508:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991877248 00000100:00100000:2.0:1746127010.517568:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22137 00000100:00100000:2.0:1746127010.517578:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4574:x1830945991877248:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.517598:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.517615:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e65 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.517645:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.517653:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.517659:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.517660:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.517663:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1789952->1925119] (req 1789952->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.517693:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.517705:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 10 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.517718:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994341888:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.517821:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.517829:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.517842:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994342016:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.517861:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.527796:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.527837:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.527865:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991877504 00000100:00100000:1.0:1746127010.527874:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991877504 00000100:00100000:0.0:1746127010.527892:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127010.527912:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 33 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746127010.527930:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991877632 00000100:00100000:0.0:1746127010.527933:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991877632 00000100:00100000:1.0:1746127010.527947:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10424 00010000:00010000:0.0:1746127010.527949:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 11 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746127010.527954:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991877504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127010.527963:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991877376 00000100:00100000:3.0:1746127010.527967:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991877376 00010000:00010000:1.0:1746127010.527968:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.527988:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 33 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.527994:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22138 00000100:00100000:3.0:1746127010.527998:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4577:x1830945991877376:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127010.527998:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 33 pid: 3542 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.528021:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.528033:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e6c expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.528033:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127010.528054:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.528060:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127010.528062:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127010.528065:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 13 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.528073:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991877504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 120us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.528078:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10424 00010000:00010000:3.0:1746127010.528091:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.528092:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10425 00000100:00100000:1.0:1746127010.528096:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991877632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.528101:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 32 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.528101:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.528107:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 13 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.528112:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994342144:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127010.528113:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 13 pid: 3148 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746127010.528121:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.528122:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.528151:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.528158:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.528176:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.528179:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.528183:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994342272:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127010.528208:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746127010.528211:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450d800/0x34dc807b6efb165 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53de0 expref: 13 pid: 3148 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.528234:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994341888:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.528244:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd03e00/0x34dc807b6efb0d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d9a expref: 32 pid: 3542 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.528254:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994342016:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.528278:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.528287:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2aa00, rc 0) 00000100:00100000:2.0:1746127010.528311:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4574:x1830945991877248:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10736us (11259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.528317:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22137 00000100:00100000:1.0:1746127010.532888:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994342272:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127010.532915:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.533115:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994342144:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.533346:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 12 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.533363:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7a00, rc 0) 00000100:00100000:1.0:1746127010.533987:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991877632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5886us (6091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.533998:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10425 00000100:00100000:3.0:1746127010.534165:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4577:x1830945991877376:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6164us (6326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.534173:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22138 00000100:00100000:0.0:1746127010.534758:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.534827:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.534869:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991877888 00000100:00100000:0.0:1746127010.534876:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991877888 00002000:00100000:0.0:1746127010.534913:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (2084864->2097151) req@ffff880099195500 x1830945991877888/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 12776/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.534923:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099195500 with x1830945991877888 ext(2084864->2097151) 00010000:00010000:0.0:1746127010.534932:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 31 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.534945:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 31 pid: 1964 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127010.534952:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099195500 00000100:00100000:0.0:1746127010.534965:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991878016 00000100:00100000:0.0:1746127010.534969:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991878016 00002000:00100000:0.0:1746127010.534980:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x9f:0x0] (1789952->1794047) req@ffff880099194700 x1830945991878016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.534988:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099194700 with x1830945991878016 ext(1789952->1794047) 00002000:00010000:0.0:1746127010.534991:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099194700 00000100:00100000:0.0:1746127010.535019:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1979 00000100:00100000:0.0:1746127010.535026:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991877888:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127010.535623:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8886 00000100:00100000:3.0:1746127010.535631:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991878016:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127010.537334:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991877888:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 2303us (2572us total) trans 17179875685 rc 0/0 00000100:00100000:0.0:1746127010.537345:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1979 00002000:00100000:0.0:1746127010.537353:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (2084864->2097151) req@ffff880099195500 x1830945991877888/t17179875685(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 12776/448 e 0 to 0 dl 1746127021 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.537361:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099195500 with x1830945991877888 ext(2084864->2097151) 00010000:00010000:0.0:1746127010.537369:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.537382:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127010.537389:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099195500 00000100:00100000:3.0:1746127010.537533:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991878016:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 1902us (2705us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127010.537540:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8886 00002000:00100000:3.0:1746127010.537543:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1789952->1794047) req@ffff880099194700 x1830945991878016/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.537550:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099194700 with x1830945991878016 ext(1789952->1794047) 00002000:00010000:3.0:1746127010.537553:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099194700 00000100:00100000:0.0:1746127010.545437:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.545503:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.545688:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991878272 00000100:00100000:3.0:1746127010.545697:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991878272 00002000:00100000:3.0:1746127010.545746:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1921024->1925119) req@ffff880099194000 x1830945991878272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.545757:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099194000 with x1830945991878272 ext(1921024->1925119) 00002000:00010000:3.0:1746127010.545762:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099194000 00000100:00100000:3.0:1746127010.545793:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8887 00000100:00100000:3.0:1746127010.545800:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991878272:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127010.548601:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991878272:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 2789us (3162us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127010.548614:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8887 00002000:00100000:3.0:1746127010.548625:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1921024->1925119) req@ffff880099194000 x1830945991878272/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.548634:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099194000 with x1830945991878272 ext(1921024->1925119) 00002000:00010000:3.0:1746127010.548640:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099194000 00000100:00100000:2.0:1746127010.548794:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.548822:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991878656 00000100:00100000:1.0:1746127010.548985:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991878400 00000100:00100000:1.0:1746127010.548992:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991878400 00010000:00010000:1.0:1746127010.549031:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 33 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.549059:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10426 00000100:00100000:1.0:1746127010.549066:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991878400:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.549077:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746127010.549092:0:7246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127008 -> 1746127009 00010000:00010000:1.0:1746127010.549097:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 33 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.549109:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 33 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.549144:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dada00/0x34dc807b6efb1a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e03 expref: 33 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.549170:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.549172:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127010.549179:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.549187:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.549218:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.549229:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994342400:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127010.549293:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.551502:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991878656 00000100:00100000:1.0:1746127010.551612:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17390 00000100:00100000:1.0:1746127010.551620:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4580:x1830945991878656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127010.551639:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.551656:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efb23e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e73 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.551730:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551742:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551751:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551762:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551767:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551771:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551873:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551882:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551887:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127010.551895:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127010.551967:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551973:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551982:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551988:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.551994:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911de800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127010.551997:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552013:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552023:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127010.552026:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127010.552030:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552034:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de800/0x34dc807b6efb245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552044:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552048:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552052:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552056:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911de200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127010.552058:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552065:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552070:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099bf6900) 00010000:00010000:1.0:1746127010.552072:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127010.552074:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552077:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911de200/0x34dc807b6efb24c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.552110:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911dee00/0x34dc807b6efb23e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 35 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.552120:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 34 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.553017:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.553020:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127010.553024:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e8e6c00, rc 0) 00000100:00100000:1.0:1746127010.553874:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4580:x1830945991878656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2251us (5077us total) trans 8589938358 rc 0/0 00000100:00100000:1.0:1746127010.553883:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17390 00000100:00100000:2.0:1746127010.554983:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994342400:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127010.555012:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.555048:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2028:x1830945991878400:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5983us (9544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.555056:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10426 00000100:00100000:0.0:1746127010.562296:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.562530:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.562620:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991879168 00000100:00100000:2.0:1746127010.562628:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991879168 00000100:00100000:2.0:1746127010.562672:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6654 00000100:00100000:2.0:1746127010.562679:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4580:x1830945991879168:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127010.562898:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4580:x1830945991879168:12345-192.168.203.42@tcp:35:cat.0 Request processed in 219us (367us total) trans 8589938359 rc 0/0 00000100:00100000:2.0:1746127010.562905:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6654 00000100:00100000:3.0:1746127010.563086:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991878912 00000100:00100000:3.0:1746127010.563091:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991878912 00002000:00100000:3.0:1746127010.563121:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009d1b4000 x1830945991878912/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.563158:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4000 with x1830945991878912 ext(1048576->2097151) 00002000:00010000:3.0:1746127010.563163:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b4000 00000100:00100000:3.0:1746127010.563177:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8888 00000100:00100000:3.0:1746127010.563183:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991878912:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.569234:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.569853:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991879424 00000100:00100000:3.0:1746127010.569862:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991879424 00000100:00100000:3.0:1746127010.569913:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22139 00000100:00100000:3.0:1746127010.569920:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991879424:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.569938:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.569956:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efb261 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e81 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.570019:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994342528:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.570097:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.570403:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.570415:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.570519:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991878912:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7335us (8235us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127010.570527:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8888 00002000:00100000:0.0:1746127010.570535:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009d1b4000 x1830945991878912/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.570543:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4000 with x1830945991878912 ext(1048576->2097151) 00002000:00010000:0.0:1746127010.570547:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b4000 00000100:00100000:0.0:1746127010.570575:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991879296 00000100:00100000:0.0:1746127010.570578:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991879296 00000100:00100000:0.0:1746127010.570596:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991879552 00000100:00100000:0.0:1746127010.570598:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991879552 00000100:00100000:0.0:1746127010.570610:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22140 00000100:00100000:0.0:1746127010.570614:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991879296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127010.570621:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.570631:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e7a expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.570644:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.570646:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.570653:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.570666:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.570679:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7e00, rc 0) 00000100:00100000:0.0:1746127010.570692:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991879296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.570697:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22140 00000100:00100000:0.0:1746127010.570705:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22141 00000100:00100000:0.0:1746127010.570709:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991879552:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127010.570713:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.570717:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb26f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e88 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127010.570736:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800997da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994342656:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127010.570764:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.578220:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:1.0:1746127010.578415:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746127008 -> 1746127009 00002000:00010000:1.0:1746127010.578420:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127007 -> 1746127009 00002000:00010000:1.0:1746127010.578422:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746127008 -> 1746127009 00000100:00100000:1.0:1746127010.578440:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800997da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994342656:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127010.578472:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb26f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e88 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.578488:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb26f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e88 expref: 34 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.578503:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6800, rc 0) 00000100:00100000:2.0:1746127010.578587:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991879680 00000100:00100000:2.0:1746127010.578593:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991879680 00000100:00100000:2.0:1746127010.578633:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22142 00000100:00100000:2.0:1746127010.578639:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4577:x1830945991879680:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.578653:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.578666:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e8f expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.578690:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.578697:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127010.578699:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127010.578702:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.578729:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.578739:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 45 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.578751:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994342784:192.168.203.42@tcp:104: 00002000:00010000:3.0:1746127010.581556:0:11152:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127008 -> 1746127009 00002000:00010000:3.0:1746127010.581564:0:11152:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127008 -> 1746127009 00002000:00010000:3.0:1746127010.581566:0:11152:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127008 -> 1746127009 00000100:00100000:3.0:1746127010.581590:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994342528:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.581624:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efb261 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e81 expref: 45 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.581641:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a44000/0x34dc807b6efb261 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e81 expref: 45 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.581666:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44000, rc 0) 00000100:00100000:1.0:1746127010.581833:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991879552:12345-192.168.203.42@tcp:101:cat.0 Request processed in 11119us (11411us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127010.581842:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22141 00000100:00100000:2.0:1746127010.582017:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.582233:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991879424:12345-192.168.203.42@tcp:101:cat.0 Request processed in 12313us (13008us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.582239:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22139 00000100:00100000:2.0:1746127010.588160:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994342784:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.588199:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.588219:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2b000, rc 0) 00000100:00100000:2.0:1746127010.588268:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4577:x1830945991879680:12345-192.168.203.42@tcp:101:cat.0 Request processed in 9627us (10056us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.588277:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22142 00000100:00100000:0.0:1746127010.588499:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.588647:0:29588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991879808 00000100:00100000:2.0:1746127010.588653:0:29588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991879808 00002000:00100000:2.0:1746127010.588692:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1126399) req@ffff8800997da300 x1830945991879808/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.588700:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997da300 with x1830945991879808 ext(1048576->1126399) 00010000:00010000:2.0:1746127010.588707:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 44 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.588718:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 44 pid: 1964 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746127010.588725:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800997da300 00000100:00100000:3.0:1746127010.590025:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1980 00000100:00100000:3.0:1746127010.590039:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991879808:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127010.595527:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.595566:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.595596:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991880064 00000100:00100000:0.0:1746127010.595603:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991880064 00002000:00100000:0.0:1746127010.595642:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a7b480 x1830945991880064/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 504/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.595653:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b480 with x1830945991880064 ext(1048576->2097151) 00002000:00010000:0.0:1746127010.595658:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7b480 00000100:00100000:0.0:1746127010.595674:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991880192 00000100:00100000:0.0:1746127010.595676:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991880192 00002000:00100000:0.0:1746127010.595687:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a78a80 x1830945991880192/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.595693:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78a80 with x1830945991880192 ext(1048576->2097151) 00002000:00010000:0.0:1746127010.595696:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a78a80 00000100:00100000:0.0:1746127010.595709:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8889 00000100:00100000:0.0:1746127010.595715:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2028:x1830945991880064:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.596363:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8890 00000100:00100000:0.0:1746127010.596370:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991880192:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127010.599014:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991879808:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8959us (10495us total) trans 21474842959 rc 0/0 00000100:00100000:3.0:1746127010.599027:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1980 00002000:00100000:3.0:1746127010.599039:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1126399) req@ffff8800997da300 x1830945991879808/t21474842959(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/448 e 0 to 0 dl 1746127021 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.599048:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800997da300 with x1830945991879808 ext(1048576->1126399) 00010000:00010000:3.0:1746127010.599059:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.599075:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127010.599082:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800997da300 00000100:00100000:2.0:1746127010.610749:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991880064:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15020us (15217us total) trans 0 rc 913408/913408 00000100:00100000:2.0:1746127010.610766:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8889 00002000:00100000:2.0:1746127010.610779:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a7b480 x1830945991880064/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 504/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.610788:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7b480 with x1830945991880064 ext(1048576->2097151) 00002000:00010000:2.0:1746127010.610794:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a7b480 00000100:00100000:1.0:1746127010.611919:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.612124:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991880448 00000100:00100000:3.0:1746127010.612147:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991880448 00010000:00010000:3.0:1746127010.612177:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.612201:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10427 00000100:00100000:0.0:1746127010.613219:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2028:x1830945991880192:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16846us (17649us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127010.613229:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8890 00002000:00100000:0.0:1746127010.613238:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880130a78a80 x1830945991880192/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.613246:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78a80 with x1830945991880192 ext(1048576->2097151) 00002000:00010000:0.0:1746127010.613250:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a78a80 00000100:00100000:3.0:1746127010.613320:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991880448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.613336:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746127010.613355:0:7246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127008 -> 1746127009 00010000:00010000:3.0:1746127010.613362:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.613373:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.613398:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800995eb800/0x34dc807b6efb1b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e11 expref: 46 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.613417:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.613419:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.613427:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.613435:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.613467:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.613483:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994342912:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127010.613554:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.626471:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.626599:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994342912:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127010.626622:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.626667:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991880448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 14459us (14751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.626677:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10427 00000100:00100000:1.0:1746127010.626920:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991880704 00000100:00100000:1.0:1746127010.626927:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991880704 00002000:00100000:1.0:1746127010.626968:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a7bb80 x1830945991880704/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.626977:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7bb80 with x1830945991880704 ext(1048576->2097151) 00002000:00010000:1.0:1746127010.626981:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7bb80 00000100:00100000:1.0:1746127010.627021:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8891 00000100:00100000:1.0:1746127010.627028:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991880704:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.652759:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.653242:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991880832 00000100:00100000:2.0:1746127010.653254:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991880832 00000100:00100000:2.0:1746127010.653311:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22143 00000100:00100000:2.0:1746127010.653320:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4580:x1830945991880832:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.653339:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.653361:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e96 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.653392:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.653394:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.653401:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.653416:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.653428:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2ac00, rc 0) 00000100:00100000:2.0:1746127010.653484:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4580:x1830945991880832:12345-192.168.203.42@tcp:101:cat.0 Request processed in 166us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.653489:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22143 00000100:00100000:2.0:1746127010.653897:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991880704:12345-192.168.203.42@tcp:3:cat.0 Request processed in 26870us (27436us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127010.653907:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8891 00002000:00100000:2.0:1746127010.653916:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a7bb80 x1830945991880704/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.653925:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7bb80 with x1830945991880704 ext(1048576->2097151) 00002000:00010000:2.0:1746127010.653929:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7bb80 00000100:00100000:0.0:1746127010.658229:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.658614:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991881088 00000100:00100000:2.0:1746127010.658624:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991881088 00002000:00100000:2.0:1746127010.658673:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a79180 x1830945991881088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.658684:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79180 with x1830945991881088 ext(1048576->2097151) 00002000:00010000:2.0:1746127010.658689:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79180 00000100:00100000:2.0:1746127010.658711:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8892 00000100:00100000:2.0:1746127010.658718:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991881088:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127010.681749:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991881088:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23018us (23516us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127010.681762:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8892 00002000:00100000:2.0:1746127010.681774:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a79180 x1830945991881088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.681784:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79180 with x1830945991881088 ext(1048576->2097151) 00002000:00010000:2.0:1746127010.681789:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79180 00000100:00100000:0.0:1746127010.681940:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.681986:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.682052:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991881344 00000100:00100000:2.0:1746127010.682060:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991881344 00000100:00100000:1.0:1746127010.682061:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991881600 00000100:00100000:1.0:1746127010.682065:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991881600 00002000:00100000:1.0:1746127010.682094:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880095caa300 x1830945991881600/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 504/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.682095:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4063231) req@ffff880130a79c00 x1830945991881344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.682102:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caa300 with x1830945991881600 ext(2097152->4194303) 00002000:00010000:1.0:1746127010.682105:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caa300 00002000:00100000:2.0:1746127010.682109:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79c00 with x1830945991881344 ext(2097152->4063231) 00002000:00010000:2.0:1746127010.682113:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79c00 00000100:00100000:1.0:1746127010.682291:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8893 00000100:00100000:3.0:1746127010.682296:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8894 00000100:00100000:1.0:1746127010.682298:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991881600:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127010.682303:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991881344:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.687888:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.687990:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991881856 00000100:00100000:1.0:1746127010.688012:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991881856 00000100:00100000:1.0:1746127010.688118:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17391 00000100:00100000:1.0:1746127010.688140:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4584:x1830945991881856:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127010.688165:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.688182:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6efb284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53e9d expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.688262:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688276:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688286:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688299:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688305:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688310:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688405:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb299 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688415:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb299 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688421:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb299 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127010.688430:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127010.688495:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688499:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688503:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688507:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688513:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc33800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127010.688516:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688523:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688534:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127010.688537:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127010.688541:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688546:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc33800/0x34dc807b6efb28b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688576:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688582:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688590:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688594:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebe600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127010.688596:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688601:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688607:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099bf6800) 00010000:00010000:1.0:1746127010.688609:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127010.688611:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688615:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe600/0x34dc807b6efb292 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.688650:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc32600/0x34dc807b6efb284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e9d expref: 38 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.688664:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb299 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e9d expref: 37 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.688670:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.688672:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127010.688674:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe400, rc 0) 00000100:00100000:1.0:1746127010.688728:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4584:x1830945991881856:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 599us (849us total) trans 8589938360 rc 0/0 00000100:00100000:1.0:1746127010.688735:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17391 00000100:00100000:0.0:1746127010.693828:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.693878:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.694181:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991881984 00000100:00100000:2.0:1746127010.694190:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991881984 00000100:00100000:2.0:1746127010.694248:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991882112 00000100:00100000:2.0:1746127010.694251:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991882112 00000100:00100000:2.0:1746127010.694275:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22144 00000100:00100000:2.0:1746127010.694282:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991881984:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.694306:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.694324:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb2a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ea4 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.694355:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22145 00000100:00100000:3.0:1746127010.694363:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991882112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.694370:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127010.694378:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994343040:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.694381:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a44c00/0x34dc807b6efb2ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53eab expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.694404:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994343168:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.694945:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.694949:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.706249:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.707019:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994343040:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127010.707061:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb2a7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ea4 expref: 47 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.707074:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb2a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ea4 expref: 47 pid: 1964 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127010.707246:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994343168:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.707267:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a44c00/0x34dc807b6efb2ae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eab expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.707277:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a44c00/0x34dc807b6efb2ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eab expref: 34 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.707290:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44c00, rc 0) 00000100:00100000:1.0:1746127010.707384:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991882368 00000100:00100000:1.0:1746127010.707391:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991882368 00000100:00100000:1.0:1746127010.707439:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17392 00000100:00100000:1.0:1746127010.707446:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4585:x1830945991882368:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127010.707466:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.707481:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53eb2 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.707562:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707574:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707585:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707597:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707603:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707608:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707703:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707712:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707717:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127010.707729:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127010.707803:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707809:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707815:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707820:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707826:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebec00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127010.707829:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707834:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707843:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127010.707846:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127010.707849:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707854:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb2bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707867:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707871:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707879:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707882:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebe200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127010.707884:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707889:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707894:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099bf6900) 00010000:00010000:1.0:1746127010.707895:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127010.707897:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707902:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.707935:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 17 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.707945:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 16 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.707951:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.707953:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127010.707955:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebf600, rc 0) 00010000:00010000:2.0:1746127010.708187:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7600, rc 0) 00000100:00100000:3.0:1746127010.708249:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991882112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 13886us (14369us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.708256:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22145 00000100:00100000:1.0:1746127010.709106:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4585:x1830945991882368:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1655us (2863us total) trans 8589938361 rc 0/0 00000100:00100000:1.0:1746127010.709113:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17392 00000100:00100000:2.0:1746127010.709486:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991881984:12345-192.168.203.42@tcp:101:cat.0 Request processed in 15202us (15667us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.709493:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22144 00000100:00100000:0.0:1746127010.721916:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.721962:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.722121:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991881600:12345-192.168.203.42@tcp:3:cat.0 Request processed in 39823us (40133us total) trans 0 rc 1757184/1757184 00000100:00100000:0.0:1746127010.722148:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8893 00002000:00100000:0.0:1746127010.722160:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880095caa300 x1830945991881600/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 504/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1757184/1757184 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.722170:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095caa300 with x1830945991881600 ext(2097152->4194303) 00002000:00010000:0.0:1746127010.722176:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095caa300 00000100:00100000:1.0:1746127010.722195:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991882496 00000100:00100000:1.0:1746127010.722203:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991882496 00000100:00100000:1.0:1746127010.722248:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17393 00000100:00100000:1.0:1746127010.722255:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4586:x1830945991882496:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127010.722275:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.722297:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb2d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53eb9 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.722358:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.722370:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.722380:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.722393:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.722397:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.722401:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.722468:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.722478:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.722483:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.722505:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991882624 00000100:00100000:2.0:1746127010.722508:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991882624 00010000:00010000:1.0:1746127010.722511:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.722525:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 36 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.722534:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22146 00000100:00100000:1.0:1746127010.722536:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123475880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994343296:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.722539:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4580:x1830945991882624:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.722546:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.722555:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ec0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.722573:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 31 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.722580:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127010.722581:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746127010.722583:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00010000:00010000:2.0:1746127010.722584:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 47 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.722599:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 31 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.722607:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 31 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.722615:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994343424:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.722642:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.725404:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.725461:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2029:x1830945991881344:12345-192.168.203.42@tcp:3:cat.0 Request processed in 43156us (43519us total) trans 0 rc 1966080/1966080 00000100:00100000:3.0:1746127010.725472:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8894 00002000:00100000:3.0:1746127010.725484:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4063231) req@ffff880130a79c00 x1830945991881344/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1966080/1966080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.725493:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79c00 with x1830945991881344 ext(2097152->4063231) 00000100:00100000:0.0:1746127010.725495:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127010.725501:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.725515:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127010.725521:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a79c00 00000100:00100000:0.0:1746127010.725528:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883008 00000100:00100000:0.0:1746127010.725534:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883008 00000100:00100000:0.0:1746127010.725576:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1039 00000100:00100000:0.0:1746127010.725582:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991883008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.725593:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.725617:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb299 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e9d expref: 37 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.725635:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127010.725639:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.725647:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.725651:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.725657:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127010.725676:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991883008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.725682:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1039 00000100:00100000:1.0:1746127010.725801:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991882880 00000100:00100000:1.0:1746127010.725805:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991882880 00000100:00100000:1.0:1746127010.725840:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6655 00000100:00100000:1.0:1746127010.725845:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4584:x1830945991882880:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127010.726963:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4584:x1830945991882880:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 1115us (1563us total) trans 8589938362 rc 0/0 00000100:00100000:1.0:1746127010.726970:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6655 00000100:00100000:1.0:1746127010.728987:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123475880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994343296:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127010.729024:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.729097:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994343424:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.729118:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 47 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.729166:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7000, rc 0) 00000100:00100000:2.0:1746127010.729202:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4580:x1830945991882624:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6661us (7238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.729209:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22146 00000100:00100000:0.0:1746127010.729504:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.729579:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883136 00000100:00100000:3.0:1746127010.729586:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883136 00002000:00100000:3.0:1746127010.729631:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4063232->4194303) req@ffff88007ec44a80 x1830945991883136/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.729640:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec44a80 with x1830945991883136 ext(4063232->4194303) 00010000:00010000:3.0:1746127010.729647:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.729664:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 30 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127010.729670:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ec44a80 00000100:00100000:3.0:1746127010.729698:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1981 00000100:00100000:3.0:1746127010.729705:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2026:x1830945991883136:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127010.738804:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.738850:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.738890:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883392 00000100:00100000:0.0:1746127010.738898:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883392 00000100:00100000:0.0:1746127010.738937:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22147 00000100:00100000:0.0:1746127010.738943:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+32:4577:x1830945991883392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127010.738965:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.738983:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ec7 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.739019:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127010.739020:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127010.739024:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.739036:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.739046:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6a00, rc 0) 00000100:00100000:0.0:1746127010.739082:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4577:x1830945991883392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 140us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.739088:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22147 00000100:00100000:1.0:1746127010.739568:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883264 00000100:00100000:1.0:1746127010.739573:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883264 00010000:00010000:1.0:1746127010.739596:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 37 pid: 13448 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746127010.739627:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10428 00000100:00100000:1.0:1746127010.739633:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991883264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127010.739644:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127010.739649:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 37 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.739658:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 37 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.739678:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb20d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e49 expref: 37 pid: 13448 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746127010.739694:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.739698:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.739708:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.739716:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.739737:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127010.739757:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:1.0:1746127010.739759:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991883264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 127us (965us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127010.739764:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:1.0:1746127010.739766:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10428 00000004:00200000:0.0:1746127010.739807:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746127010.739811:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746127010.739825:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739834:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739846:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739851:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739856:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739862:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739867:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebf800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127010.739871:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739876:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739885:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127010.739887:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127010.739890:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.739894:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb2df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740116:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740122:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740127:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740148:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebfc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127010.740150:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740154:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740161:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099bf6900) 00010000:00010000:0.0:1746127010.740163:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127010.740165:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740170:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebfc00/0x34dc807b6efb2e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127010.740198:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb2d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.740206:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 7 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.740213:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127010.740215:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746127010.740216:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe200, rc 0) 00000100:00100000:3.0:1746127010.740232:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2026:x1830945991883136:12345-192.168.203.42@tcp:4:cat.0 Request processed in 10527us (10729us total) trans 21474842960 rc 0/0 00000100:00100000:3.0:1746127010.740241:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1981 00002000:00100000:3.0:1746127010.740249:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4063232->4194303) req@ffff88007ec44a80 x1830945991883136/t21474842960(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/448 e 0 to 0 dl 1746127021 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746127010.740249:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4586:x1830945991882496:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 17994us (18343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.740254:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17393 00002000:00100000:3.0:1746127010.740258:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec44a80 with x1830945991883136 ext(4063232->4194303) 00010000:00010000:3.0:1746127010.740264:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 33 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.740275:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 33 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746127010.740280:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ec44a80 00000100:00100000:0.0:1746127010.742802:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.744441:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.744470:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.744498:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883520 00000100:00100000:1.0:1746127010.744503:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883648 00000100:00100000:0.0:1746127010.744506:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883520 00000100:00100000:1.0:1746127010.744507:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883648 00000100:00100000:0.0:1746127010.744549:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883776 00000100:00100000:0.0:1746127010.744550:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883776 00000100:00100000:0.0:1746127010.744561:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22148 00000100:00100000:1.0:1746127010.744568:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22149 00000100:00100000:0.0:1746127010.744568:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991883520:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:1.0:1746127010.744573:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991883648:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127010.744585:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.744585:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.744601:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc32600/0x34dc807b6efb309 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ed5 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.744601:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ece expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.744622:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.744624:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.744632:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.744646:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 13 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127010.744650:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123475880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994343552:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127010.744660:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6c00, rc 0) 00000100:00100000:0.0:1746127010.744693:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991883520:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 125us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.744698:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22148 00000100:00100000:0.0:1746127010.744709:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22150 00000100:00100000:0.0:1746127010.744713:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991883776:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127010.744717:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.744722:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53edc expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.744730:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.744731:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.744735:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.744743:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.744748:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6800, rc 0) 00000100:00100000:0.0:1746127010.744759:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991883776:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.744763:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22150 00000100:00100000:1.0:1746127010.746446:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.746534:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.746981:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.747044:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991883904 00000100:00100000:2.0:1746127010.747051:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991883904 00000100:00100000:0.0:1746127010.747054:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.747074:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991884032 00000100:00100000:0.0:1746127010.747077:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991884032 00000100:00100000:2.0:1746127010.747094:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991884160 00000100:00100000:2.0:1746127010.747097:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991884160 00000100:00100000:0.0:1746127010.747099:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22151 00000100:00100000:0.0:1746127010.747106:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991883904:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:2.0:1746127010.747114:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22152 00000100:00100000:2.0:1746127010.747119:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991884032:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127010.747121:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.747146:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.747152:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ee3 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.747172:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.747174:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.747181:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.747194:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127010.747204:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7600, rc 0) 00000100:00100000:0.0:1746127010.747238:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991883904:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 133us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.747244:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22151 00000100:00100000:0.0:1746127010.747259:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22153 00000100:00100000:0.0:1746127010.747263:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991884160:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127010.747270:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.747278:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac7a00/0x34dc807b6efb31e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ef1 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127010.747311:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994343680:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127010.747360:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2600 going to sleep for 11 seconds 00010000:00010000:3.0:1746127010.750934:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a44e00/0x34dc807b6efb325 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53eea expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.751016:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994343808:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127010.751026:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.751078:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.751110:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991884288 00000100:00100000:3.0:1746127010.751116:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991884288 00010000:00010000:3.0:1746127010.751156:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 33 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.751186:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10429 00000100:00100000:3.0:1746127010.751191:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991884288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.751200:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.751218:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 33 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.751228:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 33 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.751252:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.751254:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.751262:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.751269:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.751275:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.751276:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.751278:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.751283:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.751300:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.751307:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994343936:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127010.751335:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.751342:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994344064:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127010.751356:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2c00 going to sleep for 11 seconds 00002000:00010000:3.0:1746127010.751386:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127008 -> 1746127009 00002000:00010000:3.0:1746127010.751389:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127008 -> 1746127009 00002000:00010000:3.0:1746127010.751391:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127008 -> 1746127009 00000100:00100000:3.0:1746127010.751402:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123475880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994343552:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.751426:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc32600/0x34dc807b6efb309 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ed5 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.751437:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32600/0x34dc807b6efb309 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ed5 expref: 11 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.751451:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32600, rc 0) 00000100:00100000:3.0:1746127010.751473:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991883648:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6899us (7036us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.751480:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22149 00000100:00100000:1.0:1746127010.751638:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994343680:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127010.751657:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7a00/0x34dc807b6efb31e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef1 expref: 9 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.751666:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7a00/0x34dc807b6efb31e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef1 expref: 9 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.751676:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7a00, rc 0) 00000100:00100000:1.0:1746127010.751696:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991884160:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4432us (4642us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127010.751702:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22153 00010000:00010000:3.0:1746127010.757539:0:11152:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff88012ba55500 x1830945994343808) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 33 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.757581:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011de0c400/0x34dc807b6efb1f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e3b expref: 33 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.757594:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11152:1830945994343808:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.757629:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a44e00/0x34dc807b6efb325 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eea expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.757641:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a44e00/0x34dc807b6efb325 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eea expref: 15 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.757648:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44e00, rc 0) 00000100:00100000:3.0:1746127010.757703:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991884032:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 10582us (10720us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.757712:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22152 00000100:00100000:1.0:1746127010.760578:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.760641:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991884544 00000100:00100000:2.0:1746127010.760649:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991884544 00002000:00100000:2.0:1746127010.760694:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880123476300 x1830945991884544/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.760705:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476300 with x1830945991884544 ext(3145728->4194303) 00002000:00010000:2.0:1746127010.760709:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123476300 00000100:00100000:2.0:1746127010.760730:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8895 00000100:00100000:2.0:1746127010.760737:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991884544:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127010.761552:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994343936:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127010.761561:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994344064:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127010.761581:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.761607:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991884288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10415us (10583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.761616:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10429 00000100:00100000:0.0:1746127010.766583:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.766753:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991884800 00000100:00100000:1.0:1746127010.766763:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991884800 00002000:00100000:1.0:1746127010.766805:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88007ec46d80 x1830945991884800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.766815:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec46d80 with x1830945991884800 ext(2097152->3145727) 00002000:00010000:1.0:1746127010.766820:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec46d80 00000100:00100000:1.0:1746127010.766845:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8896 00000100:00100000:1.0:1746127010.766852:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991884800:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.767235:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.767344:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885056 00000100:00100000:2.0:1746127010.767704:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885056 00000100:00100000:2.0:1746127010.767841:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17394 00000100:00100000:2.0:1746127010.767848:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4586:x1830945991885056:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127010.767861:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.767881:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6e00/0x34dc807b6efb32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ef8 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.768032:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.768047:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.768054:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.768082:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.768093:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 8 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.768105:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994344192:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.768184:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.768775:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2027:x1830945991884544:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8036us (8203us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127010.768784:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8895 00002000:00100000:2.0:1746127010.768794:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880123476300 x1830945991884544/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.768803:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476300 with x1830945991884544 ext(3145728->4194303) 00002000:00010000:2.0:1746127010.768807:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123476300 00000100:00100000:2.0:1746127010.773518:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994344192:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.773551:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127010.775056:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.775365:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885184 00000100:00100000:3.0:1746127010.775374:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885184 00010000:00010000:3.0:1746127010.775409:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 9 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.775435:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10430 00000100:00100000:3.0:1746127010.775442:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991885184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.775454:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.775460:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 9 pid: 7259 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.775471:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 9 pid: 7259 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.775492:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb2ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb9 expref: 9 pid: 7259 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.775524:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127010.775530:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.775540:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.775547:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127010.775567:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.775609:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991885184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 167us (559us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127010.776345:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.776355:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:2.0:1746127010.776377:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127010.776492:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6e00/0x34dc807b6efb32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.776521:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.776527:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.776529:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127010.776531:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd6000, rc 0) 00000100:00100000:2.0:1746127010.776559:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4586:x1830945991885056:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 8712us (9324us total) trans 8589938363 rc 0/0 00000100:00100000:2.0:1746127010.776565:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17394 00000100:00100000:3.0:1746127010.776643:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10430 00000100:00100000:0.0:1746127010.779791:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.780982:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885312 00000100:00100000:3.0:1746127010.780992:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885312 00000100:00100000:0.0:1746127010.783231:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.783476:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885440 00000100:00100000:2.0:1746127010.783483:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885440 00000100:00100000:2.0:1746127010.783525:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17395 00000100:00100000:2.0:1746127010.783532:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4586:x1830945991885440:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127010.783558:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.783578:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6efb341 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f06 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.783672:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.783685:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.783691:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.783721:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.783731:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 9 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.783743:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994344320:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.783823:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.784037:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991884800:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17184us (17464us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127010.784046:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8896 00002000:00100000:1.0:1746127010.784055:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88007ec46d80 x1830945991884800/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.784064:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec46d80 with x1830945991884800 ext(2097152->3145727) 00002000:00010000:1.0:1746127010.784069:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec46d80 00000100:00100000:3.0:1746127010.784287:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22154 00000100:00100000:3.0:1746127010.784296:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991885312:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.784306:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.784317:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e983000/0x34dc807b6efb34f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53eff expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.784349:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994344448:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.784399:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.791722:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994344320:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.791753:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127010.792487:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.793535:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885568 00000100:00100000:2.0:1746127010.793544:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885568 00010000:00010000:2.0:1746127010.793579:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 10 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.793616:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10431 00000100:00100000:2.0:1746127010.793624:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991885568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.793638:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.793643:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 10 pid: 7259 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.793654:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 10 pid: 7259 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.793675:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd6000/0x34dc807b6efb333 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ef8 expref: 10 pid: 7259 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.795073:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.795202:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994344448:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.795232:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e983000/0x34dc807b6efb34f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eff expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.795244:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e983000/0x34dc807b6efb34f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eff expref: 12 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.795259:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983000, rc 0) 00000100:00100000:3.0:1746127010.795312:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991885312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 11017us (15531us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.795319:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22154 00010000:00010000:2.0:1746127010.795415:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127010.795421:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.795431:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.795438:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127010.795457:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127010.795473:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.795476:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991885568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1854us (2992us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127010.795480:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127010.795483:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10431 00000004:00200000:1.0:1746127010.795530:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127010.795535:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127010.795549:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.795578:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7400/0x34dc807b6efb341 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.795593:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.795598:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.795701:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127010.795704:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7600, rc 0) 00000100:00100000:1.0:1746127010.795727:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4586:x1830945991885440:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 12196us (12505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127010.795732:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17395 00000100:00100000:3.0:1746127010.795858:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885696 00000100:00100000:3.0:1746127010.795862:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885696 00000100:00100000:3.0:1746127010.795891:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22155 00000100:00100000:3.0:1746127010.795896:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4580:x1830945991885696:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.795908:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.795920:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f0d expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.795942:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.795948:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127010.795950:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127010.795953:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 34 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.795974:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 10 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.795985:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 10 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.795996:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994344576:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.796061:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.798941:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994344576:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.798975:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 34 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.798992:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e982200, rc 0) 00000100:00100000:3.0:1746127010.799063:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4580:x1830945991885696:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3165us (3990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.799072:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22155 00000100:00100000:0.0:1746127010.799470:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.799518:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.799713:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885952 00000100:00100000:1.0:1746127010.799720:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885952 00000100:00100000:1.0:1746127010.799755:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991886080 00000100:00100000:1.0:1746127010.799757:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991886080 00000100:00100000:1.0:1746127010.799780:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22156 00000100:00100000:1.0:1746127010.799786:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991885952:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127010.799799:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.799815:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bebf800/0x34dc807b6efb35d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f14 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.799862:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994344704:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127010.799919:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.800053:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22157 00000100:00100000:2.0:1746127010.800063:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991886080:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127010.800070:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.800080:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f1b expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.800096:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.800097:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.800106:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.800118:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.800125:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673400, rc 0) 00000100:00100000:2.0:1746127010.800161:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991886080:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 100us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.800166:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22157 00000100:00100000:1.0:1746127010.804303:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.804358:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.804410:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991885824 00000100:00100000:0.0:1746127010.804419:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991885824 00002000:00100000:0.0:1746127010.804466:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3485695) req@ffff880123474e00 x1830945991885824/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.804475:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474e00 with x1830945991885824 ext(3145728->3485695) 00010000:00010000:0.0:1746127010.804484:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 11 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.804498:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 11 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127010.804505:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880123474e00 00000100:00100000:0.0:1746127010.804534:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1982 00000100:00100000:0.0:1746127010.804541:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991885824:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127010.804724:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991886208 00000100:00100000:3.0:1746127010.804733:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991886208 00000100:00100000:3.0:1746127010.804757:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22158 00000100:00100000:3.0:1746127010.804762:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991886208:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127010.804771:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.804784:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e983800/0x34dc807b6efb36b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f22 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.805014:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994344832:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.805465:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.807174:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994344704:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127010.807208:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bebf800/0x34dc807b6efb35d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f14 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.807221:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bebf800/0x34dc807b6efb35d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f14 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.807249:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebf800, rc 0) 00000100:00100000:1.0:1746127010.807289:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991885952:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7501us (7818us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127010.807296:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22156 00000100:00100000:0.0:1746127010.808620:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.808969:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994344832:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.808995:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e983800/0x34dc807b6efb36b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f22 expref: 9 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.809020:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e983800/0x34dc807b6efb36b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f22 expref: 9 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.809032:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983800, rc 0) 00000100:00100000:3.0:1746127010.809058:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991886208:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4295us (4766us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.809064:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22158 00000100:00100000:3.0:1746127010.809125:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991886464 00000100:00100000:3.0:1746127010.809148:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991886464 00002000:00100000:3.0:1746127010.809182:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88013084b850 x1830945991886464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127010.809191:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013084b850 with x1830945991886464 ext(4194304->4829183) 00002000:00010000:3.0:1746127010.809196:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013084b850 00000100:00100000:3.0:1746127010.809211:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8897 00000100:00100000:3.0:1746127010.809217:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013084b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2027:x1830945991886464:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127010.813996:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.814077:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991886720 00000100:00100000:1.0:1746127010.814087:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991886720 00000100:00100000:1.0:1746127010.814392:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17396 00000100:00100000:1.0:1746127010.814402:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4586:x1830945991886720:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127010.814421:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.814439:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb372 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f29 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.814532:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814546:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814556:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814568:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814573:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814578:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814584:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebe800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127010.814587:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814593:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814602:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127010.814605:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746127010.814609:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.814614:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb379 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127010.816349:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb372 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f29 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.816360:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebec00/0x34dc807b6efb372 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f29 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.816371:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebec00, rc 0) 00000100:00100000:1.0:1746127010.816429:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4586:x1830945991886720:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2028us (2443us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127010.816437:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17396 00000100:00100000:0.0:1746127010.816751:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991885824:12345-192.168.203.42@tcp:4:cat.0 Request processed in 12209us (12390us total) trans 17179875686 rc 0/0 00000100:00100000:0.0:1746127010.816761:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1982 00002000:00100000:0.0:1746127010.816770:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3485695) req@ffff880123474e00 x1830945991885824/t17179875686(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/448 e 0 to 0 dl 1746127021 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.816780:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474e00 with x1830945991885824 ext(3145728->3485695) 00010000:00010000:0.0:1746127010.816790:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 13 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.816803:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 13 pid: 11152 timeout: 1005 lvb_type: 0 00002000:00010000:0.0:1746127010.816810:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880123474e00 00000100:00100000:0.0:1746127010.816973:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013084b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2027:x1830945991886464:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7755us (8355us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746127010.816979:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8897 00002000:00100000:0.0:1746127010.816985:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88013084b850 x1830945991886464/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.816992:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013084b850 with x1830945991886464 ext(4194304->4829183) 00002000:00010000:0.0:1746127010.816995:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013084b850 00000100:00100000:2.0:1746127010.822427:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.822465:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991886976 00000100:00100000:1.0:1746127010.822475:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991886976 00000100:00100000:1.0:1746127010.823092:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6656 00000100:00100000:1.0:1746127010.823103:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4586:x1830945991886976:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1746127010.824646:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4586:x1830945991886976:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 1538us (2223us total) trans 8589938364 rc 0/0 00000100:00100000:1.0:1746127010.824657:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6656 00000100:00100000:2.0:1746127010.826490:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.826529:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.826574:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.826595:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991887360 00000100:00100000:2.0:1746127010.826603:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991887360 00010000:00010000:2.0:1746127010.826639:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 13 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.826666:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10432 00000100:00100000:2.0:1746127010.826672:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991887360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.826687:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.826707:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 13 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.826725:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 13 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.826748:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006f3e8400/0x34dc807b6efb1ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e42 expref: 13 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.826767:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.826769:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.826776:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 33 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.826783:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 33 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.826815:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 33 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.826828:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994344960:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127010.826908:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.827039:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991887104 00000100:00100000:1.0:1746127010.827043:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991887104 00000100:00100000:1.0:1746127010.827064:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991887232 00000100:00100000:1.0:1746127010.827066:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991887232 00000100:00100000:1.0:1746127010.827078:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22159 00000100:00100000:1.0:1746127010.827083:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991887104:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127010.827098:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127010.827109:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bebfc00/0x34dc807b6efb380 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f30 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.827158:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994345088:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127010.827198:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.827270:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22160 00000100:00100000:3.0:1746127010.827278:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991887232:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.827285:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.827292:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f37 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.827314:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.827315:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.827320:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.827331:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.827339:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076179400, rc 0) 00000100:00100000:3.0:1746127010.827366:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991887232:12345-192.168.203.42@tcp:101:cat.0 Request processed in 90us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.827372:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22160 00000100:00100000:0.0:1746127010.840223:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994344960:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127010.840249:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.840287:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.840295:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991887360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 13622us (13720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.840306:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10432 00000100:00100000:3.0:1746127010.840409:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991887488 00000100:00100000:3.0:1746127010.840417:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991887488 00000100:00100000:3.0:1746127010.840454:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22161 00000100:00100000:3.0:1746127010.840460:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:4585:x1830945991887488:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127010.840478:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.840497:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f3e expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.840526:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.840535:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 14 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.840541:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.840547:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.840548:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.840552:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [1691648->2097151] (req 1691648->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.840581:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.840592:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 46 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.840603:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.840668:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 14 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.840677:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 14 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.840685:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345344:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.840706:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.840712:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 33 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.840718:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345472:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.840730:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.840856:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994345088:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127010.840879:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bebfc00/0x34dc807b6efb380 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f30 expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.840890:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bebfc00/0x34dc807b6efb380 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f30 expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.840915:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebfc00, rc 0) 00000100:00100000:1.0:1746127010.840936:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991887104:12345-192.168.203.42@tcp:101:cat.0 Request processed in 13852us (14452us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127010.840942:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22159 00000100:00100000:2.0:1746127010.844805:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.844890:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.844989:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991887872 00000100:00100000:1.0:1746127010.844997:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991887872 00002000:00100000:1.0:1746127010.845046:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012d3fd880 x1830945991887872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.845055:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fd880 with x1830945991887872 ext(2097152->4194303) 00002000:00010000:1.0:1746127010.845060:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fd880 00000100:00100000:1.0:1746127010.846151:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991888000 00000100:00100000:1.0:1746127010.846158:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991888000 00002000:00100000:1.0:1746127010.846180:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012d3fed80 x1830945991888000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.846188:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fed80 with x1830945991888000 ext(3145728->4194303) 00002000:00010000:1.0:1746127010.846191:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fed80 00000100:00100000:2.0:1746127010.847219:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8898 00000100:00100000:2.0:1746127010.847230:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991887872:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.850388:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8899 00000100:00100000:1.0:1746127010.850404:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991888000:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127010.857773:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.857805:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.857830:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991888128 00000100:00100000:0.0:1746127010.857838:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991888128 00010000:00010000:0.0:1746127010.857875:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 49 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.857902:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991888384 00000100:00100000:0.0:1746127010.857904:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991888384 00010000:00010000:0.0:1746127010.857913:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.857926:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10433 00000100:00100000:0.0:1746127010.857932:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2029:x1830945991888128:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.857946:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.857966:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 49 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.857977:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 49 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.858014:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127010.858071:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2029:x1830945991888128:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 139us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.858079:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10433 00000100:00100000:0.0:1746127010.858114:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10434 00000100:00100000:0.0:1746127010.858119:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2029:x1830945991888384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.858155:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.858162:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.858168:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.858179:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127010.858193:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2029:x1830945991888384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.858199:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10434 00000100:00100000:0.0:1746127010.858244:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.858258:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991888256 00000100:00100000:0.0:1746127010.858261:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991888256 00010000:00010000:0.0:1746127010.858271:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746127010.858284:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10435 00000100:00100000:0.0:1746127010.858288:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991888256:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.858294:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.858300:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746127010.858308:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746127010.858318:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.858320:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127010.858327:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.858334:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.858361:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127010.858373:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994345600:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127010.858428:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.858478:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.858510:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127010.858518:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2ac00/0x34dc807b6efb27d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e96 expref: 48 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.858536:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.858547:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac7600/0x34dc807b6efb317 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ee3 expref: 15 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746127010.858547:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991888512 00000100:00100000:0.0:1746127010.858550:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991888512 00000100:00100000:3.0:1746127010.858555:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345344:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.858564:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880077c2b000/0x34dc807b6efb276 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e8f expref: 33 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.858572:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345472:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127010.858574:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991888640 00000100:00100000:0.0:1746127010.858576:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991888640 00000100:00100000:0.0:1746127010.858592:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22162 00000100:00100000:0.0:1746127010.858597:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991888512:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.858599:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.858610:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.858612:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076179600, rc 0) 00010000:00010000:0.0:1746127010.858624:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009caea800/0x34dc807b6efb395 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f45 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.858637:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+33:4585:x1830945991887488:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 18178us (18352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.858643:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22161 00000100:00100000:0.0:1746127010.858655:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994345728:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.858661:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22163 00000100:00100000:3.0:1746127010.858666:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2028:x1830945991888640:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.858673:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746127010.858675:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746127010.858680:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e4a00/0x34dc807b6efb39c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f4c expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.858699:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345856:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127010.858720:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746127010.868596:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994345600:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127010.868644:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.869227:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994345728:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127010.869262:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991888256:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10970us (11014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.869264:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991887872:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22035us (24464us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127010.869272:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10435 00010000:00010000:3.0:1746127010.869273:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009caea800/0x34dc807b6efb395 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f45 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127010.869277:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8898 00010000:00010000:3.0:1746127010.869286:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caea800/0x34dc807b6efb395 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f45 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746127010.869287:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88012d3fd880 x1830945991887872/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127010.869296:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fd880 with x1830945991887872 ext(2097152->4194303) 00010000:00010000:3.0:1746127010.869298:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caea800, rc 0) 00002000:00010000:0.0:1746127010.869302:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3fd880 00000100:00100000:3.0:1746127010.869317:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991888512:12345-192.168.203.42@tcp:101:cat.0 Request processed in 10720us (10839us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.869323:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22162 00002000:00010000:3.0:1746127010.874833:0:9613:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746127008 -> 1746127009 00000100:00100000:3.0:1746127010.874866:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994345856:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.874903:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4a00/0x34dc807b6efb39c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f4c expref: 33 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.874917:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4a00/0x34dc807b6efb39c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f4c expref: 33 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.874930:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4a00, rc 0) 00000100:00100000:3.0:1746127010.874995:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2028:x1830945991888640:12345-192.168.203.42@tcp:101:cat.0 Request processed in 16327us (16483us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.875011:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22163 00000100:00100000:0.0:1746127010.876050:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.876258:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991888896 00000100:00100000:2.0:1746127010.876266:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991888896 00002000:00100000:2.0:1746127010.876302:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1691648->1695743) req@ffff88011dc63100 x1830945991888896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.876312:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63100 with x1830945991888896 ext(1691648->1695743) 00002000:00010000:2.0:1746127010.876317:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63100 00000100:00100000:2.0:1746127010.876345:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8900 00000100:00100000:2.0:1746127010.876351:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991888896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127010.876464:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991888896:12345-192.168.203.42@tcp:3:cat.0 Request processed in 112us (419us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127010.876469:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8900 00002000:00100000:2.0:1746127010.876473:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1691648->1695743) req@ffff88011dc63100 x1830945991888896/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127010.876480:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63100 with x1830945991888896 ext(1691648->1695743) 00002000:00010000:2.0:1746127010.876482:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63100 00000100:00100000:1.0:1746127010.886507:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991888000:12345-192.168.203.42@tcp:3:cat.0 Request processed in 36102us (41608us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127010.886517:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8899 00002000:00100000:1.0:1746127010.886527:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88012d3fed80 x1830945991888000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.886536:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fed80 with x1830945991888000 ext(3145728->4194303) 00002000:00010000:1.0:1746127010.886540:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fed80 00000100:00100000:0.0:1746127010.895311:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.895397:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991889024 00000100:00100000:3.0:1746127010.895407:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991889024 00000100:00100000:0.0:1746127010.895538:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.896357:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991889152 00000100:00100000:3.0:1746127010.896362:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991889152 00000100:00100000:3.0:1746127010.896423:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22164 00000100:00100000:3.0:1746127010.896432:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:4585:x1830945991889024:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:1.0:1746127010.896442:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22165 00010000:00010000:3.0:1746127010.896451:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127010.896460:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991889152:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.896469:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f53 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.896476:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.896503:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127010.896510:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f5a expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.896512:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 13 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.896524:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.896530:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.896532:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.896535:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 33 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.896557:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994345984:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127010.896562:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.896573:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 33 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.896584:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994346112:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127010.896638:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2240 going to sleep for 11 seconds 00010000:00010000:3.0:1746127010.896699:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 13 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.896707:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 13 pid: 1507 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.896715:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994346240:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.896752:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 47 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.896764:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 47 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.896773:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994346368:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.896801:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.901612:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.901684:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.901739:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991889280 00000100:00100000:0.0:1746127010.901749:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991889280 00010000:00010000:0.0:1746127010.901792:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.901824:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991889408 00000100:00100000:0.0:1746127010.901827:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991889408 00010000:00010000:0.0:1746127010.901842:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 14 pid: 1507 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746127010.901864:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10436 00000100:00100000:0.0:1746127010.901872:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2027:x1830945991889280:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127010.901889:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127010.901915:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746127010.901932:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.902286:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6a00/0x34dc807b6efb2fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec7 expref: 34 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.902336:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994346112:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.902352:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994346240:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127010.902392:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10437 00000100:00100000:3.0:1746127010.902401:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991889408:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.902410:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127010.902515:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994345984:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127010.902547:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3aa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f5a expref: 47 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.902560:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f5a expref: 47 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127010.902575:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe200, rc 0) 00000100:00100000:1.0:1746127010.902635:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2028:x1830945991889152:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6180us (7095us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127010.902643:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22165 00010000:00010000:0.0:1746127010.903236:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127010.903268:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+33:2027:x1830945991889280:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1395us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127010.903276:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10436 00010000:00010000:3.0:1746127010.903942:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 14 pid: 1507 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.903947:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9613:1830945994346368:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127010.903952:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 14 pid: 1507 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.903967:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098673400/0x34dc807b6efb364 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f1b expref: 14 pid: 1507 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746127010.903972:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 32 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.903976:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127010.903980:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5c00, rc 0) 00000100:00100000:3.0:1746127010.903995:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991889408:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1597us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.903995:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:4585:x1830945991889024:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7566us (8695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.904014:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10437 00000100:00100000:2.0:1746127010.904014:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22164 00000100:00100000:0.0:1746127010.904672:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.904715:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.904745:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991889664 00000100:00100000:2.0:1746127010.904750:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991889664 00000100:00100000:3.0:1746127010.904775:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991889536 00000100:00100000:3.0:1746127010.904779:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991889536 00000100:00100000:2.0:1746127010.904788:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22166 00010000:00010000:3.0:1746127010.904796:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 47 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.904796:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4580:x1830945991889664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.904809:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127010.904813:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10438 00000100:00100000:3.0:1746127010.904818:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991889536:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127010.904821:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f61 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.904826:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127010.904836:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.904838:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.904846:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 48 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.904884:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 48 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.904888:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 48 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746127010.904892:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fe00, rc 0) 00010000:00010000:3.0:1746127010.904899:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 48 pid: 1964 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.904910:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7000/0x34dc807b6efb2f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ec0 expref: 48 pid: 1964 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.904913:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4580:x1830945991889664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 119us (199us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127010.904918:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127010.904918:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22166 00010000:00010000:3.0:1746127010.904920:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.904924:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.904932:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.904962:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.904974:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994346496:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127010.905053:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.906021:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994346496:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127010.906033:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.906092:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991889536:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1273us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.906100:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10438 00000100:00100000:0.0:1746127010.906921:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.907066:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991889920 00000100:00100000:1.0:1746127010.907072:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991889920 00002000:00100000:1.0:1746127010.907111:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88011dc63480 x1830945991889920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.907160:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63480 with x1830945991889920 ext(4194304->4829183) 00002000:00010000:1.0:1746127010.907165:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63480 00000100:00100000:1.0:1746127010.907195:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8901 00000100:00100000:1.0:1746127010.907202:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991889920:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127010.907301:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746127010.911325:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991889920:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4111us (4392us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127010.911342:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8901 00002000:00100000:1.0:1746127010.911353:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88011dc63480 x1830945991889920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/440 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.911368:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc63480 with x1830945991889920 ext(4194304->4829183) 00002000:00010000:1.0:1746127010.911375:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc63480 00000100:00100000:0.0:1746127010.911648:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.911858:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991890176 00000100:00100000:1.0:1746127010.911865:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991890176 00002000:00100000:1.0:1746127010.911902:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2424832->2428927) req@ffff88011dc60000 x1830945991890176/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.911910:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60000 with x1830945991890176 ext(2424832->2428927) 00002000:00010000:1.0:1746127010.911914:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60000 00000100:00100000:1.0:1746127010.911938:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8902 00000100:00100000:1.0:1746127010.911945:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991890176:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.912065:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991890176:12345-192.168.203.42@tcp:3:cat.0 Request processed in 121us (417us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127010.912071:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8902 00002000:00100000:1.0:1746127010.912076:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2424832->2428927) req@ffff88011dc60000 x1830945991890176/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.912083:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dc60000 with x1830945991890176 ext(2424832->2428927) 00002000:00010000:1.0:1746127010.912085:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dc60000 00000100:00100000:0.0:1746127010.915364:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.915407:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.915494:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.915919:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991890560 00000100:00100000:2.0:1746127010.915928:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991890560 00000100:00100000:2.0:1746127010.915970:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991890688 00000100:00100000:2.0:1746127010.915972:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991890688 00000100:00100000:2.0:1746127010.915986:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22167 00000100:00100000:2.0:1746127010.915993:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991890560:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.916024:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.916044:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213e800/0x34dc807b6efb3b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f68 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.916098:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22168 00000100:00100000:3.0:1746127010.916107:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991890688:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127010.916113:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991890432 00000100:00100000:1.0:1746127010.916117:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991890432 00010000:00010000:3.0:1746127010.916120:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.916151:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb3bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f6f expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127010.916167:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6657 00000100:00100000:1.0:1746127010.916172:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4585:x1830945991890432:12345-192.168.203.42@tcp:35:multiop.0 00010000:00010000:3.0:1746127010.916182:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb3bf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f6f expref: 48 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.916192:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb3bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f6f expref: 48 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.916204:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5000, rc 0) 00000100:00100000:3.0:1746127010.916250:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991890688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 144us (755us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.916257:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22168 00000100:00100000:1.0:1746127010.916347:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4585:x1830945991890432:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 174us (993us total) trans 8589938365 rc 0/0 00000100:00100000:1.0:1746127010.916357:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6657 00000100:00100000:2.0:1746127010.916705:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994346624:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127010.916760:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.917151:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.917325:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991890816 00000100:00100000:0.0:1746127010.917330:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991890816 00000100:00100000:0.0:1746127010.917354:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22169 00000100:00100000:0.0:1746127010.917360:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4584:x1830945991890816:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127010.917369:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127010.917379:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f76 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.917396:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 49 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.917403:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127010.917405:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127010.917409:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2441216->3145727] (req 2441216->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 49 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.917429:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 49 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127010.917440:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 49 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746127010.917449:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994346752:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127010.917654:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127010.920252:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994346624:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127010.920291:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213e800/0x34dc807b6efb3b8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f68 expref: 49 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.920305:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012213e800/0x34dc807b6efb3b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f68 expref: 49 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.920319:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e800, rc 0) 00000100:00100000:2.0:1746127010.920373:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991890560:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4379us (4963us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.920381:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22167 00000100:00100000:0.0:1746127010.922104:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.922401:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994346752:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.922430:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2441216->3145727] (req 2441216->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 47 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.922447:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdb3800, rc 0) 00000100:00100000:3.0:1746127010.922505:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991890944 00000100:00100000:3.0:1746127010.922512:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991890944 00000100:00100000:3.0:1746127010.922552:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22170 00000100:00100000:3.0:1746127010.922558:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4580:x1830945991890944:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127010.922565:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4584:x1830945991890816:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5203us (5434us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127010.922572:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.922586:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f7d expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.922604:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.922606:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.922614:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 49 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.922627:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 49 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.922634:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e4000, rc 0) 00000100:00100000:3.0:1746127010.922660:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:4580:x1830945991890944:12345-192.168.203.42@tcp:101:cat.0 Request processed in 102us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.922665:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22170 00000100:00100000:2.0:1746127010.922779:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22169 00000100:00100000:0.0:1746127010.923675:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.923825:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991891072 00000100:00100000:3.0:1746127010.923830:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991891072 00010000:00010000:3.0:1746127010.923853:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 48 pid: 9613 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.923881:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10439 00000100:00100000:3.0:1746127010.923888:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991891072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.923898:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.923918:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 48 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.923927:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 48 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.923946:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012213fe00/0x34dc807b6efb3b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2428928->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f61 expref: 48 pid: 9613 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.923957:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.923959:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.923963:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 47 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.923970:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 47 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.924010:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 47 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.924022:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994346880:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127010.924548:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.925257:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994347008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746127010.925298:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127010.925440:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994347008 00000100:00100000:2.0:1746127010.925445:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994347008 00000100:00100000:2.0:1746127010.926367:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1746127010.926376:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994347008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746127010.926399:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 430080 granted 1138670912 pending 10436608 free 3907129344 avail 3675607040 00000100:00100000:2.0:1746127010.926451:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994347008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.926457:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1746127010.926491:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994347008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746127010.926864:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.927255:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991891200 00000100:00100000:2.0:1746127010.927259:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991891200 00000100:00100000:1.0:1746127010.927689:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.927751:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991891328 00000100:00100000:2.0:1746127010.927754:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991891328 00000100:00100000:2.0:1746127010.927766:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22171 00000100:00100000:2.0:1746127010.927771:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991891200:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127010.927782:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.927797:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213f000/0x34dc807b6efb3d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f84 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127010.927847:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994347136:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127010.927915:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127010.927979:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22172 00000100:00100000:3.0:1746127010.927988:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991891328:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127010.927995:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127010.928014:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb3db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f8b expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.928032:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb3db lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f8b expref: 51 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.928041:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb3db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f8b expref: 51 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127010.928049:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5000, rc 0) 00000100:00100000:3.0:1746127010.928070:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991891328:12345-192.168.203.42@tcp:101:cat.0 Request processed in 84us (381us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127010.928076:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22172 00000100:00100000:0.0:1746127010.931604:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.931736:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994346880:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127010.931760:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.931805:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2029:x1830945991891072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7916us (8129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.931815:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10439 00000100:00100000:1.0:1746127010.931903:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991891584 00000100:00100000:1.0:1746127010.931911:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991891584 00000100:00100000:2.0:1746127010.931942:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994347136:192.168.203.42@tcp:106: 00002000:00100000:1.0:1746127010.931952:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2441216->2445311) req@ffff880094a61180 x1830945991891584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.931960:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61180 with x1830945991891584 ext(2441216->2445311) 00002000:00010000:1.0:1746127010.931964:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a61180 00010000:00010000:2.0:1746127010.931967:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213f000/0x34dc807b6efb3d4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f84 expref: 49 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.931979:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012213f000/0x34dc807b6efb3d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f84 expref: 49 pid: 1964 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746127010.931979:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8903 00000100:00100000:1.0:1746127010.931985:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991891584:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127010.931991:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213f000, rc 0) 00000100:00100000:2.0:1746127010.932027:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991891200:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4255us (5165us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127010.932034:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22171 00000100:00100000:1.0:1746127010.933270:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991891584:12345-192.168.203.42@tcp:3:cat.0 Request processed in 1278us (1670us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127010.933280:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8903 00002000:00100000:1.0:1746127010.933288:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (2441216->2445311) req@ffff880094a61180 x1830945991891584/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.933297:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61180 with x1830945991891584 ext(2441216->2445311) 00002000:00010000:1.0:1746127010.933301:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a61180 00000100:00100000:0.0:1746127010.937577:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.939205:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991891840 00000100:00100000:1.0:1746127010.939217:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991891840 00002000:00100000:1.0:1746127010.939271:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff880094a61c00 x1830945991891840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.939286:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61c00 with x1830945991891840 ext(4825088->4829183) 00002000:00010000:1.0:1746127010.939292:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a61c00 00000100:00100000:1.0:1746127010.939331:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8904 00000100:00100000:1.0:1746127010.939339:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991891840:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.939737:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991891840:12345-192.168.203.42@tcp:3:cat.0 Request processed in 397us (2169us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127010.939744:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8904 00002000:00100000:1.0:1746127010.939750:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff880094a61c00 x1830945991891840/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.939756:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a61c00 with x1830945991891840 ext(4825088->4829183) 00002000:00010000:1.0:1746127010.939759:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a61c00 00000100:00100000:2.0:1746127010.942985:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746127010.943015:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994347264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746127010.943078:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127010.943341:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994347264 00000100:00100000:3.0:1746127010.943351:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994347264 00000100:00100000:3.0:1746127010.943390:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1746127010.943398:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994347264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746127010.943422:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 159744 granted 1105067328 pending 1294336 free 3910705152 avail 3670089728 00000100:00100000:3.0:1746127010.943472:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994347264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.943478:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1746127010.943592:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994347264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746127010.949382:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127010.949976:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991891968 00000100:00100000:2.0:1746127010.949986:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991891968 00000100:00100000:2.0:1746127010.950058:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22173 00000100:00100000:2.0:1746127010.950067:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4584:x1830945991891968:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127010.950085:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127010.950103:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f92 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.950160:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.950168:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 12 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.950175:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.950176:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127010.950179:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->2293759] (req 2097152->2293759) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 35 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.950206:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 12 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127010.950217:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 12 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.950229:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994347392:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.950337:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 35 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.950345:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 35 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.950352:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994347520:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127010.950371:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127010.957341:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127010.957385:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127010.957472:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991892096 00000100:00100000:3.0:1746127010.957481:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991892096 00010000:00010000:3.0:1746127010.957519:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 13 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746127010.957544:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991892224 00000100:00100000:3.0:1746127010.957545:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991892224 00010000:00010000:3.0:1746127010.957554:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 36 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746127010.957567:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10440 00000100:00100000:3.0:1746127010.957573:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991892096:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.957588:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.957609:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 13 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.957619:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 13 pid: 9613 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746127010.957647:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127010.957689:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991892096:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 115us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127010.957694:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10440 00000100:00100000:3.0:1746127010.957709:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10441 00000100:00100000:3.0:1746127010.957713:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991892224:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127010.957720:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127010.957725:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 36 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.957733:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 36 pid: 11152 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746127010.957745:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.957747:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127010.957754:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 36 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.957762:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 36 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127010.957794:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 36 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127010.957807:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994347648:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127010.957866:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00010000:00010000:2.0:1746127010.959057:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb387 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f37 expref: 12 pid: 9613 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746127010.959078:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994347392:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.959088:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e982200/0x34dc807b6efb356 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f0d expref: 36 pid: 11152 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746127010.959095:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994347520:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127010.959122:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 35 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127010.959162:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fc00, rc 0) 00000100:00100000:2.0:1746127010.959199:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4584:x1830945991891968:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 9133us (9828us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.959210:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22173 00000100:00100000:2.0:1746127010.961581:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994347648:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127010.961603:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127010.961643:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945991892224:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3928us (4255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127010.961653:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10441 00000100:00100000:0.0:1746127010.970460:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.970727:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991892480 00000100:00100000:1.0:1746127010.970736:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991892480 00002000:00100000:1.0:1746127010.970785:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2289664->2293759) req@ffff88009cd65880 x1830945991892480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/0 e 0 to 0 dl 1746127021 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.970794:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65880 with x1830945991892480 ext(2289664->2293759) 00002000:00010000:1.0:1746127010.970800:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd65880 00000100:00100000:1.0:1746127010.970832:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8905 00000100:00100000:1.0:1746127010.970840:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991892480:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127010.970991:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991892480:12345-192.168.203.42@tcp:3:cat.0 Request processed in 151us (540us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127010.970998:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8905 00002000:00100000:1.0:1746127010.971012:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0xa1:0x0] (2289664->2293759) req@ffff88009cd65880 x1830945991892480/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746127021 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127010.971020:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd65880 with x1830945991892480 ext(2289664->2293759) 00002000:00010000:1.0:1746127010.971024:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd65880 00000100:00100000:0.0:1746127010.974579:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127010.974643:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991892736 00000100:00100000:1.0:1746127010.974652:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991892736 00000100:00100000:1.0:1746127010.974714:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6658 00000100:00100000:1.0:1746127010.974722:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4baec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4584:x1830945991892736:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127010.974956:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4baec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4584:x1830945991892736:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 234us (384us total) trans 8589938366 rc 0/0 00000100:00100000:1.0:1746127010.974963:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6658 00000100:00100000:0.0:1746127011.051977:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.052118:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991892864 00000100:00100000:1.0:1746127011.052156:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991892864 00000100:00100000:1.0:1746127011.052306:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17397 00000100:00100000:1.0:1746127011.052316:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4593:x1830945991892864:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127011.052482:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.052501:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb3e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53f99 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746127011.052610:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746127011.052691:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052704:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052716:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052729:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052736:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052741:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052812:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb3fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052821:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb3fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052827:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb3fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127011.052863:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127011.052868:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127011.052883:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb3fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052892:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb3fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052900:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052906:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052911:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052916:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052926:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebe800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127011.052930:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052936:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052946:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127011.052949:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127011.052953:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.052959:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe800/0x34dc807b6efb3f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053033:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053038:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053042:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053046:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebe200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127011.053048:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053052:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053059:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7800) 00010000:00010000:1.0:1746127011.053061:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127011.053064:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053068:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb3f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.053094:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb3e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f99 expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.053105:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb3fe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f99 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.053111:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127011.053114:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127011.053116:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebf800, rc 0) 00000100:00100000:1.0:1746127011.053186:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4593:x1830945991892864:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 872us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.053193:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17397 00000100:00100000:0.0:1746127011.056077:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.056820:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991892992 00000100:00100000:2.0:1746127011.056829:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991892992 00000100:00100000:2.0:1746127011.056893:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1040 00000100:00100000:2.0:1746127011.056901:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991892992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.056915:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.056941:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf800/0x34dc807b6efb3fe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f99 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.056969:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.056973:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.057027:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2028:x1830945991892992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 127us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.057033:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1040 00000100:00100000:0.0:1746127011.058690:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.058736:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991893120 00000100:00100000:0.0:1746127011.058736:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.058743:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991893120 00000100:00100000:0.0:1746127011.058758:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.058948:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:3.0:1746127011.059442:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746127011.059757:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991893248 00000100:00100000:2.0:1746127011.059762:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991893248 00000100:00100000:2.0:1746127011.059788:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991893376 00000100:00100000:2.0:1746127011.059790:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991893376 00000100:00100000:2.0:1746127011.059799:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991893504 00000100:00100000:2.0:1746127011.059802:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991893504 00000100:00100000:2.0:1746127011.059814:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22174 00000100:00100000:2.0:1746127011.059821:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991893120:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.059843:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.059860:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213fa00/0x34dc807b6efb405 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fa0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.059875:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22175 00000100:00100000:1.0:1746127011.059884:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991893248:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127011.059892:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.059901:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebec00/0x34dc807b6efb40c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fa7 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.059915:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994347776:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127011.059924:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994347904:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.059964:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22176 00000100:00100000:3.0:1746127011.059971:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991893376:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.059977:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.059984:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb413 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fae expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.059988:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746127011.060016:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb413 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fae expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.060026:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb413 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fae expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127011.060026:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22177 00000100:00100000:2.0:1746127011.060031:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991893504:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.060037:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.060039:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5000, rc 0) 00010000:00010000:2.0:1746127011.060043:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb41a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fb5 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.060063:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994348032:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127011.060105:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.060356:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991893376:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 384us (1595us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.060362:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22176 00000100:00100000:2.0:1746127011.062426:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.063539:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994347904:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127011.063575:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebec00/0x34dc807b6efb40c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fa7 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.063590:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebec00/0x34dc807b6efb40c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fa7 expref: 14 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.063605:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebec00, rc 0) 00000100:00100000:0.0:1746127011.063644:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991893248:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3761us (4906us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127011.063652:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22175 00000100:00100000:2.0:1746127011.063830:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994347776:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127011.063849:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213fa00/0x34dc807b6efb405 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fa0 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.063858:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213fa00/0x34dc807b6efb405 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fa0 expref: 11 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.063869:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213fa00, rc 0) 00000100:00100000:2.0:1746127011.063890:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991893120:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4069us (6070us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127011.063896:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22174 00000100:00100000:2.0:1746127011.070480:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994348032:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127011.070534:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb41a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fb5 expref: 9 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.070550:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb41a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fb5 expref: 9 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.071539:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213f600, rc 0) 00000100:00100000:2.0:1746127011.074167:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991893504:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 14120us (15203us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127011.074179:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22177 00000100:00100000:0.0:1746127011.082979:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.083097:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991893760 00000100:00100000:1.0:1746127011.084562:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991893760 00000100:00100000:1.0:1746127011.084645:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17398 00000100:00100000:1.0:1746127011.084655:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4593:x1830945991893760:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127011.084943:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.084963:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fbc expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.085080:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.085097:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.085105:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.085202:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.085215:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 10 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.085228:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994348160:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.085826:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.095799:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.095938:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994348160:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.095968:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127011.096239:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991893888 00000100:00100000:2.0:1746127011.096246:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991893888 00010000:00010000:2.0:1746127011.096283:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.096324:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10442 00000100:00100000:2.0:1746127011.096332:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991893888:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.096347:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.096353:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.096363:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.096391:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cfd7600/0x34dc807b6efb348 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f06 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.096421:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.096427:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.096438:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.096445:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.096463:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127011.096497:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127011.096505:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991893888:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 173us (717us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127011.096505:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127011.096511:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10442 00000004:00200000:0.0:1746127011.096525:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127011.096654:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.096671:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.096682:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.096691:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746127011.096693:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe200, rc 0) 00000100:00100000:0.0:1746127011.096735:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4593:x1830945991893760:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 12081us (13765us total) trans 8589938367 rc 0/0 00000100:00100000:0.0:1746127011.096742:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17398 00000100:00100000:0.0:1746127011.099123:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.099287:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991894016 00000100:00100000:2.0:1746127011.099296:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991894016 00000100:00100000:2.0:1746127011.099994:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17399 00000100:00100000:2.0:1746127011.100018:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4593:x1830945991894016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.100046:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.100065:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb436 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fc3 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.100236:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.100252:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.100260:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.100291:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.100302:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.100315:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994348288:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.101298:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.103700:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994348288:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127011.103736:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127011.104560:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.104804:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991894144 00000100:00100000:2.0:1746127011.104812:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991894144 00010000:00010000:2.0:1746127011.104844:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 12 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.105782:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10443 00000100:00100000:0.0:1746127011.105795:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991894144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127011.105813:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127011.105822:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 12 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.105835:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 12 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.105858:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb428 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fbc expref: 12 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.105882:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.105886:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.105898:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.105906:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.105927:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127011.105971:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991894144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 180us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.105978:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10443 00010000:00010000:0.0:1746127011.106015:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.106021:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:0.0:1746127011.106077:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746127011.106081:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746127011.106098:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.106145:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb436 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fc3 expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.106158:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fc3 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.106164:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.106166:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746127011.106168:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e800, rc 0) 00000100:00100000:0.0:1746127011.106208:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4593:x1830945991894016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6193us (7094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.106215:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17399 00000100:00100000:0.0:1746127011.110061:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.110199:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991894400 00000100:00100000:2.0:1746127011.110208:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991894400 00000100:00100000:2.0:1746127011.110252:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22178 00000100:00100000:2.0:1746127011.110259:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991894400:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.110277:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.110294:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012213e600/0x34dc807b6efb444 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fd1 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.110346:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994348416:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127011.110442:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.111477:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.111493:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.111530:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.111556:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991894272 00000100:00100000:3.0:1746127011.111559:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991894272 00000100:00100000:3.0:1746127011.111586:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991894528 00000100:00100000:3.0:1746127011.111588:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991894528 00000100:00100000:3.0:1746127011.111600:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22179 00000100:00100000:3.0:1746127011.111605:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991894272:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.111622:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.111636:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967e5a00/0x34dc807b6efb44b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fca expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.111667:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994348544:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.111708:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.111721:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991894656 00000100:00100000:3.0:1746127011.111724:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991894656 00000100:00100000:3.0:1746127011.111743:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22180 00000100:00100000:3.0:1746127011.111747:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991894528:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.111753:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.111761:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb452 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fd8 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.111779:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb452 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fd8 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.111789:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5000/0x34dc807b6efb452 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fd8 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.111802:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5000, rc 0) 00000100:00100000:3.0:1746127011.111826:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991894528:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 78us (331us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.111832:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22180 00000100:00100000:3.0:1746127011.111846:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22181 00000100:00100000:3.0:1746127011.111850:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991894656:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.111856:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.111861:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967e5400/0x34dc807b6efb459 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fdf expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.111883:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994348672:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.111902:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127011.112680:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994348416:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127011.112705:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012213e600/0x34dc807b6efb444 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fd1 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.112714:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012213e600/0x34dc807b6efb444 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fd1 expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.112733:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e600, rc 0) 00000100:00100000:2.0:1746127011.112754:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991894400:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2496us (2705us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127011.112759:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22178 00000100:00100000:3.0:1746127011.114098:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994348544:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127011.114125:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967e5a00/0x34dc807b6efb44b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fca expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.114186:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e5a00/0x34dc807b6efb44b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fca expref: 11 pid: 11152 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.114195:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5a00, rc 0) 00000100:00100000:2.0:1746127011.114329:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16295:1830945994348672:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127011.114344:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967e5400/0x34dc807b6efb459 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fdf expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.114352:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967e5400/0x34dc807b6efb459 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fdf expref: 10 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.114360:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5400, rc 0) 00000100:00100000:3.0:1746127011.114396:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991894272:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2790us (2919us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.114402:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22179 00000100:00100000:2.0:1746127011.115233:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991894656:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3378us (3698us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127011.115240:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22181 00000100:00100000:0.0:1746127011.116985:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.117100:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991894912 00000100:00100000:2.0:1746127011.117108:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991894912 00000100:00100000:2.0:1746127011.117195:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17400 00000100:00100000:2.0:1746127011.117204:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4593:x1830945991894912:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.117226:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.117247:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6efb460 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fe6 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.117359:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb467 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.117373:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb467 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.117386:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb467 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:2.0:1746127011.117398:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127011.117497:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213ee00/0x34dc807b6efb460 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fe6 expref: 13 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.117511:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb467 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fe6 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.117519:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.117521:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746127011.117525:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e000, rc 0) 00000100:00100000:2.0:1746127011.117583:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4593:x1830945991894912:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 380us (604us total) trans 8589938368 rc 0/0 00000100:00100000:2.0:1746127011.117589:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17400 00000100:00100000:0.0:1746127011.119008:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.119041:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.119067:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895040 00000100:00100000:0.0:1746127011.119069:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.119073:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895040 00000100:00100000:0.0:1746127011.119083:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.119404:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.119557:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.119616:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895424 00000100:00100000:2.0:1746127011.119616:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895168 00000100:00100000:3.0:1746127011.119620:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895424 00000100:00100000:2.0:1746127011.119620:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895168 00000100:00100000:3.0:1746127011.119653:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895296 00000100:00100000:3.0:1746127011.119655:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895296 00000100:00100000:1.0:1746127011.119759:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895680 00000100:00100000:1.0:1746127011.119763:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895680 00000100:00100000:1.0:1746127011.119784:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895552 00000100:00100000:1.0:1746127011.119785:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895552 00000100:00100000:1.0:1746127011.119797:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22182 00000100:00100000:1.0:1746127011.119803:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991895040:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:1.0:1746127011.119841:0:1964:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.119859:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 46 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.119867:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.119874:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.119880:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.119881:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.119885:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.119913:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 31 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.119925:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 31 pid: 3148 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.119938:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994348800:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.120026:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.120035:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 15 pid: 9613 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.120043:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994348928:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.120069:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 46 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.120076:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 46 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.120083:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123475c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994349056:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.120100:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127011.120124:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22183 00000100:00100000:1.0:1746127011.120145:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991895424:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:1.0:1746127011.120160:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120170:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120176:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127011.120177:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127011.120179:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120199:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120207:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 31 pid: 9613 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.120214:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994349184:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.120226:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22184 00000100:00100000:1.0:1746127011.120231:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127011.120232:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991895168:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:1.0:1746127011.120245:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22185 00000100:00100000:1.0:1746127011.120249:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991895296:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127011.120259:0:12333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120262:0:3148:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.120268:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120271:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 11 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.120274:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127011.120275:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127011.120277:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120278:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.120284:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.120289:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.120291:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.120292:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120293:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.120299:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 33 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.120306:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127011.120310:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994349312:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.120313:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 33 pid: 1507 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.120319:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123475180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994349440:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.120330:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746127011.120339:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 10 pid: 9613 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127011.120346:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22186 00010000:00010000:1.0:1746127011.120346:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 10 pid: 9613 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746127011.120351:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991895680:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:1.0:1746127011.120353:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994349568:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.120364:0:3542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120371:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 11 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.120373:0:3542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120378:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 11 pid: 11152 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.120383:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127011.120384:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746127011.120385:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994349696:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.120386:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.120397:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace69000 going to sleep for 11 seconds 00010000:00010000:2.0:1746127011.120400:0:3542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 33 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.120407:0:3542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 33 pid: 1964 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.120412:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22187 00000100:00100000:2.0:1746127011.120415:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994349824:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.120416:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991895552:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:2.0:1746127011.120427:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fc00 going to sleep for 11 seconds 00010000:00010000:1.0:1746127011.120431:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120440:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120447:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120453:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 46 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120457:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746127011.120459:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746127011.120461:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120473:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 46 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120481:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 46 pid: 16295 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.120488:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994349952:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.120508:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 46 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120520:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 46 pid: 1964 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.120527:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994350080:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.120547:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 31 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.120554:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 31 pid: 9613 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.120561:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994350208:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.120573:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.124531:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.124566:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.124599:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.124646:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.124670:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895808 00000100:00100000:0.0:1746127011.124677:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895808 00002000:00100000:0.0:1746127011.124738:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1691648->2097151) req@ffff880094b78000 x1830945991895808/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.124748:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78000 with x1830945991895808 ext(1691648->2097151) 00010000:00010000:0.0:1746127011.124757:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 32 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.124769:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 32 pid: 9613 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746127011.124775:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78000 00000100:00100000:0.0:1746127011.124790:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896064 00000100:00100000:0.0:1746127011.124793:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896064 00002000:00100000:0.0:1746127011.124903:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x9f:0x0] (1789952->1925119) req@ffff880094b78e00 x1830945991896064/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.124910:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78e00 with x1830945991896064 ext(1789952->1925119) 00010000:00010000:0.0:1746127011.124916:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 34 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.124924:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 34 pid: 1964 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746127011.124929:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094b78e00 00000100:00100000:0.0:1746127011.124940:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896448 00000100:00100000:0.0:1746127011.124942:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896448 00002000:00100000:0.0:1746127011.124952:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2293759) req@ffff880094b78a80 x1830945991896448/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.124958:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78a80 with x1830945991896448 ext(2097152->2293759) 00010000:00010000:0.0:1746127011.124963:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 35 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.124970:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 35 pid: 1964 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746127011.124974:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094b78a80 00000100:00100000:0.0:1746127011.124983:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1983 00000100:00100000:0.0:1746127011.124989:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2026:x1830945991895808:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127011.126505:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994349184:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.126538:0:1507:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.126574:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994349952:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.126583:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994350080:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.126590:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994350208:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.126606:0:9612:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.126626:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994348800:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.126634:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994348928:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.126642:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123475c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994349056:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.126657:0:1964:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.126686:0:29584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1984 00000100:00100000:1.0:1746127011.126695:0:29584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2028:x1830945991896064:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127011.127038:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:3542:1830945994349824:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.127054:0:3542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.127079:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994349312:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.127089:0:12333:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.127109:0:29588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1985 00000100:00100000:2.0:1746127011.127116:0:29588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945991896448:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127011.127223:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991895936 00000100:00100000:2.0:1746127011.127230:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991895936 00010000:00010000:2.0:1746127011.127257:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 16 pid: 9613 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746127011.127286:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10444 00000100:00100000:2.0:1746127011.127290:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991895936:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.127299:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.127316:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 16 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.127325:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 16 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.127348:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ac6c00/0x34dc807b6efb302 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ece expref: 16 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.127363:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.127381:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991895936:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 90us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.127387:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10444 00000100:00080000:2.0:1746127011.127433:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746127011.130027:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.130055:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.130120:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123475180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994349440:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.130153:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994349568:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127011.130161:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994349696:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127011.130189:0:3148:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127011.131620:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.131650:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.131666:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.131682:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.132144:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896576 00000100:00100000:3.0:1746127011.132152:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896576 00002000:00100000:3.0:1746127011.132196:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2428927) req@ffff880094b78380 x1830945991896576/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.132207:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78380 with x1830945991896576 ext(2097152->2428927) 00010000:00010000:3.0:1746127011.132216:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 34 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.132231:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 34 pid: 9613 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746127011.132238:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78380 00000100:00100000:3.0:1746127011.132256:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896832 00000100:00100000:3.0:1746127011.132259:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896832 00002000:00100000:3.0:1746127011.132270:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2441216->3145727) req@ffff8801220f1180 x1830945991896832/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.132277:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1180 with x1830945991896832 ext(2441216->3145727) 00010000:00010000:3.0:1746127011.132280:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 47 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.132287:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 47 pid: 1964 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746127011.132292:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f1180 00000100:00100000:3.0:1746127011.132304:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1986 00000100:00100000:3.0:1746127011.132311:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+34:2026:x1830945991896576:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:3.0:1746127011.132446:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1987 00000100:00100000:3.0:1746127011.132451:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991896832:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127011.132792:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.136242:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896320 00000100:00100000:1.0:1746127011.136242:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896192 00000100:00100000:2.0:1746127011.136255:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896320 00000100:00100000:1.0:1746127011.136255:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896192 00010000:00010000:2.0:1746127011.136296:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 49 pid: 16295 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.136296:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 36 pid: 3148 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.136323:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896704 00000100:00100000:1.0:1746127011.136325:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896704 00010000:00010000:1.0:1746127011.136334:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 50 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746127011.136346:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991897088 00000100:00100000:3.0:1746127011.136350:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991897088 00000100:00100000:2.0:1746127011.136388:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991896960 00000100:00100000:2.0:1746127011.136391:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991896960 00000100:00100000:1.0:1746127011.136678:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10445 00000100:00100000:1.0:1746127011.136686:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+36:2026:x1830945991896192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.136701:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.136724:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 36 pid: 3148 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.136736:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 36 pid: 3148 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.136759:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x34dc807b6efb15e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dd9 expref: 36 pid: 3148 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.136780:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 11 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.136781:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.136793:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10446 00000100:00100000:2.0:1746127011.136798:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991896320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.136807:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.136815:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 50 pid: 16295 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.136822:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 50 pid: 16295 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.136827:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991896192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 143us (6771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.136832:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10445 00010000:00010000:2.0:1746127011.136834:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e4000/0x34dc807b6efb3cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [4825088->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f7d expref: 50 pid: 16295 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.136842:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127011.136847:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10447 00000100:00100000:1.0:1746127011.136851:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2028:x1830945991896704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127011.136854:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2026:x1830945991896320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 57us (6840us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127011.136856:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127011.136859:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10446 00010000:00010000:1.0:1746127011.136862:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 49 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746127011.136867:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10448 00010000:00010000:1.0:1746127011.136869:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 48 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746127011.136871:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991896960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.136878:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.136879:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb0a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53d69 expref: 48 pid: 1964 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.136887:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 11 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.136891:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.136893:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.136894:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 11 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.136897:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.136905:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.136906:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6800/0x34dc807b6efb310 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53edc expref: 11 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.136915:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.136926:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991896960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 54us (4134us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127011.136926:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.136931:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10448 00000100:00100000:1.0:1746127011.136937:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2028:x1830945991896704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 86us (5287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.136942:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10447 00010000:00010000:1.0:1746127011.136972:0:1964:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.136979:0:1964:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.136994:0:1964:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137016:0:1964:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137022:0:1964:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137033:0:1964:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebee00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.137037:0:1964:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137045:0:1964:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137055:0:1964:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137061:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efb475 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.137100:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991895040:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 17297us (18107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.137107:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22182 00000100:00100000:1.0:1746127011.137198:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.137214:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991897216 00000100:00100000:1.0:1746127011.137217:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991897216 00010000:00010000:1.0:1746127011.137229:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 38 pid: 1507 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.137244:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10449 00000100:00100000:1.0:1746127011.137248:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991897216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.137254:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.137262:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 38 pid: 1507 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.137271:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 38 pid: 1507 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.137283:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb268 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e7a expref: 38 pid: 1507 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.137291:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127011.137305:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991897216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.137310:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10449 00000100:00080000:3.0:1746127011.137415:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746127011.137432:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 12 pid: 11152 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.137449:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10450 00000100:00100000:3.0:1746127011.137454:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991897088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127011.137460:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127011.137467:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 12 pid: 11152 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.137478:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 12 pid: 11152 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.137489:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf7a00/0x34dc807b6efb237 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e6c expref: 12 pid: 11152 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.137498:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.137499:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.137502:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.137507:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.137520:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127011.137535:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991897088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 81us (5852us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127011.137538:0:3148:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.137540:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10450 00010000:00010000:1.0:1746127011.137545:0:3148:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137556:0:3148:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137561:0:3148:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137566:0:3148:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137574:0:3148:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd6e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.137576:0:3148:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137581:0:3148:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137589:0:3148:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.137595:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6e00/0x34dc807b6efb48a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.137623:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991895296:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 17373us (18538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.137628:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22185 00000100:00100000:2.0:1746127011.145055:0:29584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991896064:12345-192.168.203.42@tcp:4:cat.0 Request processed in 18350us (20443us total) trans 17179875687 rc 0/0 00000100:00100000:2.0:1746127011.145067:0:29584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1984 00002000:00100000:2.0:1746127011.145078:0:29584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x9f:0x0] (1789952->1925119) req@ffff880094b78e00 x1830945991896064/t17179875687(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/448 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.145088:0:29584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78e00 with x1830945991896064 ext(1789952->1925119) 00010000:00010000:2.0:1746127011.145097:0:29584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 39 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.145112:0:29584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 39 pid: 1964 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746127011.145119:0:29584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094b78e00 00000100:00100000:3.0:1746127011.146824:0:29588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991896448:12345-192.168.203.42@tcp:4:cat.0 Request processed in 19699us (22167us total) trans 17179875688 rc 0/0 00000100:00100000:3.0:1746127011.146835:0:29588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1985 00002000:00100000:3.0:1746127011.146844:0:29588:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->2293759) req@ffff880094b78a80 x1830945991896448/t17179875688(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/448 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.146853:0:29588:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78a80 with x1830945991896448 ext(2097152->2293759) 00010000:00010000:3.0:1746127011.146862:0:29588:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 37 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.146876:0:29588:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 37 pid: 1964 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746127011.146883:0:29588:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094b78a80 00000100:00100000:1.0:1746127011.155803:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991895808:12345-192.168.203.42@tcp:4:cat.0 Request processed in 30800us (31268us total) trans 21474842961 rc 0/0 00000100:00100000:1.0:1746127011.155818:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1983 00002000:00100000:1.0:1746127011.155831:0:29587:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9e:0x0] (1691648->2097151) req@ffff880094b78000 x1830945991895808/t21474842961(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/448 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.155840:0:29587:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78000 with x1830945991895808 ext(1691648->2097151) 00010000:00010000:1.0:1746127011.155851:0:29587:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 35 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.155870:0:29587:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 35 pid: 9613 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746127011.155876:0:29587:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78000 00000100:00100000:2.0:1746127011.155956:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.156201:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991897344 00000100:00100000:1.0:1746127011.156209:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991897344 00010000:00010000:1.0:1746127011.156239:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 37 pid: 1964 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.156260:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10451 00000100:00100000:1.0:1746127011.156266:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991897344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.156279:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.156298:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 37 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.156307:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 37 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.156330:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c2aa00/0x34dc807b6efb230 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e65 expref: 37 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.156348:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.156350:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.156355:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.156368:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.156401:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127011.156426:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991897344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 160us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.156433:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10451 00010000:00010000:3.0:1746127011.156517:0:12333:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156525:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156541:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156547:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156555:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156561:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213f600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127011.156565:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156573:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156588:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.156594:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213f600/0x34dc807b6efb483 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.156639:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991895168:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 36407us (37596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.156646:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22184 00000100:00100000:3.0:1746127011.160431:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.160992:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991897472 00000100:00100000:0.0:1746127011.161009:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991897472 00010000:00010000:0.0:1746127011.161042:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 36 pid: 1964 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.161080:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10452 00000100:00100000:0.0:1746127011.161087:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991897472:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127011.161101:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127011.161118:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 36 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.161149:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 36 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.161172:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213fc00/0x34dc807b6efb3e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2293759) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f92 expref: 36 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.161190:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.161192:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.161198:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161210:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161229:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127011.161265:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2029:x1830945991897472:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 178us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.161270:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10452 00010000:00010000:0.0:1746127011.161321:0:3542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161329:0:3542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161346:0:3542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161352:0:3542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161359:0:3542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161366:0:3542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213f000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127011.161370:0:3542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161382:0:3542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161391:0:3542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.161396:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012213f000/0x34dc807b6efb491 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127011.161433:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2027:x1830945991895680:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 41081us (42029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.161440:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22186 00000100:00100000:2.0:1746127011.161917:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+35:2026:x1830945991896576:12345-192.168.203.42@tcp:4:cat.0 Request processed in 29603us (30302us total) trans 21474842962 rc 0/0 00000100:00100000:2.0:1746127011.161925:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1986 00002000:00100000:2.0:1746127011.161935:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2428927) req@ffff880094b78380 x1830945991896576/t21474842962(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/448 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.161944:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094b78380 with x1830945991896576 ext(2097152->2428927) 00010000:00010000:2.0:1746127011.161950:0:29586:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 35 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.161960:0:29586:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 35 pid: 9613 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746127011.161965:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094b78380 00000001:00080000:2.0:1746127011.164714:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842961 is committed 00000001:00080000:2.0:1746127011.164735:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842959 is committed 00000001:00080000:2.0:1746127011.164741:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842958 is committed 00000001:00080000:2.0:1746127011.164811:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842927 is committed 00000100:00100000:1.0:1746127011.165158:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.165182:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991897600 00000100:00100000:1.0:1746127011.165189:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991897600 00010000:00010000:1.0:1746127011.165220:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 9 pid: 9613 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.165244:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10453 00000100:00100000:1.0:1746127011.165249:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2027:x1830945991897600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.165262:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.165282:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 9 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.165292:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 9 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.165313:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880076179600/0x34dc807b6efb38e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f3e expref: 9 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.165332:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.165335:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.165340:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165349:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165370:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127011.165425:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991897600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 175us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.165432:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10453 00010000:00010000:1.0:1746127011.165454:0:1507:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165461:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165477:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165483:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165490:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165496:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cfd7e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.165499:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165511:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165520:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.165524:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cfd7e00/0x34dc807b6efb47c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.165563:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991895424:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 45434us (46494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.165570:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22183 00000100:00100000:0.0:1746127011.167260:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.167345:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991897728 00000100:00100000:2.0:1746127011.167352:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991897728 00010000:00010000:2.0:1746127011.167379:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 8 pid: 9613 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.167411:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10454 00000100:00100000:2.0:1746127011.167418:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2026:x1830945991897728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.167429:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.167439:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 8 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.167449:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 8 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.167471:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5c00/0x34dc807b6efb3a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f53 expref: 8 pid: 9613 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.167495:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.167534:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991897728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.167540:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10454 00000100:00100000:3.0:1746127011.168783:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2026:x1830945991896832:12345-192.168.203.42@tcp:4:cat.0 Request processed in 36324us (37108us total) trans 21474842963 rc 0/0 00000100:00100000:3.0:1746127011.168793:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1987 00002000:00100000:3.0:1746127011.168803:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2441216->3145727) req@ffff8801220f1180 x1830945991896832/t21474842963(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/448 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.168812:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1180 with x1830945991896832 ext(2441216->3145727) 00010000:00010000:3.0:1746127011.168820:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 21 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.168831:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 21 pid: 1964 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746127011.168838:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801220f1180 00000100:00100000:0.0:1746127011.173571:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.173679:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991897856 00000100:00100000:2.0:1746127011.173688:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991897856 00010000:00010000:2.0:1746127011.173724:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 21 pid: 1964 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.173802:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10455 00000100:00100000:2.0:1746127011.173810:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991897856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.173826:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.173846:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 21 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.173859:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 21 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.173884:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdb3800/0x34dc807b6efb3c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2441216->4816895] (req 2441216->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53f76 expref: 21 pid: 1964 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.173917:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.173919:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.173924:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.173933:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.173967:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127011.173990:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.174011:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.174028:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.174035:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991897856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 225us (473us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127011.174035:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.174041:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10455 00010000:00010000:1.0:1746127011.174042:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.174052:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c8c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.174055:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.174063:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.174072:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.174078:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb498 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.174276:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991895552:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 53859us (54718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.174284:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22187 00000100:00100000:0.0:1746127011.175699:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.175803:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991898112 00000100:00100000:2.0:1746127011.175809:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991898112 00000100:00100000:2.0:1746127011.175858:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17401 00000100:00100000:2.0:1746127011.175865:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4593:x1830945991898112:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1746127011.175915:0:7259:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.175936:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb43d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fc3 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.175950:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.175954:0:7259:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127011.175977:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.175989:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 36 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.175996:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 16 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.176019:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 16 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.176024:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.176029:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 7/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.176056:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.176067:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 36 pid: 13448 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.176080:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350336:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.176513:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 16 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.176521:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 16 pid: 10958 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.176529:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350464:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.176560:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 16 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.176566:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 16 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.176574:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350592:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.176596:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 36 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.176603:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 36 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.176610:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350720:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.176623:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.178440:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.178534:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991898240 00000100:00100000:3.0:1746127011.178542:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991898240 00010000:00010000:3.0:1746127011.178588:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 37 pid: 13448 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.178775:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350336:192.168.203.42@tcp:104: 00000100:00080000:0.0:1746127011.178905:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746127011.179247:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10456 00000100:00100000:3.0:1746127011.179256:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991898240:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127011.179269:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127011.179275:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 37 pid: 13448 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.179285:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 37 pid: 13448 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.179307:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb229 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e5e expref: 37 pid: 13448 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.179326:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.179330:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.179341:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127011.179379:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991898240:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 124us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.179385:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10456 00000100:00100000:2.0:1746127011.181777:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350464:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.181790:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350592:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127011.182764:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.182860:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994350720:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.182895:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127011.184344:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.184453:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991898496 00000100:00100000:3.0:1746127011.184457:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991898368 00000100:00100000:1.0:1746127011.184461:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991898496 00000100:00100000:3.0:1746127011.184462:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991898368 00010000:00010000:3.0:1746127011.184508:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 18 pid: 10958 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.184599:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127011.184635:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 18 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00080000:0.0:1746127011.184781:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746127011.185051:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991898624 00000100:00100000:3.0:1746127011.185056:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991898624 00000100:00100000:1.0:1746127011.185060:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10457 00000100:00100000:2.0:1746127011.185068:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10458 00000100:00100000:1.0:1746127011.185068:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991898368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127011.185077:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991898496:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.185082:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.185085:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.185089:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 18 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.185091:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 18 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.185092:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 36 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.185102:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 18 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.185109:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10459 00000100:00100000:3.0:1746127011.185115:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2027:x1830945991898624:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.185115:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 18 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.185122:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127011.185125:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 36 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.185154:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efb2ca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53eb2 expref: 18 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.185160:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006f3e8000/0x34dc807b6efb11f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53dbd expref: 18 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.185165:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 36 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.185172:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.185176:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.185185:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.185236:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991898496:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 160us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.185242:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10458 00010000:00010000:3.0:1746127011.185842:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e8e6c00/0x34dc807b6efb253 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53e73 expref: 36 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.185851:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.185854:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.185861:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.185867:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.185901:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127011.185907:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127011.185912:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127011.185932:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2027:x1830945991898624:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 817us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.185932:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991898368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 865us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.185938:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10459 00000100:00100000:1.0:1746127011.186300:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10457 00010000:00010000:2.0:1746127011.186448:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.186456:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000040:00080000:2.0:1746127011.186716:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1453, 88 off135472 00000004:00080000:2.0:1746127011.186723:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228593277ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186749:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1465, 88 off136616 00000004:00080000:2.0:1746127011.186753:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228623640ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.186781:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1466, 88 off136704 00000004:00080000:2.0:1746127011.186784:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228654766ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.186793:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1454, 88 off135560 00000004:00080000:2.0:1746127011.186796:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228666363ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186803:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1455, 88 off135648 00000004:00080000:2.0:1746127011.186806:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228676180ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186813:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1467, 88 off136792 00000004:00080000:2.0:1746127011.186816:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228686467ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.186828:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1468, 88 off136880 00000004:00080000:2.0:1746127011.186830:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228701133ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.186837:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1469, 88 off136968 00000004:00080000:2.0:1746127011.186840:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228710688ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.186846:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1456, 88 off135736 00000004:00080000:2.0:1746127011.186849:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228719357ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186856:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1470, 88 off137056 00000004:00080000:2.0:1746127011.186858:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228728557ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.186865:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1457, 88 off135824 00000004:00080000:2.0:1746127011.186868:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228738208ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186875:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1471, 88 off137144 00000004:00080000:2.0:1746127011.186877:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228747822ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.186884:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1458, 88 off135912 00000004:00080000:2.0:1746127011.186887:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228757455ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186893:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1459, 88 off136000 00000004:00080000:2.0:1746127011.186896:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228766243ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186902:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1460, 88 off136088 00000004:00080000:2.0:1746127011.186904:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228775172ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186911:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1461, 88 off136176 00000004:00080000:2.0:1746127011.186913:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906228784135ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.186920:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1472, 88 off137232 00000004:00080000:2.0:1746127011.186923:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906228793495ns, next at 895431202182ns, rc = 0 00000001:00080000:1.0:1746127011.194799:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938369 is committed 00000004:00080000:1.0:1746127011.194808:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1446 committed 00000004:00080000:1.0:1746127011.194822:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1435 committed 00000004:00080000:1.0:1746127011.194826:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1434 committed 00000004:00080000:1.0:1746127011.194827:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1433 committed 00000004:00080000:1.0:1746127011.194828:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1432 committed 00000004:00080000:1.0:1746127011.194829:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1445 committed 00000004:00080000:1.0:1746127011.194831:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1431 committed 00000004:00080000:1.0:1746127011.194832:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1444 committed 00000004:00080000:1.0:1746127011.194833:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1430 committed 00000004:00080000:1.0:1746127011.194834:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1443 committed 00000004:00080000:1.0:1746127011.194835:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1442 committed 00000004:00080000:1.0:1746127011.194837:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1441 committed 00000004:00080000:1.0:1746127011.194838:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1429 committed 00000004:00080000:1.0:1746127011.194839:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1428 committed 00000004:00080000:1.0:1746127011.194840:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1440 committed 00000004:00080000:1.0:1746127011.194842:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1439 committed 00000004:00080000:1.0:1746127011.194844:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1427 committed 00000001:00080000:1.0:1746127011.194850:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938366 is committed 00000001:00080000:1.0:1746127011.194854:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938365 is committed 00000004:00010000:2.0:1746127011.194981:0:7259:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801220f1880 reply state ffff88007f125800 transno 8589938369 ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.195018:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127011.195025:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351104:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746127011.195028:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.195031:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746127011.195035:0:7259:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746127011.195065:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994350848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.195074:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.195099:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.195114:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.195145:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746127011.195149:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.195162:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.195171:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.195181:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.195192:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.195204:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.195214:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.195223:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.195231:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746127011.195234:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.195243:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994351104 00000100:00100000:0.0:1746127011.195244:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.195252:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994351104 00000100:00100000:0.0:1746127011.195252:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.195261:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.195281:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994351616 00000100:00100000:0.0:1746127011.195286:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994351616 00000100:00100000:3.0:1746127011.195300:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994351232 00000100:00100000:3.0:1746127011.195303:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994351232 00000100:00100000:0.0:1746127011.195311:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994351744 00000100:00100000:0.0:1746127011.195313:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994351744 00000100:00100000:3.0:1746127011.195316:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352128 00000100:00100000:3.0:1746127011.195318:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352128 00000100:00100000:0.0:1746127011.195321:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352640 00000100:00100000:0.0:1746127011.195323:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352640 00000100:00100000:3.0:1746127011.195331:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352256 00000100:00100000:0.0:1746127011.195332:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352768 00000100:00100000:3.0:1746127011.195333:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352256 00000100:00100000:0.0:1746127011.195334:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352768 00000100:00100000:3.0:1746127011.195346:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22188 00000100:00100000:3.0:1746127011.195353:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3782:x1830945994351104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.195376:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994350976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.195388:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.195407:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127011.195412:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994351360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.195425:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994351488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.195432:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.195441:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127011.195447:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994351872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.195451:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994352000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127011.195468:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.195481:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994350848 00000100:00100000:1.0:1746127011.195484:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994350848 00000100:00100000:2.0:1746127011.195486:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994352384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127011.195499:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.195520:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3782:x1830945994351104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (444us total) trans 21474842964 rc 0/0 00000100:00100000:2.0:1746127011.195522:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994350976 00000100:00100000:2.0:1746127011.195525:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994350976 00000100:00100000:0.0:1746127011.195977:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22189 00000100:00100000:0.0:1746127011.195985:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3782:x1830945994351616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127011.196095:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127011.196098:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127011.196100:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127011.196102:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127011.196104:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:0.0:1746127011.196127:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3782:x1830945994351616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (1011us total) trans 21474842965 rc 0/0 00000100:00100000:0.0:1746127011.196153:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22189 00000100:00100000:0.0:1746127011.196165:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994351360 00000100:00100000:0.0:1746127011.196168:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994351360 00000100:00100000:0.0:1746127011.196175:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994351488 00000100:00100000:0.0:1746127011.196177:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994351488 00000100:00100000:0.0:1746127011.196182:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994351872 00000100:00100000:0.0:1746127011.196183:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994351872 00000100:00100000:0.0:1746127011.196189:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352384 00000100:00100000:0.0:1746127011.196191:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352384 00000100:00100000:0.0:1746127011.196197:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22190 00000100:00100000:0.0:1746127011.196200:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994351232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127011.196234:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746127011.196236:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127011.196238:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127011.196239:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:0.0:1746127011.196241:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:0.0:1746127011.196255:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994351232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (1091us total) trans 21474842966 rc 0/0 00000100:00100000:0.0:1746127011.196259:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22190 00000100:00100000:3.0:1746127011.196683:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22188 00000100:00100000:1.0:1746127011.196695:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22191 00000100:00100000:1.0:1746127011.196702:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994351744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127011.196707:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22192 00000100:00100000:3.0:1746127011.196715:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3782:x1830945994352128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127011.196747:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:1.0:1746127011.196749:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.196750:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127011.196752:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.196754:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:0.0:1746127011.196809:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22193 00000100:00100000:2.0:1746127011.196820:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22194 00000100:00100000:0.0:1746127011.196825:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3782:x1830945994352640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127011.196829:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3782:x1830945994352256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127011.196899:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22195 00000100:00100000:2.0:1746127011.196904:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3782:x1830945994352768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.196912:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994351744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (1729us total) trans 21474842967 rc 0/0 00000100:00100000:0.0:1746127011.196914:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3782:x1830945994352640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (1689us total) trans 17179875689 rc 0/0 00000100:00100000:1.0:1746127011.196918:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22191 00000100:00100000:0.0:1746127011.196921:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22193 00000100:00100000:1.0:1746127011.196930:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22196 00000100:00100000:3.0:1746127011.196932:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3782:x1830945994352128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (1725us total) trans 17179875690 rc 0/0 00000100:00100000:0.0:1746127011.196934:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22197 00000100:00100000:1.0:1746127011.196935:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3784:x1830945994351360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127011.196938:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22192 00000100:00100000:0.0:1746127011.196938:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994351488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127011.196952:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22198 00000100:00100000:3.0:1746127011.196956:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3784:x1830945994351872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127011.196970:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3782:x1830945994352768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1706us total) trans 17179875692 rc 0/0 00000100:00100000:2.0:1746127011.196975:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22195 00000100:00100000:1.0:1746127011.196977:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127011.196986:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352000 00000100:00100000:2.0:1746127011.196989:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352000 00000100:00100000:1.0:1746127011.196995:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994352512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.197013:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994351488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1555us total) trans 21474842969 rc 0/0 00000100:00100000:2.0:1746127011.197018:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22199 00000100:00100000:0.0:1746127011.197021:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22197 00000100:00100000:1.0:1746127011.197027:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.197031:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352512 00000100:00100000:3.0:1746127011.197033:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994351872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1564us total) trans 17179875693 rc 0/0 00000100:00100000:0.0:1746127011.197034:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352512 00000100:00100000:3.0:1746127011.197037:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22198 00000100:00100000:0.0:1746127011.197046:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22200 00000100:00100000:3.0:1746127011.197052:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22201 00000100:00100000:0.0:1746127011.197052:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3784:x1830945994350848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.197054:0:3785:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842958 gen 2 00000100:00100000:3.0:1746127011.197056:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994350976:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127011.197057:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba54700/2, rc 0, transno 17179875693 00000004:00080000:1.0:1746127011.197058:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d1b5180, transno 21474842890 00000100:00100000:2.0:1746127011.197061:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994351872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127011.197065:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd66d80, transno 21474842891 00000004:00080000:1.0:1746127011.197067:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093640700, transno 21474842892 00000004:00080000:1.0:1746127011.197069:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d1b6680, transno 21474842893 00000004:00080000:1.0:1746127011.197071:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c749500, transno 21474842894 00000004:00080000:1.0:1746127011.197074:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096630380, transno 21474842895 00000004:00080000:1.0:1746127011.197076:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d1b7100, transno 21474842896 00000100:00100000:2.0:1746127011.197077:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994352384:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127011.197078:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093643480, transno 21474842897 00000004:00080000:1.0:1746127011.197080:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c74ad80, transno 21474842898 00000004:00080000:1.0:1746127011.197082:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a63480, transno 21474842899 00000004:00080000:1.0:1746127011.197084:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60e00, transno 21474842900 00000004:00080000:1.0:1746127011.197086:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096631c00, transno 21474842901 00000004:00080000:1.0:1746127011.197088:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a62d80, transno 21474842902 00000004:00080000:1.0:1746127011.197090:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60000, transno 21474842903 00000004:00080000:1.0:1746127011.197092:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a61880, transno 21474842904 00000004:00080000:1.0:1746127011.197094:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096631180, transno 21474842905 00000004:00080000:1.0:1746127011.197096:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60700, transno 21474842906 00000004:00080000:1.0:1746127011.197098:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cc9ca80, transno 21474842907 00000004:00080000:1.0:1746127011.197100:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d1c00, transno 21474842915 00000004:00080000:1.0:1746127011.197102:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d3480, transno 21474842916 00000004:00080000:1.0:1746127011.197104:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d3100, transno 21474842917 00000004:00080000:1.0:1746127011.197106:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d2300, transno 21474842918 00000004:00080000:1.0:1746127011.197108:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d3b80, transno 21474842919 00000004:00080000:1.0:1746127011.197109:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3c000, transno 21474842920 00000004:00080000:1.0:1746127011.197112:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d2d80, transno 21474842921 00000004:00080000:1.0:1746127011.197114:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3ca80, transno 21474842922 00000004:00080000:1.0:1746127011.197116:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3df80, transno 21474842923 00000004:00080000:1.0:1746127011.197119:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122386a00, transno 21474842928 00000004:00080000:1.0:1746127011.197121:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122387480, transno 21474842929 00000100:00100000:0.0:1746127011.197121:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3784:x1830945994350848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1733us total) trans 21474842970 rc 0/0 00000004:00080000:1.0:1746127011.197123:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d0000, transno 21474842930 00000100:00100000:0.0:1746127011.197125:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22200 00000004:00080000:1.0:1746127011.197126:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b79f80, transno 21474842931 00000004:00080000:1.0:1746127011.197143:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b78700, transno 21474842932 00000004:00080000:1.0:1746127011.197145:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba55f80, transno 21474842933 00000004:00080000:1.0:1746127011.197147:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122386d80, transno 21474842934 00000004:00080000:1.0:1746127011.197149:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b7ad80, transno 21474842935 00000004:00080000:1.0:1746127011.197151:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880122384700, transno 21474842936 00000004:00080000:1.0:1746127011.197153:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22e680, transno 21474842941 00000004:00080000:1.0:1746127011.197155:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c428700, transno 21474842942 00000004:00080000:1.0:1746127011.197157:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f3480, transno 21474842943 00000004:00080000:1.0:1746127011.197159:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f480, transno 21474842944 00000004:00080000:1.0:1746127011.197161:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f1f80, transno 21474842945 00000004:00080000:1.0:1746127011.197164:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c429880, transno 21474842946 00000004:00080000:1.0:1746127011.197166:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c428a80, transno 21474842947 00000004:00080000:1.0:1746127011.197168:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4cf480, transno 21474842948 00000004:00080000:1.0:1746127011.197170:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c42b800, transno 21474842949 00000004:00080000:1.0:1746127011.197172:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c05180, transno 21474842950 00000004:00080000:1.0:1746127011.197174:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd64000, transno 21474842951 00000004:00080000:1.0:1746127011.197176:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c05500, transno 21474842952 00000004:00080000:1.0:1746127011.197178:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74a80, transno 21474842953 00000004:00080000:1.0:1746127011.197180:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd64e00, transno 21474842954 00000004:00080000:1.0:1746127011.197181:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a75500, transno 21474842955 00000004:00080000:1.0:1746127011.197183:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c07100, transno 21474842956 00000004:00080000:1.0:1746127011.197185:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd64700, transno 21474842957 00000004:00080000:1.0:1746127011.197187:0:3785:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a77b80, transno 21474842958 00000100:00100000:1.0:1746127011.197192:0:3785:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009cc3f480 x1830945994351488/t21474842969(21474842969) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127027 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746127011.197201:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3f480/2, rc 0, transno 21474842969 00000100:00100000:1.0:1746127011.197205:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994351488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.197224:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22202 00000100:00100000:1.0:1746127011.197230:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3785:x1830945994352000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.197252:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22203 00000100:00100000:0.0:1746127011.197257:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3785:x1830945994352512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.197291:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3785:x1830945994352000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (313us total) trans 17179875695 rc 0/0 00000100:00100000:1.0:1746127011.197296:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22202 00002000:00010000:0.0:1746127011.197296:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746127011.197299:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127011.197300:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127011.197302:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127011.197303:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000004:00080000:1.0:1746127011.197317:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba56d80/2, rc 0, transno 17179875695 00000100:00100000:1.0:1746127011.197320:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994352000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.197322:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3785:x1830945994352512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (294us total) trans 17179875696 rc 0/0 00000100:00080000:3.0:1746127011.197326:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746127011.197327:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba56680/2, rc 0, transno 17179875696 00000100:00100000:0.0:1746127011.197327:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22203 00000100:00100000:1.0:1746127011.197330:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994352512:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746127011.197331:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746127011.197357:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba55500/2, rc 0, transno 17179875692 00000100:00100000:0.0:1746127011.197361:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.197365:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3784:x1830945994351360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 430us (1932us total) trans 21474842968 rc 0/0 00000004:00080000:0.0:1746127011.197368:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba54a80/2, rc 0, transno 17179875689 00000100:00100000:1.0:1746127011.197370:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22196 00000100:00100000:0.0:1746127011.197371:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127011.197378:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba54380/2, rc 0, transno 17179875690 00000100:00100000:0.0:1746127011.197381:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127011.197387:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3c700/2, rc 0, transno 21474842966 00000100:00100000:0.0:1746127011.197390:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127011.197395:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3ce00/2, rc 0, transno 21474842967 00000100:00100000:0.0:1746127011.197397:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351744:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127011.197404:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3d500/2, rc 0, transno 21474842964 00000100:00100000:0.0:1746127011.197406:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127011.197411:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3c380/2, rc 0, transno 21474842965 00000100:00100000:0.0:1746127011.197414:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994351616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127011.197889:0:8231:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 3 in flight, 54 done 00002000:00010000:0.0:1746127011.198494:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127011.198497:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127011.198498:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:0.0:1746127011.198500:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127011.198501:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127011.198509:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994350976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1449us (3098us total) trans 21474842971 rc 0/0 00000100:00100000:3.0:1746127011.198517:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22201 00000100:00100000:0.0:1746127011.198535:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3782:x1830945994352256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1707us (3288us total) trans 17179875691 rc 0/0 00000100:00100000:0.0:1746127011.198541:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22194 00000004:00080000:0.0:1746127011.198569:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba55880/2, rc 0, transno 17179875691 00000100:00100000:0.0:1746127011.198572:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994352256:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746127011.198612:0:7259:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746127011.198624:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4593:x1830945991898112:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 22758us (22928us total) trans 8589938369 rc 0/0 00000100:00100000:3.0:1746127011.198631:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17401 00010000:00010000:0.0:1746127011.198631:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.198639:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.198645:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.198650:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096643400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127011.198654:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.198659:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.198673:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.198675:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127011.198678:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.198683:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096643400/0x34dc807b6efb49f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00000004:00080000:1.0:1746127011.198709:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3d880/2, rc 0, transno 21474842971 00000100:00100000:1.0:1746127011.198714:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994350976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.198723:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746127011.198728:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994352896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.198752:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.198801:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994352896 00000100:00100000:0.0:1746127011.198806:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994352896 00000100:00100000:0.0:1746127011.198825:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22204 00000100:00100000:0.0:1746127011.198830:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994352896:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127011.198884:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3dc00/2, rc 0, transno 21474842970 00000100:00100000:2.0:1746127011.198889:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994350848:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127011.198898:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cc3d180/2, rc 0, transno 21474842968 00000100:00100000:2.0:1746127011.198901:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994351360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.198964:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3784:x1830945994352384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1941us (3464us total) trans 17179875694 rc 0/0 00000100:00100000:2.0:1746127011.198971:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22199 00000004:00080000:2.0:1746127011.198995:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba54000/2, rc 0, transno 17179875694 00000100:00100000:2.0:1746127011.199010:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994352384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.199308:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994352896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 477us (554us total) trans 21474842972 rc 0/0 00000004:00080000:1.0:1746127011.199309:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd7800/2, rc 0, transno 21474842972 00000100:00100000:1.0:1746127011.199314:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994352896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.199314:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22204 00000100:00100000:0.0:1746127011.200874:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.201072:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991898752 00000100:00100000:3.0:1746127011.201080:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991898752 00000100:00100000:3.0:1746127011.201119:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17402 00000100:00100000:3.0:1746127011.201147:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4593:x1830945991898752:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.201171:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.201191:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53fed expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.201256:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.201269:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.201286:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.201289:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127011.201292:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe400, rc 0) 00000100:00100000:3.0:1746127011.201335:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4593:x1830945991898752:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 209us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.201340:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17402 00000100:00100000:0.0:1746127011.208254:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.208910:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991898880 00000100:00100000:3.0:1746127011.208924:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991898880 00000100:00100000:3.0:1746127011.209004:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17403 00000100:00100000:3.0:1746127011.209013:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4593:x1830945991898880:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.209036:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.209056:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb4ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ff4 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.209181:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efb4b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.209197:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efb4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.209209:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efb4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:3.0:1746127011.209240:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127011.209245:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127011.209258:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efb4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.209282:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe200/0x34dc807b6efb4ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ff4 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.209311:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efb4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ff4 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.209318:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.209321:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127011.209324:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebee00, rc 0) 00000100:00100000:3.0:1746127011.209390:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4593:x1830945991898880:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 378us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.209397:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17403 00000100:00100000:2.0:1746127011.214116:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.214168:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.214191:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.214212:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899136 00000100:00100000:2.0:1746127011.214218:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899136 00000100:00100000:0.0:1746127011.214268:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899008 00000100:00100000:0.0:1746127011.214273:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899008 00000100:00100000:3.0:1746127011.214330:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899264 00000100:00100000:3.0:1746127011.214334:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899264 00000100:00100000:0.0:1746127011.214425:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22205 00000100:00100000:1.0:1746127011.214434:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22206 00000100:00100000:0.0:1746127011.214434:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991899136:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:1.0:1746127011.214440:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991899008:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127011.214449:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127011.214449:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.214465:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e53ffb expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.214465:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54002 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127011.214485:0:1507:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c89f, atime: 0x6813c89f, ctime: 0x6813c89f, blocks: 0x7f8 00002000:00010000:0.0:1746127011.214485:0:16295:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c8a1, atime: 0x6813c8a1, ctime: 0x6813c8a1, blocks: 0x800 00010000:00010000:1.0:1746127011.214501:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.214501:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.214503:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.214503:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.214510:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 9 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.214510:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.214523:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 9 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.214523:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 9 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.214531:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8c00, rc 0) 00010000:00010000:0.0:1746127011.214531:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcfc400, rc 0) 00000100:00100000:1.0:1746127011.214568:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991899008:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 128us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.214573:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22206 00000100:00100000:3.0:1746127011.214641:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22207 00000100:00100000:3.0:1746127011.214647:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991899264:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.214654:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.214663:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54009 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127011.214672:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c8a1, atime: 0x6813c8a0, ctime: 0x6813c8a0, blocks: 0x808 00010000:00010000:3.0:1746127011.214679:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.214680:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.214684:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.214692:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.214698:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebec00, rc 0) 00000100:00100000:0.0:1746127011.215641:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991899136:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1161us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.215647:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22205 00000100:00100000:3.0:1746127011.215929:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991899264:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1280us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.215934:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22207 00000100:00100000:2.0:1746127011.216037:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.216104:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.216161:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899392 00000100:00100000:3.0:1746127011.216166:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899392 00000100:00100000:3.0:1746127011.216192:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899648 00000100:00100000:3.0:1746127011.216195:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899648 00000100:00100000:3.0:1746127011.216207:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22208 00000100:00100000:3.0:1746127011.216212:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991899392:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:1.0:1746127011.216215:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22209 00000100:00100000:1.0:1746127011.216221:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2029:x1830945991899648:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.216222:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.216226:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.216233:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54010 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.216233:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5401e expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127011.216245:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c8a1, atime: 0x6813c8a1, ctime: 0x6813c8a1, blocks: 0x800 00002000:00010000:1.0:1746127011.216245:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c8a1, atime: 0x6813c8a1, ctime: 0x6813c8a1, blocks: 0x1008 00010000:00010000:3.0:1746127011.216253:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.216253:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.216255:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.216255:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.216259:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.216259:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 10 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.216269:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 10 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.216269:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 10 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.216276:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebe800, rc 0) 00010000:00010000:1.0:1746127011.216276:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8c8e00, rc 0) 00000100:00100000:1.0:1746127011.216295:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991899648:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.216300:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22209 00000100:00100000:3.0:1746127011.216373:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991899392:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 159us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.216378:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22208 00000100:00100000:0.0:1746127011.216962:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.218808:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899520 00000100:00100000:2.0:1746127011.218818:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899520 00000100:00100000:2.0:1746127011.218873:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22210 00000100:00100000:2.0:1746127011.218881:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991899520:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.218897:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.218913:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54017 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127011.218937:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c8a1, atime: 0x6813c8a1, ctime: 0x6813c8a1, blocks: 0x14e0 00010000:00010000:2.0:1746127011.218951:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.218952:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.218959:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.218973:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 11 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.218982:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096643e00, rc 0) 00000100:00100000:2.0:1746127011.219033:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991899520:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 152us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.219039:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22210 00000100:00100000:0.0:1746127011.223245:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.223290:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.223812:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.224561:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899904 00000100:00100000:3.0:1746127011.224572:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899904 00000100:00100000:0.0:1746127011.224581:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.224719:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900160 00000100:00100000:2.0:1746127011.224723:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900160 00000100:00100000:0.0:1746127011.224731:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.224732:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900416 00000100:00100000:1.0:1746127011.224745:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900416 00000100:00100000:1.0:1746127011.224764:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991899776 00000100:00100000:1.0:1746127011.224766:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991899776 00000100:00100000:2.0:1746127011.224767:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900032 00000100:00100000:2.0:1746127011.224769:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900032 00000100:00100000:0.0:1746127011.224769:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.224866:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900288 00000100:00100000:2.0:1746127011.224868:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900288 00000100:00100000:1.0:1746127011.224919:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22211 00000100:00100000:0.0:1746127011.224927:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22212 00000100:00100000:1.0:1746127011.224928:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991899904:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.224935:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991900160:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127011.224950:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22213 00000100:00100000:3.0:1746127011.224956:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991900032:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127011.225030:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991900032:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.225030:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991900160:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 96us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.225036:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22213 00000100:00100000:0.0:1746127011.225038:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22212 00000100:00100000:3.0:1746127011.225050:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22214 00000100:00100000:0.0:1746127011.225053:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22215 00000100:00100000:3.0:1746127011.225055:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991899776:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.225057:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991900288:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127011.225119:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991899904:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 191us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.225126:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22211 00000100:00100000:3.0:1746127011.225288:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991899776:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 232us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.225288:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991900288:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 229us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.225294:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22215 00000100:00100000:3.0:1746127011.225296:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22214 00000100:00100000:1.0:1746127011.225519:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22216 00000100:00100000:1.0:1746127011.225525:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991900416:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127011.225559:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2029:x1830945991900416:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 34us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.225563:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22216 00000100:00100000:0.0:1746127011.228092:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.228181:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.228202:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.228222:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.228244:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900544 00000100:00100000:0.0:1746127011.228252:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900544 00000100:00100000:0.0:1746127011.228290:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900800 00000100:00100000:0.0:1746127011.228291:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900800 00000100:00100000:0.0:1746127011.228301:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991901056 00000100:00100000:0.0:1746127011.228303:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991901056 00000100:00100000:0.0:1746127011.228312:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900672 00000100:00100000:0.0:1746127011.228313:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900672 00000100:00100000:0.0:1746127011.228325:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22217 00000100:00100000:0.0:1746127011.228332:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991900544:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.228431:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991900544:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.228437:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22217 00000100:00100000:0.0:1746127011.228449:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22218 00000100:00100000:0.0:1746127011.228454:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991900800:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.228485:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991900800:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.228489:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22218 00000100:00100000:0.0:1746127011.228496:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22219 00000100:00100000:0.0:1746127011.228500:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991901056:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.228524:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991901056:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.228528:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22219 00000100:00100000:0.0:1746127011.228535:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22220 00000100:00100000:0.0:1746127011.228539:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991900672:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.228561:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991900672:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 22us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.228565:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22220 00000100:00100000:0.0:1746127011.228619:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.228631:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991900928 00000100:00100000:0.0:1746127011.228633:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991900928 00000100:00100000:0.0:1746127011.228646:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22221 00000100:00100000:0.0:1746127011.228650:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991900928:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.228682:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991900928:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 31us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.228687:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22221 00000100:00100000:0.0:1746127011.228748:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.228759:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991901184 00000100:00100000:0.0:1746127011.228762:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991901184 00000100:00100000:0.0:1746127011.228775:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22222 00000100:00100000:0.0:1746127011.228779:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991901184:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127011.228809:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991901184:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 29us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.228813:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22222 00000100:00100000:0.0:1746127011.230700:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.230828:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991901312 00000100:00100000:2.0:1746127011.230834:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991901312 00000100:00100000:2.0:1746127011.231503:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22223 00000100:00100000:2.0:1746127011.231512:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2028:x1830945991901312:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:2.0:1746127011.231711:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127011.231714:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127011.231716:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:2.0:1746127011.231719:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127011.231721:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:2.0:1746127011.231780:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991901312:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 269us (1087us total) trans 17179875697 rc 0/0 00000100:00100000:2.0:1746127011.231787:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22223 00000100:00100000:0.0:1746127011.235295:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.235359:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991901440 00000100:00100000:1.0:1746127011.235370:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991901440 00000100:00100000:1.0:1746127011.235428:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22224 00000100:00100000:1.0:1746127011.235436:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991901440:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:1.0:1746127011.235691:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127011.235694:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127011.235698:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127011.235700:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127011.235701:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:1.0:1746127011.235762:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991901440:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 326us (476us total) trans 21474842973 rc 0/0 00000100:00100000:1.0:1746127011.235769:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22224 00000100:00100000:0.0:1746127011.239852:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.239910:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991901696 00000100:00100000:3.0:1746127011.239920:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991901696 00000100:00100000:3.0:1746127011.240010:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8906 00000100:00100000:3.0:1746127011.240019:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991901696:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127011.240060:0:9617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.240074:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.240077:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.240082:0:9617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.240095:0:9617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.250225:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.250252:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.252062:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.256748:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991902208 00000100:00100000:0.0:1746127011.256748:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991902080 00000100:00100000:0.0:1746127011.256765:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991902080 00000100:00100000:0.0:1746127011.256916:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991902336 00000100:00100000:0.0:1746127011.256919:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991902336 00000100:00100000:1.0:1746127011.256928:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991902208 00000100:00100000:0.0:1746127011.256945:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8907 00000100:00100000:0.0:1746127011.256958:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991902080:12345-192.168.203.42@tcp:3:lfs.0 00000100:00100000:1.0:1746127011.256981:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8908 00000100:00100000:1.0:1746127011.256986:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991902336:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746127011.256995:0:29586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.257011:0:29587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.257019:0:29587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.257019:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.257021:0:29587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.257021:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.257026:0:29587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.257026:0:29586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.257039:0:29587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.257039:0:29586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.257797:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8909 00000100:00100000:1.0:1746127011.257804:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991902208:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127011.257822:0:9616:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.257830:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.257831:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.257835:0:9616:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.257842:0:9616:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.260663:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.260698:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.261313:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.261724:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991902720 00000100:00100000:1.0:1746127011.261734:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991902720 00000100:00100000:1.0:1746127011.261795:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991902976 00000100:00100000:1.0:1746127011.261798:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991902976 00000100:00100000:1.0:1746127011.261814:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991903232 00000100:00100000:1.0:1746127011.261816:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991903232 00000100:00100000:1.0:1746127011.261832:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8910 00000100:00100000:1.0:1746127011.261839:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991902720:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127011.261877:0:13835:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.261891:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.261893:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.261898:0:13835:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.261912:0:13835:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127011.262109:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8911 00000100:00100000:0.0:1746127011.262117:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991902976:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746127011.262150:0:9618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.262158:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.262159:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.262162:0:9618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.262171:0:9618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.262715:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8912 00000100:00100000:1.0:1746127011.262722:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991903232:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127011.262740:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.262751:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.262753:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.262755:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.262762:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127011.265243:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.266824:0:29584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991903488 00000100:00100000:2.0:1746127011.266837:0:29584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991903488 00010000:00010000:3.0:1746127011.267941:0:9617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.267958:0:9617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.267967:0:9617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.267978:0:9617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebf800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127011.267982:0:9617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.267990:0:9617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.268018:0:9617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.268025:0:9617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf800/0x34dc807b6efb4e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.268146:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991901696:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 28105us (28281us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746127011.268158:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8906 00000100:00100000:3.0:1746127011.268187:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8913 00000100:00100000:3.0:1746127011.268196:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991903488:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127011.268233:0:9617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.268243:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.268245:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.268251:0:9617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.268263:0:9617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.274031:0:29587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.274051:0:29587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.274059:0:29587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.274067:0:29587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c8800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.274071:0:29587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.274079:0:29587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.274099:0:29587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.274105:0:29587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8800/0x34dc807b6efb4f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.274224:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991902336:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 17231us (22166us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127011.274234:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8908 00010000:00010000:2.0:1746127011.281889:0:29586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.281907:0:29586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.281915:0:29586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.281922:0:29586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011d9e3200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127011.281926:0:29586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.281933:0:29586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.281957:0:29586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.281963:0:29586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011d9e3200/0x34dc807b6efb4ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.282061:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991902080:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 25098us (31841us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.282071:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8907 00010000:00010000:1.0:1746127011.284578:0:9616:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.284598:0:9616:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.284606:0:9616:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.284613:0:9616:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c9200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.284617:0:9616:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.284630:0:9616:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.284649:0:9616:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.284656:0:9616:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c9200/0x34dc807b6efb4fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.284734:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991902208:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 26926us (34475us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127011.284748:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8909 00010000:00010000:1.0:1746127011.292038:0:13835:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.292057:0:13835:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.292070:0:13835:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.292077:0:13835:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918b600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.292081:0:13835:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.292088:0:13835:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.292109:0:13835:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.292115:0:13835:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918b600/0x34dc807b6efb501 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.292244:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991902720:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 30399us (31585us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127011.292256:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8910 00010000:00010000:2.0:1746127011.300490:0:9618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.300508:0:9618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.300517:0:9618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.300524:0:9618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d001a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127011.300528:0:9618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.300535:0:9618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.300554:0:9618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.300566:0:9618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d001a00/0x34dc807b6efb508 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.301491:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991902976:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 39362us (40778us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.301507:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8911 00010000:00010000:1.0:1746127011.306326:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.306346:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.306354:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.306361:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009918b800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127011.306365:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.306373:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.306394:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.306500:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918b800/0x34dc807b6efb50f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.307047:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991903232:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 44318us (45730us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127011.307058:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8912 00010000:00010000:3.0:1746127011.309373:0:9617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.309393:0:9617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.309402:0:9617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.309410:0:9617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebf600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127011.309415:0:9617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.309423:0:9617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.309443:0:9617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.309449:0:9617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bebf600/0x34dc807b6efb516 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.309557:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991903488:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 41357us (44317us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127011.309568:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8913 00000100:00100000:0.0:1746127011.319612:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.322192:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991903744 00000100:00100000:3.0:1746127011.322207:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991903744 00000100:00100000:3.0:1746127011.322273:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17404 00000100:00100000:3.0:1746127011.322281:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4593:x1830945991903744:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:3.0:1746127011.322337:0:7259:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127011.322368:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efb4b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ff4 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.322390:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.322395:0:7259:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127011.322441:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.322457:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.322467:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00010000:3.0:1746127011.322584:0:7259:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801303d0000 reply state ffff880090562000 transno 8589938370 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.322594:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.322599:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.322602:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746127011.322604:0:7259:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746127011.322693:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4593:x1830945991903744:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 412us (3091us total) trans 8589938370 rc 0/0 00000100:00100000:3.0:1746127011.322700:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17404 00000100:00100000:0.0:1746127011.325937:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.325976:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.326015:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.326044:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.326070:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991903872 00000100:00100000:0.0:1746127011.326079:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991903872 00000100:00100000:0.0:1746127011.326121:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991904128 00000100:00100000:0.0:1746127011.326123:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991904128 00000100:00100000:0.0:1746127011.326157:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991904384 00000100:00100000:0.0:1746127011.326159:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991904384 00000100:00100000:0.0:1746127011.326168:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991904000 00000100:00100000:0.0:1746127011.326170:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991904000 00000100:00100000:0.0:1746127011.326182:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22225 00000100:00100000:0.0:1746127011.326189:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991903872:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127011.326350:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127011.326353:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127007 -> 1746127009 00002000:00010000:0.0:1746127011.326356:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127007 -> 1746127009 00002000:00010000:0.0:1746127011.326358:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127007 -> 1746127009 00002000:00010000:0.0:1746127011.326360:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746127011.326407:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991903872:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 218us (481us total) trans 21474842974 rc 0/0 00000100:00100000:0.0:1746127011.326414:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22225 00000100:00100000:0.0:1746127011.326453:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22226 00000100:00100000:0.0:1746127011.326458:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991904128:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127011.326528:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127011.326530:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326532:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127008 -> 1746127009 00002000:00010000:0.0:1746127011.326533:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127008 -> 1746127009 00002000:00010000:0.0:1746127011.326535:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746127011.326550:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991904128:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 92us (574us total) trans 17179875698 rc 0/0 00000100:00100000:0.0:1746127011.326554:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22226 00000100:00100000:0.0:1746127011.326580:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22227 00000100:00100000:0.0:1746127011.326584:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991904384:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127011.326618:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127011.326620:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326621:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326623:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326625:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746127011.326637:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991904384:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 53us (623us total) trans 21474842975 rc 0/0 00000100:00100000:0.0:1746127011.326645:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22227 00000100:00100000:0.0:1746127011.326757:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22228 00000100:00100000:0.0:1746127011.326761:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991904000:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127011.326797:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127011.326799:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326801:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326802:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326804:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127011.326819:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991904000:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 57us (774us total) trans 17179875699 rc 0/0 00000100:00100000:0.0:1746127011.326823:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22228 00000100:00100000:0.0:1746127011.326870:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.326884:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991904256 00000100:00100000:0.0:1746127011.326886:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991904256 00000100:00100000:0.0:1746127011.326900:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22229 00000100:00100000:0.0:1746127011.326905:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991904256:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127011.326945:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127011.326947:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326949:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326951:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.326952:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127011.326967:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991904256:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 62us (97us total) trans 21474842976 rc 0/0 00000100:00100000:0.0:1746127011.326973:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22229 00000100:00100000:0.0:1746127011.327054:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.327067:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991904512 00000100:00100000:0.0:1746127011.327070:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991904512 00000100:00100000:0.0:1746127011.327086:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22230 00000100:00100000:0.0:1746127011.327090:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991904512:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127011.327147:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127011.327149:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.327151:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.327153:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.327154:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746127011.327168:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991904512:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 77us (114us total) trans 17179875700 rc 0/0 00000100:00100000:0.0:1746127011.327172:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22230 00000100:00100000:0.0:1746127011.333884:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.334087:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991904768 00000100:00100000:2.0:1746127011.334096:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991904768 00000100:00100000:2.0:1746127011.334401:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6659 00000100:00100000:2.0:1746127011.334411:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4593:x1830945991904768:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:2.0:1746127011.334482:0:7261:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb467 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fe6 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.334526:0:7261:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7261 initiator: MDT0 00010000:00010000:2.0:1746127011.334540:0:7261:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.334548:0:7261:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7261 initiator: MDT0 00010000:00010000:2.0:1746127011.334576:0:7261:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.334587:0:7261:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 10 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.334605:0:7261:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd64700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7261:1830945994353024:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.334696:0:7261:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1746127011.336316:0:7261:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd64700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7261:1830945994353024:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.336339:0:7261:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7261 initiator: MDT0 00000100:00100000:1.0:1746127011.337694:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.337782:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991904896 00000100:00100000:2.0:1746127011.337790:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991904896 00010000:00010000:2.0:1746127011.337827:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.337864:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10460 00000100:00100000:2.0:1746127011.337872:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991904896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.337887:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.337893:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.337903:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.337925:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efb4a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fed expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.338092:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.338098:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7261 initiator: MDT0 00010000:00010000:2.0:1746127011.338112:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7261 initiator: MDT0 00010000:00010000:2.0:1746127011.338118:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7261 initiator: MDT0 00010000:00010000:2.0:1746127011.338168:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.338217:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991904896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 344us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.338224:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10460 00010000:00010000:0.0:1746127011.338289:0:7261:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7261 initiator: MDT0 00010000:00010000:0.0:1746127011.338299:0:7261:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7261 initiator: MDT0 00000040:00080000:0.0:1746127011.338636:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1462, 88 off136264 00000004:00080000:0.0:1746127011.338646:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380516387ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338684:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1473, 88 off137320 00000004:00080000:0.0:1746127011.338688:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380558659ns, next at 895431202182ns, rc = 0 00000040:00080000:0.0:1746127011.338712:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1474, 88 off137408 00000004:00080000:0.0:1746127011.338715:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380585286ns, next at 895431202182ns, rc = 0 00000040:00080000:0.0:1746127011.338756:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1463, 88 off136352 00000004:00080000:0.0:1746127011.338760:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380630612ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338780:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1464, 88 off136440 00000004:00080000:0.0:1746127011.338783:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380653272ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338795:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1475, 88 off137496 00000004:00080000:0.0:1746127011.338798:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380667979ns, next at 895431202182ns, rc = 0 00000040:00080000:0.0:1746127011.338815:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1476, 88 off137584 00000004:00080000:0.0:1746127011.338818:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380688707ns, next at 895431202182ns, rc = 0 00000040:00080000:0.0:1746127011.338825:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1477, 88 off137672 00000004:00080000:0.0:1746127011.338828:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380698531ns, next at 895431202182ns, rc = 0 00000040:00080000:0.0:1746127011.338835:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1465, 88 off136528 00000004:00080000:0.0:1746127011.338838:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380708533ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338846:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1478, 88 off137760 00000004:00080000:0.0:1746127011.338848:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380718912ns, next at 895431202182ns, rc = 0 00000040:00080000:0.0:1746127011.338856:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1466, 88 off136616 00000004:00080000:0.0:1746127011.338858:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380729011ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338865:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1479, 88 off137848 00000004:00080000:0.0:1746127011.338867:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380737509ns, next at 895431202182ns, rc = 0 00000040:00080000:0.0:1746127011.338874:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1467, 88 off136704 00000004:00080000:0.0:1746127011.338877:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380747378ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338883:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1468, 88 off136792 00000004:00080000:0.0:1746127011.338885:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380755947ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338891:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1469, 88 off136880 00000004:00080000:0.0:1746127011.338894:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380764628ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338900:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1470, 88 off136968 00000004:00080000:0.0:1746127011.338902:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906380772612ns, next at 847916292410ns, rc = 0 00000040:00080000:0.0:1746127011.338907:0:7261:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1480, 88 off137936 00000004:00080000:0.0:1746127011.338909:0:7261:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906380779927ns, next at 895431202182ns, rc = 0 00000001:00080000:1.0:1746127011.340333:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938371 is committed 00000004:00080000:1.0:1746127011.340341:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1454 committed 00010000:00010000:0.0:1746127011.340408:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.340422:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00000004:00080000:1.0:1746127011.340424:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1444 committed 00010000:00010000:0.0:1746127011.340428:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.340434:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a03000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127011.340439:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00000004:00080000:1.0:1746127011.340442:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1443 committed 00000004:00080000:1.0:1746127011.340444:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1442 committed 00010000:00010000:0.0:1746127011.340445:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00000004:00080000:1.0:1746127011.340447:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1441 committed 00000004:00080000:1.0:1746127011.340449:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1453 committed 00000004:00080000:1.0:1746127011.340450:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1440 committed 00000004:00080000:1.0:1746127011.340452:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1452 committed 00000004:00080000:1.0:1746127011.340453:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1439 committed 00000004:00080000:1.0:1746127011.340454:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1451 committed 00000004:00080000:1.0:1746127011.340455:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1450 committed 00000004:00080000:1.0:1746127011.340456:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1449 committed 00000004:00080000:1.0:1746127011.340458:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1438 committed 00000004:00080000:1.0:1746127011.340459:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1437 committed 00000004:00080000:1.0:1746127011.340461:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1448 committed 00000004:00080000:1.0:1746127011.340462:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1447 committed 00000004:00080000:1.0:1746127011.340464:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1436 committed 00010000:00010000:0.0:1746127011.340467:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.340532:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127011.340537:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.340542:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb51d lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127011.340576:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746127011.340595:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994353536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.340608:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994353280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.340689:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994353664:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1746127011.340742:0:7261:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801303d3100 reply state ffff88007f127800 transno 8589938371 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7261 initiator: MDT0 00010000:00010000:0.0:1746127011.340754:0:7261:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7261 initiator: MDT0 00010000:00010000:0.0:1746127011.340760:0:7261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.340761:0:7261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746127011.340765:0:7261:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746127011.340770:0:7261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.340772:0:7261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746127011.340778:0:7261:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb467 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53fe6 expref: 7 pid: 7259 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.340828:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1746127011.340851:0:7261:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746127011.340860:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994353152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.340863:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4593:x1830945991904768:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 6453us (6989us total) trans 8589938371 rc 0/0 00000100:00100000:0.0:1746127011.340872:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6659 00000100:00100000:2.0:1746127011.340877:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127011.340891:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127011.340904:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746127011.340907:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7261 initiator: MDT0 00010000:00010000:3.0:1746127011.340913:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7261 initiator: MDT0 00000100:00100000:2.0:1746127011.340916:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354560:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746127011.340917:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7261 initiator: MDT0 00010000:00010000:3.0:1746127011.340921:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213e800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.340923:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7261 initiator: MDT0 00010000:00010000:3.0:1746127011.340927:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7261 initiator: MDT0 00000100:00100000:2.0:1746127011.340931:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746127011.340934:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.340935:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127011.340937:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7261 initiator: MDT0 00010000:00010000:3.0:1746127011.340941:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb524 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7261 initiator: MDT0 00000100:00100000:2.0:1746127011.340954:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994355072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.340970:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127011.340983:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746127011.340987:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.341018:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.341126:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994353408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127011.341655:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.341675:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.341776:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994353536 00000100:00100000:3.0:1746127011.341783:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994353536 00000100:00100000:3.0:1746127011.341819:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994353152 00000100:00100000:3.0:1746127011.341822:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994353152 00000100:00100000:3.0:1746127011.341833:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354048 00000100:00100000:3.0:1746127011.341835:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354048 00000100:00100000:3.0:1746127011.341844:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354560 00000100:00100000:3.0:1746127011.341845:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354560 00000100:00100000:3.0:1746127011.341856:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994355072 00000100:00100000:3.0:1746127011.341857:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994355072 00000100:00100000:3.0:1746127011.341865:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354176 00000100:00100000:3.0:1746127011.341867:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354176 00000100:00100000:3.0:1746127011.341877:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22231 00000100:00100000:3.0:1746127011.341883:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3784:x1830945994353536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127011.342017:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127011.342020:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127011.342022:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127011.342026:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127011.342028:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746127011.342152:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22232 00000100:00100000:0.0:1746127011.342159:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3784:x1830945994353152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127011.342207:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127011.342210:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.342211:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.342213:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.342215:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746127011.342243:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354688 00000100:00100000:2.0:1746127011.342246:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354688 00000100:00100000:2.0:1746127011.342262:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22233 00000100:00100000:2.0:1746127011.342266:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3784:x1830945994354048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.342300:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22234 00000100:00100000:1.0:1746127011.342310:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.342326:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994353920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.342348:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.342355:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.342366:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.342372:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.342381:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.342390:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746127011.342394:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.342403:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.342409:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.342418:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.342430:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.342445:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3784:x1830945994354560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127011.342515:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746127011.342517:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.342519:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127011.342521:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.342523:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:0.0:1746127011.342592:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3784:x1830945994353152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 433us (1713us total) trans 17179875702 rc 0/0 00000100:00100000:0.0:1746127011.342597:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22232 00000100:00100000:0.0:1746127011.342609:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994353408 00000100:00100000:0.0:1746127011.342611:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994353408 00000100:00100000:0.0:1746127011.342621:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994353920 00000100:00100000:0.0:1746127011.342622:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994353920 00000100:00100000:0.0:1746127011.342628:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354432 00000100:00100000:0.0:1746127011.342630:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354432 00000100:00100000:0.0:1746127011.342635:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354944 00000100:00100000:0.0:1746127011.342636:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354944 00000100:00100000:0.0:1746127011.342641:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354304 00000100:00100000:0.0:1746127011.342643:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354304 00000100:00100000:3.0:1746127011.342659:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3784:x1830945994353536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 776us (1831us total) trans 17179875701 rc 0/0 00000100:00100000:3.0:1746127011.342665:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22231 00000100:00100000:1.0:1746127011.342667:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994354560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 362us (1735us total) trans 21474842977 rc 0/0 00000100:00100000:1.0:1746127011.342671:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22234 00000100:00100000:3.0:1746127011.342674:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994354816 00000100:00100000:3.0:1746127011.342676:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994354816 00000100:00100000:1.0:1746127011.342677:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994353664 00000100:00100000:1.0:1746127011.342679:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994353664 00000100:00100000:3.0:1746127011.342685:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22235 00000100:00100000:3.0:1746127011.342689:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994355072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.342689:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22236 00000100:00100000:1.0:1746127011.342693:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3784:x1830945994354176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127011.342733:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:3.0:1746127011.342735:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127011.342737:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127011.342739:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127011.342740:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:3.0:1746127011.342758:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994355072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1787us total) trans 21474842978 rc 0/0 00000100:00100000:3.0:1746127011.342763:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22235 00000100:00100000:3.0:1746127011.342770:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22237 00000100:00100000:3.0:1746127011.342774:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3784:x1830945994354688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127011.342799:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746127011.342802:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:1.0:1746127011.342804:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:1.0:1746127011.342805:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:1.0:1746127011.342807:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746127011.342816:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3784:x1830945994354688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (1141us total) trans 21474842980 rc 0/0 00000100:00100000:1.0:1746127011.342821:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3784:x1830945994354176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (1803us total) trans 21474842979 rc 0/0 00000100:00100000:0.0:1746127011.343004:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22238 00000100:00100000:0.0:1746127011.343011:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3783:x1830945994353408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127011.343051:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127011.343053:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343055:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343057:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343058:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746127011.343070:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3784:x1830945994354048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 803us (2164us total) trans 17179875703 rc 0/0 00000100:00100000:2.0:1746127011.343076:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22233 00000100:00100000:2.0:1746127011.343086:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22239 00000100:00100000:0.0:1746127011.343087:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3783:x1830945994353408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (775us total) trans 17179875704 rc 0/0 00000100:00100000:2.0:1746127011.343091:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3783:x1830945994353920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.343092:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22238 00000100:00100000:0.0:1746127011.343120:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22240 00000100:00100000:0.0:1746127011.343125:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3783:x1830945994354432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127011.343179:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127011.343181:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343183:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343185:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343187:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746127011.343205:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3783:x1830945994354432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (838us total) trans 21474842981 rc 0/0 00000100:00100000:0.0:1746127011.343210:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22240 00000100:00100000:0.0:1746127011.343220:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22241 00000100:00100000:0.0:1746127011.343224:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3783:x1830945994354944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127011.343255:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127011.343258:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127011.343260:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127011.343261:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127011.343263:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:0.0:1746127011.343278:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3783:x1830945994354944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (896us total) trans 21474842982 rc 0/0 00000100:00100000:2.0:1746127011.343279:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3783:x1830945994353920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (930us total) trans 17179875705 rc 0/0 00000100:00100000:0.0:1746127011.343283:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22241 00000100:00100000:2.0:1746127011.343285:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22239 00000100:00100000:0.0:1746127011.343291:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22242 00000100:00100000:0.0:1746127011.343295:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3783:x1830945994354816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.343308:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22243 00000100:00100000:2.0:1746127011.343311:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3785:x1830945994353664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.343341:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3783:x1830945994354816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (922us total) trans 21474842983 rc 0/0 00000100:00100000:0.0:1746127011.343346:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22242 00000100:00100000:0.0:1746127011.343355:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22244 00000100:00100000:2.0:1746127011.343356:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3785:x1830945994353664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (925us total) trans 17179875706 rc 0/0 00000100:00100000:0.0:1746127011.343359:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3783:x1830945994354304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127011.343361:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22243 00002000:00010000:0.0:1746127011.343392:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127011.343394:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343396:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343397:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.343399:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:2.0:1746127011.343404:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481aa00/2, rc 0, transno 21474842979 00000100:00100000:2.0:1746127011.343412:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.343413:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3783:x1830945994354304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (1009us total) trans 21474842984 rc 0/0 00000100:00100000:0.0:1746127011.343417:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22244 00000004:00080000:2.0:1746127011.343420:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481a300/2, rc 0, transno 21474842980 00000100:00100000:2.0:1746127011.343423:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127011.343429:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094818000/2, rc 0, transno 21474842978 00000100:00100000:2.0:1746127011.343431:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994355072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127011.343439:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481a680/2, rc 0, transno 17179875703 00000100:00100000:2.0:1746127011.343441:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127011.343448:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094819f80/2, rc 0, transno 21474842977 00000100:00100000:2.0:1746127011.343450:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994354560:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127011.343456:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba56a00/2, rc 0, transno 17179875701 00000100:00100000:2.0:1746127011.343458:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994353536:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127011.343463:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba55f80/2, rc 0, transno 17179875702 00000100:00100000:2.0:1746127011.343465:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994353152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.343478:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.343493:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991905024 00000100:00100000:0.0:1746127011.343496:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991905024 00000100:00100000:2.0:1746127011.343503:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746127011.343508:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994355200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.343516:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17405 00000100:00100000:0.0:1746127011.343520:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4593:x1830945991905024:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:2.0:1746127011.343525:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746127011.343536:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127011.343543:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994355200 00000100:00100000:2.0:1746127011.343545:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994355200 00010000:00010000:0.0:1746127011.343550:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54025 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.343558:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22245 00000100:00100000:2.0:1746127011.343562:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3784:x1830945994355200:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746127011.343600:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.343611:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.343627:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.343630:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127011.343633:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb400, rc 0) 00000100:00100000:0.0:1746127011.343661:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4593:x1830945991905024:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 140us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.343667:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17405 00000100:00100000:3.0:1746127011.343839:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22237 00000100:00100000:3.0:1746127011.343868:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.343886:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994353792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.343906:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.343928:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994353280 00000100:00100000:3.0:1746127011.343932:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994353280 00000100:00100000:3.0:1746127011.343945:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994353792 00000100:00100000:3.0:1746127011.343946:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994353792 00000100:00100000:3.0:1746127011.343962:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22246 00000100:00100000:3.0:1746127011.343966:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3782:x1830945994353280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.344010:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22236 00000004:00080000:1.0:1746127011.344040:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481b100/2, rc 0, transno 21474842984 00000100:00100000:1.0:1746127011.344043:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.344051:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481b480/2, rc 0, transno 21474842983 00000100:00100000:1.0:1746127011.344053:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.344059:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba57480/2, rc 0, transno 17179875704 00000100:00100000:1.0:1746127011.344062:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994353408:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127011.344068:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481b800/2, rc 0, transno 17179875705 00000100:00100000:1.0:1746127011.344071:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994353920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127011.344078:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481ad80/2, rc 0, transno 21474842981 00000100:00100000:1.0:1746127011.344080:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.344085:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009481bb80/2, rc 0, transno 21474842982 00000100:00100000:1.0:1746127011.344087:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009481bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994354944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.344104:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba54e00/2, rc 0, transno 17179875706 00000100:00100000:1.0:1746127011.344106:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994353664:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127011.344110:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127011.344112:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.344114:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.344116:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00000100:00100000:1.0:1746127011.344117:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22247 00002000:00010000:3.0:1746127011.344118:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746127011.344122:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994353792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.344151:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994353280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (282us total) trans 17179875707 rc 0/0 00000100:00100000:3.0:1746127011.344156:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22246 00000004:00080000:3.0:1746127011.344175:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba57b80/2, rc 0, transno 17179875707 00000100:00100000:3.0:1746127011.344178:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994353280:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127011.344180:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:1.0:1746127011.344182:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746127011.344184:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127011.344186:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:1.0:1746127011.344187:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:1.0:1746127011.344208:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3782:x1830945994353792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (301us total) trans 17179875708 rc 0/0 00000004:00080000:3.0:1746127011.344209:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094819880/2, rc 0, transno 17179875708 00000100:00100000:3.0:1746127011.344212:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994353792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127011.344213:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22247 00000100:00100000:2.0:1746127011.344669:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3784:x1830945994355200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1105us (1141us total) trans 21474842985 rc 0/0 00000100:00100000:2.0:1746127011.344675:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22245 00000004:00080000:3.0:1746127011.344742:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b78700/2, rc 0, transno 21474842985 00000100:00100000:3.0:1746127011.344746:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994355200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.348577:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.349098:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991905280 00000100:00100000:0.0:1746127011.349107:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991905280 00000100:00100000:0.0:1746127011.349175:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6660 00000100:00100000:0.0:1746127011.349183:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4593:x1830945991905280:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1746127011.349683:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4593:x1830945991905280:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 499us (1113us total) trans 8589938372 rc 0/0 00000100:00100000:0.0:1746127011.349689:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6660 00000100:00100000:0.0:1746127011.364239:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.364330:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991905536 00000100:00100000:2.0:1746127011.364340:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991905536 00000100:00100000:2.0:1746127011.364390:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17406 00000100:00100000:2.0:1746127011.364398:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4604:x1830945991905536:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127011.364424:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.364443:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5402c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.364518:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364532:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364544:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364556:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364561:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364566:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364673:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364680:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364686:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:2.0:1746127011.364694:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127011.364765:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364773:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364778:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364783:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364789:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213e800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127011.364793:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364800:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364810:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127011.364813:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127011.364817:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364822:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364839:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364843:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364847:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364851:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012213fe00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127011.364853:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364858:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364864:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58af00) 00010000:00010000:2.0:1746127011.364866:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127011.364868:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364872:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213fe00/0x34dc807b6efb540 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.364908:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.364920:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 29 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.364925:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.364927:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127011.364929:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213f000, rc 0) 00000100:00100000:2.0:1746127011.364974:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4604:x1830945991905536:12345-192.168.203.42@tcp:101:cat.0 Request processed in 576us (748us total) trans 8589938373 rc 0/0 00000100:00100000:2.0:1746127011.364981:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17406 00000100:00100000:0.0:1746127011.365793:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.366939:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.366992:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991906048 00000100:00100000:1.0:1746127011.367009:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991906048 00000100:00100000:1.0:1746127011.367050:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6661 00000100:00100000:1.0:1746127011.367057:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4604:x1830945991906048:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127011.367240:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4604:x1830945991906048:12345-192.168.203.42@tcp:35:cat.0 Request processed in 183us (301us total) trans 8589938374 rc 0/0 00000100:00100000:1.0:1746127011.367246:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6661 00000100:00100000:2.0:1746127011.367651:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991905792 00000100:00100000:2.0:1746127011.367655:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991905792 00000100:00100000:3.0:1746127011.369631:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17407 00000100:00100000:3.0:1746127011.369646:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4605:x1830945991905792:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.369670:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.369691:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6efb555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54033 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.369759:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.369771:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370114:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370144:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370154:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370160:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370260:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370268:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370273:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:3.0:1746127011.370282:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127011.370349:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370356:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370361:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370367:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370373:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d2c3400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.370377:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370382:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370393:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127011.370396:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.370399:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370404:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3400/0x34dc807b6efb55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370436:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370441:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370445:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370449:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d2c3600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.370452:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370457:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370463:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7400) 00010000:00010000:3.0:1746127011.370465:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.370467:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370471:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3600/0x34dc807b6efb563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.370512:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2600/0x34dc807b6efb555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.370524:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.370530:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.370532:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127011.370534:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3200, rc 0) 00000100:00100000:3.0:1746127011.370595:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4605:x1830945991905792:12345-192.168.203.42@tcp:101:cat.0 Request processed in 953us (4803us total) trans 8589938375 rc 0/0 00000100:00100000:3.0:1746127011.370602:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17407 00000100:00100000:2.0:1746127011.371111:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.371241:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.371420:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991906176 00000100:00100000:3.0:1746127011.371429:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991906176 00000100:00100000:3.0:1746127011.371464:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22248 00000100:00100000:3.0:1746127011.371470:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:4604:x1830945991906176:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.371483:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.371496:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5403a expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.371521:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.371523:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.371531:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 21 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.371543:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 21 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.371551:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3000, rc 0) 00000100:00100000:3.0:1746127011.371574:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:4604:x1830945991906176:12345-192.168.203.42@tcp:101:cat.0 Request processed in 104us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.371580:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22248 00000100:00100000:3.0:1746127011.371858:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991906432 00000100:00100000:3.0:1746127011.371862:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991906432 00000100:00100000:3.0:1746127011.371956:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17408 00000100:00100000:3.0:1746127011.371962:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4602:x1830945991906432:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127011.371974:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.371988:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6efb57f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54041 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.372067:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.372079:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 31 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.372087:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.372093:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127011.372122:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.372279:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 9 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.372291:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094819c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355328:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.372588:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 31 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.372597:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 31 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.372605:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355456:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.373024:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.373504:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.373831:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991906688 00000100:00100000:1.0:1746127011.373838:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991906688 00000100:00100000:1.0:1746127011.373884:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6662 00000100:00100000:1.0:1746127011.373890:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4605:x1830945991906688:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127011.374062:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4605:x1830945991906688:12345-192.168.203.42@tcp:35:cat.0 Request processed in 172us (559us total) trans 8589938376 rc 0/0 00000100:00100000:1.0:1746127011.374068:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6662 00000100:00100000:0.0:1746127011.374470:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.374971:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991906944 00000100:00100000:3.0:1746127011.374976:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991906944 00002000:00100000:3.0:1746127011.375019:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012d3fe680 x1830945991906944/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.375028:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe680 with x1830945991906944 ext(0->1048575) 00002000:00010000:3.0:1746127011.375033:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fe680 00000100:00100000:3.0:1746127011.375047:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8914 00000100:00100000:3.0:1746127011.375053:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2028:x1830945991906944:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127011.375170:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094819c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355328:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.375179:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355456:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.375200:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127011.376210:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.376217:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.376239:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991907072 00000100:00100000:2.0:1746127011.376242:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991907072 00000100:00100000:1.0:1746127011.376263:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127011.376277:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 32 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.376312:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10461 00000100:00100000:2.0:1746127011.376319:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991907072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.376328:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.376333:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 32 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.376334:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127011.376343:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 32 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.376365:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f000/0x34dc807b6efb547 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5402c expref: 32 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.376399:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991907584 00000100:00100000:0.0:1746127011.376403:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991907584 00010000:00010000:0.0:1746127011.376417:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.376439:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10462 00000100:00100000:0.0:1746127011.376443:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2029:x1830945991907584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127011.376450:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127011.376453:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.376475:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.376483:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.376492:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.376497:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127011.376502:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.376513:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3200/0x34dc807b6efb56a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54033 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.376547:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.376551:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.376557:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.376563:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.376580:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127011.376594:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991907584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 151us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.376601:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10462 00010000:00010000:0.0:1746127011.376629:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.376633:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:0.0:1746127011.376647:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:2.0:1746127011.376920:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991907072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 225us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.376928:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10461 00000100:00100000:2.0:1746127011.376945:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991907456 00000100:00100000:2.0:1746127011.376948:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991907456 00000100:00100000:2.0:1746127011.376967:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991907200 00010000:00010000:0.0:1746127011.376968:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3e00/0x34dc807b6efb57f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 32 pid: 7259 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.376969:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991907200 00000100:00100000:2.0:1746127011.376979:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17409 00010000:00010000:0.0:1746127011.376981:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 31 pid: 7259 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.376984:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4600:x1830945991907456:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127011.376987:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.376989:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746127011.376991:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c2c00, rc 0) 00010000:00010000:2.0:1746127011.377006:0:10958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.377018:0:10958:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f200/0x34dc807b6efb594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5404f expref: -99 pid: 10958 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127011.377033:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4602:x1830945991906432:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5071us (5792us total) trans 8589938377 rc 0/0 00000100:00100000:0.0:1746127011.377038:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17408 00000100:00100000:0.0:1746127011.377056:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17410 00000100:00100000:0.0:1746127011.377074:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4605:x1830945991907200:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127011.377082:0:10958:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127011.377082:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127011.377090:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2e00/0x34dc807b6efb5a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54048 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.377091:0:10958:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10958 initiator: MDT0 00010000:00010000:2.0:1746127011.377097:0:10958:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00000004:00200000:2.0:1746127011.377103:0:10958:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127011.377121:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.377152:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.377158:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 2/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10958 initiator: MDT0 00010000:00010000:0.0:1746127011.377163:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.377179:0:10958:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213f200/0x34dc807b6efb594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 15 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.377189:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.377200:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.377208:0:10958:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 6/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.377211:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355584:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.377215:0:10958:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 6/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.377219:0:10958:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e000, rc 0) 00000100:00100000:2.0:1746127011.377434:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4600:x1830945991907456:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 448us (1217us total) trans 8589938378 rc 0/0 00000100:00100000:2.0:1746127011.377439:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17409 00010000:00010000:0.0:1746127011.377486:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.377497:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 30 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.377505:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355712:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127011.377531:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127011.382545:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355584:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.382563:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994355712:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.382599:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127011.385787:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.385855:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991907840 00000100:00100000:2.0:1746127011.385865:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991907840 00010000:00010000:2.0:1746127011.385902:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.385944:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.386459:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991907712 00000100:00100000:2.0:1746127011.386463:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991907712 00010000:00010000:2.0:1746127011.386480:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 31 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.386484:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10463 00000100:00100000:0.0:1746127011.386494:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991907840:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127011.386499:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10464 00000100:00100000:2.0:1746127011.386504:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991907712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127011.386507:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.386512:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127011.386513:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.386516:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 31 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.386525:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.386613:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 31 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.386639:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2c00/0x34dc807b6efb586 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54041 expref: 31 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.386655:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.386660:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x40 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.386669:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x40 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.386674:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x40 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.386679:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.386721:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991907712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 217us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.386727:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10464 00010000:00010000:0.0:1746127011.387214:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb59b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5404f expref: 14 pid: 10958 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.387226:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.387230:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.387239:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.387245:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.387353:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127011.387374:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991907840:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 882us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.387380:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10463 00000100:00100000:3.0:1746127011.387579:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2028:x1830945991906944:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12524us (13107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127011.387588:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8914 00002000:00100000:3.0:1746127011.387596:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012d3fe680 x1830945991906944/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.387605:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3fe680 with x1830945991906944 ext(0->1048575) 00002000:00010000:3.0:1746127011.387609:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3fe680 00010000:00010000:2.0:1746127011.387615:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.387623:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:2.0:1746127011.387673:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127011.387678:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127011.387695:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.387704:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.387729:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c2e00/0x34dc807b6efb5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 13 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.387742:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.387749:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.387752:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746127011.387754:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a03000, rc 0) 00000100:00100000:2.0:1746127011.387796:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4605:x1830945991907200:12345-192.168.203.42@tcp:101:cat.0 Request processed in 10734us (11533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.387803:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17410 00000100:00100000:2.0:1746127011.393288:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.393359:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991907968 00000100:00100000:0.0:1746127011.393370:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991907968 00000100:00100000:0.0:1746127011.393412:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17411 00000100:00100000:0.0:1746127011.393418:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4605:x1830945991907968:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127011.393441:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127011.393459:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54056 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.393518:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 13 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.393534:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 13 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.393550:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.393553:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127011.393556:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35cc00, rc 0) 00000100:00100000:0.0:1746127011.393678:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4605:x1830945991907968:12345-192.168.203.42@tcp:101:cat.0 Request processed in 259us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.393684:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17411 00000100:00100000:0.0:1746127011.397811:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.399755:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991908096 00000100:00100000:2.0:1746127011.399766:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991908096 00000100:00100000:2.0:1746127011.399829:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17412 00000100:00100000:2.0:1746127011.399836:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4602:x1830945991908096:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127011.399863:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.399882:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb5be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5405d expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.399946:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb5be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5405d expref: 31 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.399962:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb5be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5405d expref: 31 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.399982:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.399985:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127011.399988:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e800, rc 0) 00000100:00100000:2.0:1746127011.400068:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4602:x1830945991908096:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 228us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.400075:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17412 00000100:00100000:2.0:1746127011.401283:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.401658:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991908224 00000100:00100000:3.0:1746127011.401665:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991908224 00000100:00100000:3.0:1746127011.401698:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22249 00000100:00100000:3.0:1746127011.401704:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4604:x1830945991908224:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.401718:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.401732:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54064 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.401751:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.401753:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.401759:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 36 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.401771:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 36 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.401780:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fd400, rc 0) 00000100:00100000:3.0:1746127011.401812:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4604:x1830945991908224:12345-192.168.203.42@tcp:101:cat.0 Request processed in 108us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.401818:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22249 00000100:00100000:2.0:1746127011.401863:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.401993:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991908352 00000100:00100000:0.0:1746127011.402006:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991908352 00000100:00100000:0.0:1746127011.402039:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22250 00000100:00100000:0.0:1746127011.402044:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:4605:x1830945991908352:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127011.402051:0:11152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127011.402062:0:11152:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5406b expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.402076:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.402077:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.402082:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 8 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.402092:0:11152:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 8 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.402099:0:11152:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c35c000, rc 0) 00000100:00100000:0.0:1746127011.402121:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4605:x1830945991908352:12345-192.168.203.42@tcp:101:cat.0 Request processed in 77us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.402126:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22250 00000100:00100000:2.0:1746127011.404707:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.404756:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991908608 00000100:00100000:3.0:1746127011.404766:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991908608 00000100:00100000:3.0:1746127011.404816:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17413 00000100:00100000:3.0:1746127011.404823:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4602:x1830945991908608:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127011.404842:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.404846:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746127011.404871:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e800/0x34dc807b6efb5be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5405d expref: 31 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.404895:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.404899:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127011.404910:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc800/0x34dc807b6efb5d3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54072 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.404969:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.404980:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.404991:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.405172:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.405188:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 6/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.405219:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.405230:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 12 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.405243:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994355840:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.405339:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.405350:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 7 pid: 13448 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.405358:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994355968:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.405386:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.405393:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 12 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.405401:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994356096:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.405424:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.406036:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.406125:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991908736 00000100:00100000:2.0:1746127011.406163:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991908736 00000100:00100000:2.0:1746127011.406396:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17414 00000100:00100000:2.0:1746127011.406405:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4604:x1830945991908736:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127011.406419:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.406433:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54079 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.406477:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.406486:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 33 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.406501:0:7259:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.406512:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 33 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.406523:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.406526:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127011.406528:0:7259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.406535:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012213e000, rc 0) 00000100:00100000:2.0:1746127011.408711:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4604:x1830945991908736:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2295us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.408722:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17414 00000100:00100000:0.0:1746127011.409726:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.409777:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.409803:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.410286:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.410380:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991908864 00000100:00100000:2.0:1746127011.410389:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991908864 00010000:00010000:2.0:1746127011.410430:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 13 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.410459:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991909120 00000100:00100000:2.0:1746127011.410463:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991909120 00010000:00010000:2.0:1746127011.410476:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 14 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.410493:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991908992 00000100:00100000:2.0:1746127011.410497:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991908992 00010000:00010000:2.0:1746127011.410507:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 8 pid: 13448 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.410523:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10465 00000100:00100000:2.0:1746127011.410531:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991908864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.410547:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.410554:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 14 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.410566:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 14 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.410590:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.410596:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.410604:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.410613:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.410663:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991908864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 132us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.410670:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10465 00000100:00100000:2.0:1746127011.410687:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10466 00000100:00100000:2.0:1746127011.410694:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991909120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.410702:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.410706:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 13 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.410714:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 13 pid: 7259 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.410725:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.410728:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.410733:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.410738:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.410758:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991909120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.410764:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10466 00000100:00100000:2.0:1746127011.410777:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10467 00000100:00100000:2.0:1746127011.410783:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991908992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.410794:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.410798:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 8 pid: 13448 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.410807:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 8 pid: 13448 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.410819:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.410823:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.410831:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.410837:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.410845:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 32 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.410862:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.410883:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991908992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.410889:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10467 00010000:00010000:2.0:1746127011.410942:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c35cc00/0x34dc807b6efb5b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54056 expref: 12 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.410964:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994355840:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.410979:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb400/0x34dc807b6efb52b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54025 expref: 7 pid: 13448 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.411028:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994355968:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.411042:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a03000/0x34dc807b6efb5b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54048 expref: 11 pid: 7259 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.411051:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994356096:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.411075:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.411083:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127011.411088:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13448 initiator: MDT0 00000040:00080000:2.0:1746127011.411449:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1471, 88 off137056 00000004:00080000:2.0:1746127011.411458:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453327899ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411495:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1481, 88 off138024 00000004:00080000:2.0:1746127011.411500:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453370826ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.411516:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1482, 88 off138112 00000004:00080000:2.0:1746127011.411519:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453389344ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.411528:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1472, 88 off137144 00000004:00080000:2.0:1746127011.411530:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453400596ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411536:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1473, 88 off137232 00000004:00080000:2.0:1746127011.411538:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453409049ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411545:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1483, 88 off138200 00000004:00080000:2.0:1746127011.411547:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453418202ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.411554:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1484, 88 off138288 00000004:00080000:2.0:1746127011.411557:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453427934ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.411564:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1485, 88 off138376 00000004:00080000:2.0:1746127011.411567:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453437821ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.411574:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1474, 88 off137320 00000004:00080000:2.0:1746127011.411576:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453446712ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411582:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1486, 88 off138464 00000004:00080000:2.0:1746127011.411585:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453455747ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.411593:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1475, 88 off137408 00000004:00080000:2.0:1746127011.411595:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453465442ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411601:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1487, 88 off138552 00000004:00080000:2.0:1746127011.411604:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453475056ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127011.411611:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1476, 88 off137496 00000004:00080000:2.0:1746127011.411613:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453484229ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411621:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1477, 88 off137584 00000004:00080000:2.0:1746127011.411623:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453493399ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411629:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1478, 88 off137672 00000004:00080000:2.0:1746127011.411632:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453502434ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411638:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1479, 88 off137760 00000004:00080000:2.0:1746127011.411641:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906453511422ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127011.411648:0:13448:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1488, 88 off138640 00000004:00080000:2.0:1746127011.411650:0:13448:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906453521031ns, next at 895431202182ns, rc = 0 00000100:00100000:3.0:1746127011.411839:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991909248 00000100:00100000:3.0:1746127011.411847:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991909248 00000100:00100000:3.0:1746127011.411902:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17415 00000100:00100000:3.0:1746127011.411910:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4605:x1830945991909248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.411929:0:11634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.411944:0:11634:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54080 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.411987:0:11634:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 12 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.412012:0:11634:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 12 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.412021:0:11634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.412024:0:11634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127011.412026:0:11634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 33 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.412032:0:11634:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fc400, rc 0) 00000100:00100000:3.0:1746127011.412054:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4605:x1830945991909248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 146us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.412059:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17415 00000001:00080000:1.0:1746127011.414824:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938379 is committed 00000004:00080000:1.0:1746127011.414838:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1462 committed 00000004:00080000:1.0:1746127011.416333:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1453 committed 00000004:00080000:1.0:1746127011.416342:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1452 committed 00000004:00080000:1.0:1746127011.416343:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1451 committed 00000004:00080000:1.0:1746127011.416345:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1450 committed 00000004:00080000:1.0:1746127011.416347:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1461 committed 00000100:00100000:3.0:1746127011.416539:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.416598:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.416623:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.416634:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.416650:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746127011.416654:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.416665:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.416675:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.416685:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.416705:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994356224 00000100:00100000:3.0:1746127011.416711:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994356224 00000100:00100000:3.0:1746127011.416741:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994356736 00000100:00100000:3.0:1746127011.416742:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994356736 00000100:00100000:3.0:1746127011.416751:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994356352 00000100:00100000:3.0:1746127011.416753:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994356352 00000100:00100000:3.0:1746127011.416761:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994356864 00000100:00100000:3.0:1746127011.416763:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994356864 00000100:00100000:3.0:1746127011.416773:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22251 00000100:00100000:3.0:1746127011.416779:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994356224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127011.416905:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127011.416908:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.416910:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.416912:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.416914:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746127011.416938:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994356224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (340us total) trans 17179875709 rc 0/0 00000100:00100000:3.0:1746127011.416944:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22251 00000100:00100000:3.0:1746127011.416957:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22252 00000100:00100000:3.0:1746127011.416961:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994356736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417018:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994356736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (382us total) trans 17179875710 rc 0/0 00000100:00100000:3.0:1746127011.417023:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22252 00000100:00100000:3.0:1746127011.417031:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22253 00000100:00100000:3.0:1746127011.417035:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994356352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127011.417067:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127011.417069:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.417071:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.417073:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.417075:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746127011.417088:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994356352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (421us total) trans 17179875711 rc 0/0 00000100:00100000:3.0:1746127011.417092:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22253 00000100:00100000:3.0:1746127011.417098:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22254 00000100:00100000:3.0:1746127011.417102:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3782:x1830945994356864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127011.417146:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:3.0:1746127011.417148:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:3.0:1746127011.417150:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127011.417152:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:3.0:1746127011.417154:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1746127011.417168:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994356864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (482us total) trans 17179875712 rc 0/0 00000100:00100000:3.0:1746127011.417172:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22254 00000004:00080000:3.0:1746127011.417203:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0ed80/2, rc 0, transno 17179875711 00000100:00100000:3.0:1746127011.417207:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356352:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127011.417213:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0ce00/2, rc 0, transno 17179875712 00000100:00100000:3.0:1746127011.417215:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127011.417221:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0dc00/2, rc 0, transno 17179875709 00000100:00100000:3.0:1746127011.417224:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127011.417228:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0e680/2, rc 0, transno 17179875710 00000100:00100000:3.0:1746127011.417231:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994356736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417246:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994356480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417260:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.417269:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994356992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417281:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.417289:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746127011.417293:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994356608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417303:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.417310:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994357120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417320:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127011.417337:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994356480 00000100:00100000:3.0:1746127011.417339:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994356480 00000100:00100000:3.0:1746127011.417350:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994356992 00000100:00100000:3.0:1746127011.417351:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994356992 00000100:00100000:3.0:1746127011.417360:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994356608 00000100:00100000:3.0:1746127011.417362:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994356608 00000100:00100000:3.0:1746127011.417369:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994357120 00000100:00100000:3.0:1746127011.417370:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994357120 00000100:00100000:3.0:1746127011.417378:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22255 00000100:00100000:3.0:1746127011.417382:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3784:x1830945994356480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127011.417417:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127011.417420:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.417422:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.417423:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:3.0:1746127011.417426:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746127011.417442:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3784:x1830945994356480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (181us total) trans 17179875713 rc 0/0 00000100:00100000:3.0:1746127011.417447:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22255 00000100:00100000:3.0:1746127011.417454:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22256 00000100:00100000:3.0:1746127011.417458:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3784:x1830945994356992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417500:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3784:x1830945994356992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (218us total) trans 17179875714 rc 0/0 00000100:00100000:3.0:1746127011.417504:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22256 00000100:00100000:3.0:1746127011.417512:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22257 00000100:00100000:3.0:1746127011.417516:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3784:x1830945994356608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127011.417546:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127011.417548:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127011.417550:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127011.417552:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127011.417554:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127011.417566:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3784:x1830945994356608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (262us total) trans 17179875715 rc 0/0 00000100:00100000:3.0:1746127011.417570:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22257 00000100:00100000:3.0:1746127011.417577:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22258 00000100:00100000:3.0:1746127011.417581:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3784:x1830945994357120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127011.417619:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3784:x1830945994357120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (298us total) trans 17179875716 rc 0/0 00000100:00100000:3.0:1746127011.417623:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22258 00000004:00080000:3.0:1746127011.417643:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0d500/2, rc 0, transno 17179875715 00000100:00100000:3.0:1746127011.417646:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994356608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127011.417651:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0e300/2, rc 0, transno 17179875716 00000100:00100000:3.0:1746127011.417653:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994357120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127011.417658:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0fb80/2, rc 0, transno 17179875713 00000100:00100000:3.0:1746127011.417661:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994356480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127011.417666:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ab0ea00/2, rc 0, transno 17179875714 00000100:00100000:3.0:1746127011.417668:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994356992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127011.417878:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.417904:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.417917:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.417928:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.417938:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746127011.417941:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.417952:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.417959:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.417970:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.417983:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994357376 00000100:00100000:0.0:1746127011.417985:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994357376 00000100:00100000:0.0:1746127011.418013:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994357888 00000100:00100000:0.0:1746127011.418015:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994357888 00000100:00100000:0.0:1746127011.418023:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994357248 00000100:00100000:0.0:1746127011.418025:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994357248 00000100:00100000:0.0:1746127011.418031:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994357760 00000100:00100000:0.0:1746127011.418032:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994357760 00000100:00100000:0.0:1746127011.418041:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22259 00000100:00100000:0.0:1746127011.418045:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994357376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127011.418103:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127011.418106:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.418108:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.418109:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.418111:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127011.418150:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3783:x1830945994357376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (224us total) trans 21474842986 rc 0/0 00000100:00100000:0.0:1746127011.418155:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22259 00000100:00100000:0.0:1746127011.418163:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22260 00000100:00100000:0.0:1746127011.418167:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994357888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.418211:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3783:x1830945994357888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (281us total) trans 21474842987 rc 0/0 00000100:00100000:0.0:1746127011.418216:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22260 00000100:00100000:0.0:1746127011.418223:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22261 00000100:00100000:0.0:1746127011.418227:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994357248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127011.418254:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127011.418256:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.418258:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.418260:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:0.0:1746127011.418262:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746127011.418274:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3783:x1830945994357248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (321us total) trans 21474842988 rc 0/0 00000100:00100000:0.0:1746127011.418278:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22261 00000100:00100000:0.0:1746127011.418285:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22262 00000100:00100000:0.0:1746127011.418288:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3783:x1830945994357760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.418329:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3783:x1830945994357760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (359us total) trans 21474842989 rc 0/0 00000100:00100000:0.0:1746127011.418335:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22262 00000004:00080000:0.0:1746127011.418352:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60e00/2, rc 0, transno 21474842988 00000100:00100000:0.0:1746127011.418358:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127011.418363:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60700/2, rc 0, transno 21474842989 00000100:00100000:0.0:1746127011.418366:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127011.418371:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a62d80/2, rc 0, transno 21474842986 00000100:00100000:0.0:1746127011.418373:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127011.418378:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a62300/2, rc 0, transno 21474842987 00000100:00100000:0.0:1746127011.418381:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994357888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.418531:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1449 committed 00000004:00080000:1.0:1746127011.418534:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1460 committed 00000004:00080000:1.0:1746127011.418536:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1448 committed 00000004:00080000:1.0:1746127011.418537:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1459 committed 00000004:00080000:1.0:1746127011.418539:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1458 committed 00000004:00080000:1.0:1746127011.418540:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1457 committed 00000004:00080000:1.0:1746127011.418542:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1447 committed 00000004:00080000:1.0:1746127011.418543:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1446 committed 00000004:00080000:1.0:1746127011.418544:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1456 committed 00000004:00080000:1.0:1746127011.418545:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1455 committed 00000004:00080000:1.0:1746127011.418547:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1445 committed 00000001:00080000:1.0:1746127011.418565:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938378 is committed 00000001:00080000:1.0:1746127011.418578:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938372 is committed 00000100:00100000:1.0:1746127011.418592:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994357632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.418615:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.418626:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994358144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.418638:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.418647:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746127011.418651:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994357504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.418661:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.418668:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994358016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127011.418678:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127011.418694:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994357632 00000100:00100000:1.0:1746127011.418696:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994357632 00000100:00100000:1.0:1746127011.418710:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994358144 00000100:00100000:1.0:1746127011.418712:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994358144 00000100:00100000:1.0:1746127011.418726:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994357504 00000100:00100000:1.0:1746127011.418728:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994357504 00000100:00100000:1.0:1746127011.418736:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994358016 00000100:00100000:1.0:1746127011.418738:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994358016 00000100:00100000:1.0:1746127011.418745:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22263 00000100:00100000:1.0:1746127011.418749:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3785:x1830945994357632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127011.418789:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746127011.418791:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.418793:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127011.418795:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.418796:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:1.0:1746127011.418813:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3785:x1830945994357632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (198us total) trans 21474842990 rc 0/0 00000100:00100000:1.0:1746127011.418818:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22263 00000100:00100000:1.0:1746127011.418909:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22264 00000100:00100000:1.0:1746127011.418913:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3785:x1830945994358144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127011.418945:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:1.0:1746127011.418947:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.418949:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127011.418951:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127011.418953:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:1.0:1746127011.418966:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3785:x1830945994358144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (327us total) trans 21474842991 rc 0/0 00000100:00100000:1.0:1746127011.418971:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22264 00000100:00100000:1.0:1746127011.418978:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22265 00000100:00100000:1.0:1746127011.418982:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3785:x1830945994357504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127011.419022:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:1.0:1746127011.419024:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127009 -> 1746127009 00002000:00010000:1.0:1746127011.419026:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127009 -> 1746127009 00002000:00010000:1.0:1746127011.419028:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127009 -> 1746127009 00002000:00010000:1.0:1746127011.419029:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:1.0:1746127011.419045:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3785:x1830945994357504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (383us total) trans 21474842992 rc 0/0 00000100:00100000:1.0:1746127011.419050:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22265 00000100:00100000:1.0:1746127011.419058:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22266 00000100:00100000:1.0:1746127011.419062:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3785:x1830945994358016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127011.419095:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746127011.419096:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127011.419098:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127011.419099:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:1.0:1746127011.419101:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:1.0:1746127011.419117:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3785:x1830945994358016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (438us total) trans 21474842993 rc 0/0 00000100:00100000:1.0:1746127011.419122:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22266 00000004:00080000:1.0:1746127011.419160:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60000/2, rc 0, transno 21474842992 00000100:00100000:1.0:1746127011.419163:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994357504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.419169:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60a80/2, rc 0, transno 21474842993 00000100:00100000:1.0:1746127011.419171:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994358016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.419176:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a61880/2, rc 0, transno 21474842990 00000100:00100000:1.0:1746127011.419178:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994357632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127011.419183:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a62a00/2, rc 0, transno 21474842991 00000100:00100000:1.0:1746127011.419186:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994358144:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746127011.419292:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.419305:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.419307:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746127011.419312:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.419323:0:13448:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.419329:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.419337:0:13448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.419344:0:13448:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.419350:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.419381:0:13448:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 8 pid: 11634 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.419392:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a63800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994358400:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127011.419502:0:13448:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.419511:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994358528:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127011.419533:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.420037:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746127011.420050:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994358272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.420083:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127011.420168:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994358272 00000100:00100000:0.0:1746127011.420174:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994358272 00000100:00100000:0.0:1746127011.420222:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22267 00000100:00100000:0.0:1746127011.420230:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3783:x1830945994358272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.420344:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3783:x1830945994358272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (260us total) trans 21474842994 rc 0/0 00000100:00100000:0.0:1746127011.420350:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22267 00000004:00080000:0.0:1746127011.420383:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a63b80/2, rc 0, transno 21474842994 00000100:00100000:0.0:1746127011.420389:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994358272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127011.422441:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.422459:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a63800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994358400:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127011.422471:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994358528:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127011.422514:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc800/0x34dc807b6efb5d3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 30 pid: 13448 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746127011.422534:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127011.422548:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 29 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.422585:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967fca00, rc 0) 00000100:00100000:1.0:1746127011.422596:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991909376 00000100:00100000:1.0:1746127011.422602:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991909376 00000100:00100000:2.0:1746127011.422624:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4602:x1830945991908608:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 17802us (17926us total) trans 8589938379 rc 0/0 00000100:00100000:2.0:1746127011.422631:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17413 00000100:00100000:1.0:1746127011.422633:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991909504 00000100:00100000:1.0:1746127011.422636:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991909504 00000100:00100000:1.0:1746127011.422649:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6663 00000100:00100000:1.0:1746127011.422654:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4604:x1830945991909376:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:2.0:1746127011.422656:0:12342:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6664 00000100:00100000:2.0:1746127011.422660:0:12342:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4605:x1830945991909504:12345-192.168.203.42@tcp:49:cat.0 00000100:00100000:2.0:1746127011.422717:0:12342:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4605:x1830945991909504:12345-192.168.203.42@tcp:49:cat.0 Request processed in 56us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.422717:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4604:x1830945991909376:12345-192.168.203.42@tcp:49:cat.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.422721:0:12342:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6664 00000100:00100000:1.0:1746127011.423178:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6663 00000100:00100000:0.0:1746127011.429742:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.429822:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991909760 00000100:00100000:3.0:1746127011.429832:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991909760 00002000:00100000:3.0:1746127011.429882:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd7b80 x1830945991909760/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.429893:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7b80 with x1830945991909760 ext(1048576->2097151) 00002000:00010000:3.0:1746127011.429898:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd7b80 00000100:00100000:3.0:1746127011.429973:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8915 00000100:00100000:3.0:1746127011.429981:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991909760:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127011.430586:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.430702:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991910016 00000100:00100000:1.0:1746127011.430708:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991910016 00002000:00100000:1.0:1746127011.430737:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88007edd4e00 x1830945991910016/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.430745:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4e00 with x1830945991910016 ext(0->1048575) 00002000:00010000:1.0:1746127011.430749:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd4e00 00000100:00100000:1.0:1746127011.430794:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8916 00000100:00100000:1.0:1746127011.430802:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991910016:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127011.443626:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2027:x1830945991910016:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12810us (13027us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127011.443641:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8916 00002000:00100000:1.0:1746127011.443657:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88007edd4e00 x1830945991910016/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.443667:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4e00 with x1830945991910016 ext(0->1048575) 00002000:00010000:1.0:1746127011.443674:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd4e00 00000100:00100000:3.0:1746127011.448452:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945991909760:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 18459us (18711us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127011.448464:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8915 00002000:00100000:3.0:1746127011.448476:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd7b80 x1830945991909760/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.448485:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd7b80 with x1830945991909760 ext(1048576->2097151) 00002000:00010000:3.0:1746127011.448492:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd7b80 00000100:00100000:0.0:1746127011.455931:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.456020:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991910144 00000100:00100000:3.0:1746127011.456031:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991910144 00000100:00100000:3.0:1746127011.456097:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22268 00000100:00100000:3.0:1746127011.456106:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4605:x1830945991910144:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.456125:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.456174:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54087 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.456201:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.456203:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.456212:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.456227:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.456238:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a88000, rc 0) 00000100:00100000:3.0:1746127011.456302:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4605:x1830945991910144:12345-192.168.203.42@tcp:101:cat.0 Request processed in 197us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.456308:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22268 00000100:00100000:0.0:1746127011.459493:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.459549:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.459581:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991910272 00000100:00100000:2.0:1746127011.459590:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991910272 00000100:00100000:2.0:1746127011.459636:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991910400 00000100:00100000:2.0:1746127011.459638:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991910400 00000100:00100000:2.0:1746127011.459665:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22269 00000100:00100000:0.0:1746127011.459671:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22270 00000100:00100000:2.0:1746127011.459673:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4604:x1830945991910272:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:0.0:1746127011.459676:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:4602:x1830945991910400:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127011.459693:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127011.459698:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.459711:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5408e expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.459711:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54095 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.459734:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.459737:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.459739:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 13 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.459744:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 39 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.459748:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.459754:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 39 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.459756:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 39 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.459759:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.459761:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.459763:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1064960->1286143] (req 1064960->1286143) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 39 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.459766:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d2c3e00, rc 0) 00010000:00010000:0.0:1746127011.459789:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 39 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.459799:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 39 pid: 3542 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.459807:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4604:x1830945991910272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 136us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.459811:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994358656:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.459812:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22269 00010000:00010000:0.0:1746127011.459877:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.459885:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 11 pid: 12340 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.459892:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994358784:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127011.459915:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 13 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.459923:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 13 pid: 16295 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746127011.459931:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994358912:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127011.459951:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afd480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.465497:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.465737:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991910656 00000100:00100000:3.0:1746127011.465750:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991910656 00002000:00100000:3.0:1746127011.465811:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd5c00 x1830945991910656/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.465822:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5c00 with x1830945991910656 ext(1048576->2097151) 00010000:00010000:3.0:1746127011.465833:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 12 pid: 12340 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.465848:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 12 pid: 12340 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746127011.465856:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007edd5c00 00000100:00100000:3.0:1746127011.465898:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1988 00000100:00100000:3.0:1746127011.465907:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991910656:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127011.476184:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.476820:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994358656:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.477364:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.477569:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994358784:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127011.477579:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994358912:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127011.477618:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [1064960->1286143] (req 1064960->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 38 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.477643:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880076179400, rc 0) 00000100:00100000:0.0:1746127011.477694:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4602:x1830945991910400:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 18017us (18143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.477703:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22270 00000100:00100000:2.0:1746127011.478535:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.480041:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991910784 00000100:00100000:1.0:1746127011.480053:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991910784 00010000:00010000:1.0:1746127011.480098:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 38 pid: 3542 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.480142:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991910912 00000100:00100000:1.0:1746127011.480145:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991910912 00010000:00010000:1.0:1746127011.480155:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 14 pid: 16295 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.480184:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10468 00000100:00100000:1.0:1746127011.480192:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2029:x1830945991910784:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.480208:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.480230:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 38 pid: 3542 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.480239:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10469 00010000:00010000:1.0:1746127011.480242:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 38 pid: 3542 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.480247:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991910912:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127011.480253:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.480273:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967fd400/0x34dc807b6efb5c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54064 expref: 38 pid: 3542 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746127011.480392:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 14 pid: 16295 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746127011.480400:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 14 pid: 16295 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746127011.480413:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dcfc400/0x34dc807b6efb4bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54002 expref: 14 pid: 16295 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746127011.480430:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127011.480481:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991910912:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 235us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.480487:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10469 00010000:00010000:1.0:1746127011.480546:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127011.480566:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2029:x1830945991910784:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 375us (4394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.480572:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10468 00000100:00100000:0.0:1746127011.481256:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991911168 00000100:00100000:0.0:1746127011.481264:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991911168 00002000:00100000:0.0:1746127011.481302:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fd8000 x1830945991911168/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.481312:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd8000 with x1830945991911168 ext(1048576->2097151) 00002000:00010000:0.0:1746127011.481565:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fd8000 00000100:00100000:0.0:1746127011.481596:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8917 00000100:00100000:0.0:1746127011.481602:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991911168:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127011.484851:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991910656:12345-192.168.203.42@tcp:3:cat.0 Request processed in 18930us (19350us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.484865:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1988 00002000:00100000:2.0:1746127011.484880:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88007edd5c00 x1830945991910656/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.484891:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5c00 with x1830945991910656 ext(1048576->2097151) 00010000:00010000:2.0:1746127011.484903:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 12 pid: 12340 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.484919:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 12 pid: 12340 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746127011.484925:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007edd5c00 00000100:00100000:0.0:1746127011.499105:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.499182:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991911296 00000100:00100000:2.0:1746127011.499191:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991911296 00000100:00100000:2.0:1746127011.499407:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22271 00000100:00100000:2.0:1746127011.499415:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4605:x1830945991911296:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127011.499433:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.499452:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5409c expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.499481:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.499483:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.499490:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.499504:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.499515:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac800, rc 0) 00000100:00100000:2.0:1746127011.499682:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4605:x1830945991911296:12345-192.168.203.42@tcp:101:cat.0 Request processed in 267us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.499689:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22271 00000100:00100000:2.0:1746127011.501370:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991911168:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 19762us (22830us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.501381:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8917 00002000:00100000:2.0:1746127011.501393:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fd8000 x1830945991911168/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.501403:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fd8000 with x1830945991911168 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.501409:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fd8000 00000100:00100000:2.0:1746127011.504677:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.504771:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991911424 00000100:00100000:1.0:1746127011.504781:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991911424 00010000:00010000:1.0:1746127011.504819:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 13 pid: 12340 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.507153:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10470 00000100:00100000:1.0:1746127011.507174:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991911424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.507200:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.507227:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 13 pid: 12340 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.507241:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 13 pid: 12340 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.507269:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a88000/0x34dc807b6efb5ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54087 expref: 13 pid: 12340 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746127011.507298:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.507300:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.507308:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.507316:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.507352:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 36 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.507365:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994359040:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127011.507477:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746127011.508723:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.508805:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.509370:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991911680 00000100:00100000:2.0:1746127011.509379:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991911680 00002000:00100000:2.0:1746127011.509425:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123477b80 x1830945991911680/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.509434:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477b80 with x1830945991911680 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.509438:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123477b80 00000100:00100000:2.0:1746127011.509459:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8918 00000100:00100000:2.0:1746127011.509467:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991911680:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127011.512649:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.512730:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991911808 00000100:00100000:3.0:1746127011.512739:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991911808 00000100:00100000:3.0:1746127011.512786:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22272 00000100:00100000:3.0:1746127011.512792:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:4604:x1830945991911808:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.512810:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.512828:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540a3 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.512850:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.512852:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.512859:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 22 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.512872:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 22 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.512881:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7c00, rc 0) 00000100:00100000:3.0:1746127011.512919:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:4604:x1830945991911808:12345-192.168.203.42@tcp:101:cat.0 Request processed in 127us (4113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.512926:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22272 00000100:00100000:0.0:1746127011.514239:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994359040:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127011.514262:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127011.514300:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991911424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7136us (9635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.514309:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10470 00000100:00100000:2.0:1746127011.515864:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991912064 00000100:00100000:2.0:1746127011.515876:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991912064 00002000:00100000:2.0:1746127011.515919:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1064960->1069055) req@ffff880123475c00 x1830945991912064/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.515930:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475c00 with x1830945991912064 ext(1064960->1069055) 00002000:00010000:2.0:1746127011.515936:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123475c00 00000100:00100000:2.0:1746127011.515971:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8919 00000100:00100000:2.0:1746127011.515978:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991912064:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127011.516573:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991912064:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 594us (3931us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127011.516580:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8919 00002000:00100000:2.0:1746127011.516586:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1064960->1069055) req@ffff880123475c00 x1830945991912064/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/4536 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.516592:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123475c00 with x1830945991912064 ext(1064960->1069055) 00002000:00010000:2.0:1746127011.516595:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123475c00 00000100:00100000:2.0:1746127011.519121:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991911680:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9646us (10392us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.519157:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8918 00002000:00100000:2.0:1746127011.519167:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff880123477b80 x1830945991911680/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.519173:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477b80 with x1830945991911680 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.519178:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123477b80 00000100:00100000:0.0:1746127011.521028:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.521359:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991912320 00000100:00100000:2.0:1746127011.521368:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991912320 00002000:00100000:2.0:1746127011.521415:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007edd5500 x1830945991912320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.521425:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5500 with x1830945991912320 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.521430:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd5500 00000100:00100000:2.0:1746127011.521466:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8920 00000100:00100000:2.0:1746127011.521474:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2029:x1830945991912320:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127011.522715:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.522769:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991912576 00000100:00100000:3.0:1746127011.522776:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991912576 00002000:00100000:3.0:1746127011.522805:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1282048->1286143) req@ffff88007edd4a80 x1830945991912576/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.522814:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4a80 with x1830945991912576 ext(1282048->1286143) 00002000:00010000:3.0:1746127011.522820:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd4a80 00000100:00100000:3.0:1746127011.522849:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8921 00000100:00100000:3.0:1746127011.522855:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991912576:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127011.522941:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991912576:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 86us (230us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127011.522947:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8921 00002000:00100000:3.0:1746127011.522952:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1282048->1286143) req@ffff88007edd4a80 x1830945991912576/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/4536 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.522961:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd4a80 with x1830945991912576 ext(1282048->1286143) 00002000:00010000:3.0:1746127011.522963:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007edd4a80 00000100:00100000:0.0:1746127011.527826:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.527937:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991912704 00000100:00100000:3.0:1746127011.527947:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991912704 00000100:00100000:3.0:1746127011.528450:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22273 00000100:00100000:3.0:1746127011.528460:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4605:x1830945991912704:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.528479:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.528497:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540aa expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.528523:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.528525:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.528532:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 9 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.528547:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 9 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.528556:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6400, rc 0) 00000100:00100000:3.0:1746127011.528611:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4605:x1830945991912704:12345-192.168.203.42@tcp:101:cat.0 Request processed in 153us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.528616:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22273 00000100:00100000:0.0:1746127011.536191:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.536275:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2029:x1830945991912320:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 14800us (15252us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.536288:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8920 00002000:00100000:2.0:1746127011.536300:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88007edd5500 x1830945991912320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.536309:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007edd5500 with x1830945991912320 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.536315:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007edd5500 00000100:00100000:0.0:1746127011.536793:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.536855:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991913088 00000100:00100000:1.0:1746127011.536864:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991913088 00000100:00100000:1.0:1746127011.536901:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6665 00000100:00100000:1.0:1746127011.536908:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4602:x1830945991913088:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127011.537362:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991913216 00000100:00100000:2.0:1746127011.537367:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991913216 00002000:00100000:2.0:1746127011.537392:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012d3ff800 x1830945991913216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.537400:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff800 with x1830945991913216 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.537404:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3ff800 00000100:00100000:1.0:1746127011.541182:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4602:x1830945991913088:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 4259us (4985us total) trans 8589938380 rc 0/0 00000100:00100000:1.0:1746127011.541195:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6665 00000100:00100000:0.0:1746127011.542460:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.542511:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.543287:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8922 00000100:00100000:2.0:1746127011.543303:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991913216:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127011.544619:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991913344 00000100:00100000:1.0:1746127011.544630:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991913344 00000100:00100000:1.0:1746127011.544668:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991913472 00000100:00100000:1.0:1746127011.544670:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991913472 00000100:00100000:1.0:1746127011.544701:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22274 00000100:00100000:1.0:1746127011.544707:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2028:x1830945991913344:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127011.544721:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.544738:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540b1 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.544761:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.544763:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.544771:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 23 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.544787:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 23 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.544804:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918a200, rc 0) 00000100:00100000:1.0:1746127011.544838:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991913344:12345-192.168.203.42@tcp:101:cat.0 Request processed in 130us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.544844:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22274 00000100:00100000:1.0:1746127011.544954:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22275 00000100:00100000:1.0:1746127011.544970:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991913472:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127011.544987:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.545016:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540b8 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.545038:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.545040:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.545047:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 38 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.545061:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 38 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.545070:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009918b800, rc 0) 00000100:00100000:1.0:1746127011.545107:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991913472:12345-192.168.203.42@tcp:101:cat.0 Request processed in 145us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.545112:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22275 00000100:00100000:2.0:1746127011.561116:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2028:x1830945991913216:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17805us (24309us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.561712:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8922 00002000:00100000:2.0:1746127011.561727:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012d3ff800 x1830945991913216/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.561737:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3ff800 with x1830945991913216 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.561744:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3ff800 00000100:00100000:1.0:1746127011.565855:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.565896:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.565951:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991913856 00000100:00100000:3.0:1746127011.565959:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991913856 00002000:00100000:3.0:1746127011.566028:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880123474a80 x1830945991913856/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.566044:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474a80 with x1830945991913856 ext(2097152->4194303) 00002000:00010000:3.0:1746127011.566049:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123474a80 00000100:00100000:3.0:1746127011.566062:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991913984 00000100:00100000:3.0:1746127011.566064:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991913984 00002000:00100000:3.0:1746127011.566074:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880123476a00 x1830945991913984/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.566080:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476a00 with x1830945991913984 ext(2097152->4194303) 00002000:00010000:3.0:1746127011.566082:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123476a00 00000100:00100000:3.0:1746127011.566100:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8923 00000100:00100000:3.0:1746127011.566106:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991913856:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127011.567102:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8924 00000100:00100000:0.0:1746127011.567115:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991913984:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127011.579599:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.579640:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.579683:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.579727:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991914112 00000100:00100000:3.0:1746127011.579737:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991914112 00000100:00100000:2.0:1746127011.579743:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991914240 00000100:00100000:2.0:1746127011.579747:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991914240 00000100:00100000:1.0:1746127011.579747:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991914368 00000100:00100000:1.0:1746127011.579752:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991914368 00000100:00100000:2.0:1746127011.579786:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22276 00000100:00100000:3.0:1746127011.579794:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22277 00000100:00100000:1.0:1746127011.579799:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22278 00000100:00100000:3.0:1746127011.579801:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991914112:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127011.579806:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991914368:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127011.579811:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2029:x1830945991914240:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.579824:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.579824:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.579836:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.579842:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efb62e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540bf expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.579842:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540c6 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.579846:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540cd expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.579862:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.579862:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.579864:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.579864:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.579871:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.579871:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.579889:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.579890:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 10 pid: 3148 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127011.579895:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994359168:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127011.579898:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6600, rc 0) 00010000:00010000:1.0:1746127011.579898:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6200, rc 0) 00000100:00100000:1.0:1746127011.579951:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991914368:12345-192.168.203.42@tcp:101:cat.0 Request processed in 145us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.579952:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991914240:12345-192.168.203.42@tcp:101:cat.0 Request processed in 158us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.579957:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22278 00000100:00100000:2.0:1746127011.579961:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22276 00000100:00100000:3.0:1746127011.579982:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746127011.582196:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991913856:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16080us (16340us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127011.582207:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8923 00002000:00100000:2.0:1746127011.582219:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880123474a80 x1830945991913856/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.582229:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123474a80 with x1830945991913856 ext(2097152->4194303) 00002000:00010000:2.0:1746127011.582235:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123474a80 00002000:00010000:3.0:1746127011.584527:0:9611:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127009 -> 1746127010 00002000:00010000:3.0:1746127011.584536:0:9611:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127009 -> 1746127010 00002000:00010000:3.0:1746127011.584539:0:9611:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127009 -> 1746127010 00000100:00100000:3.0:1746127011.584567:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994359168:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127011.584610:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efb62e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540bf expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.584626:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efb62e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540bf expref: 14 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.584670:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6200, rc 0) 00000100:00100000:3.0:1746127011.584752:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991914112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4949us (5160us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.584762:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22277 00000100:00100000:0.0:1746127011.608464:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.608651:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991914624 00000100:00100000:2.0:1746127011.608661:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991914624 00002000:00100000:2.0:1746127011.608707:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009cc3ca80 x1830945991914624/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.608717:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3ca80 with x1830945991914624 ext(2097152->4194303) 00002000:00010000:2.0:1746127011.608722:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3ca80 00000100:00100000:2.0:1746127011.609061:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8925 00000100:00100000:2.0:1746127011.609070:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991914624:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127011.610100:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.610542:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991913984:12345-192.168.203.42@tcp:3:cat.0 Request processed in 43429us (44642us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127011.610554:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8924 00002000:00100000:1.0:1746127011.610565:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880123476a00 x1830945991913984/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.610575:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123476a00 with x1830945991913984 ext(2097152->4194303) 00002000:00010000:1.0:1746127011.610581:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880123476a00 00000100:00100000:1.0:1746127011.610770:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991914880 00000100:00100000:1.0:1746127011.610777:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991914880 00002000:00100000:1.0:1746127011.610808:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cc3df80 x1830945991914880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.610815:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3df80 with x1830945991914880 ext(2097152->4194303) 00002000:00010000:1.0:1746127011.610819:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3df80 00000100:00100000:1.0:1746127011.610834:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8926 00000100:00100000:1.0:1746127011.610839:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991914880:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127011.625281:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.629825:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991915136 00000100:00100000:3.0:1746127011.629839:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991915136 00002000:00100000:3.0:1746127011.629886:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801220f0700 x1830945991915136/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.629898:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0700 with x1830945991915136 ext(4194304->4829183) 00002000:00010000:3.0:1746127011.629904:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801220f0700 00000100:00100000:3.0:1746127011.629947:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8927 00000100:00100000:3.0:1746127011.629953:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991915136:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127011.641288:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991914880:12345-192.168.203.42@tcp:3:cat.0 Request processed in 30434us (31182us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127011.641303:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8926 00002000:00100000:1.0:1746127011.641316:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009cc3df80 x1830945991914880/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.641325:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3df80 with x1830945991914880 ext(2097152->4194303) 00002000:00010000:1.0:1746127011.641331:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cc3df80 00000100:00100000:2.0:1746127011.651049:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:2029:x1830945991914624:12345-192.168.203.42@tcp:3:cat.0 Request processed in 41967us (42582us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127011.651064:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8925 00002000:00100000:2.0:1746127011.651076:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009cc3ca80 x1830945991914624/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.651086:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cc3ca80 with x1830945991914624 ext(2097152->4194303) 00002000:00010000:2.0:1746127011.651092:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cc3ca80 00000100:00100000:3.0:1746127011.655197:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991915136:12345-192.168.203.42@tcp:3:cat.0 Request processed in 25232us (29913us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127011.655209:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8927 00002000:00100000:3.0:1746127011.655219:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8801220f0700 x1830945991915136/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127011.655229:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f0700 with x1830945991915136 ext(4194304->4829183) 00002000:00010000:3.0:1746127011.655235:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801220f0700 00000100:00100000:0.0:1746127011.662878:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.665191:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991915264 00000100:00100000:3.0:1746127011.665204:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991915264 00000100:00100000:3.0:1746127011.665259:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22279 00000100:00100000:3.0:1746127011.665267:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4600:x1830945991915264:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127011.665286:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.665303:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540d4 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.665331:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 14 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.665340:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.665347:0:9611:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.665353:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.665355:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.665358:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 11 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.665386:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.665395:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 22 pid: 12340 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746127011.665411:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994359296:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.665521:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 11 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.665528:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 11 pid: 3148 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746127011.665535:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994359424:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.665561:0:9611:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 14 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.665569:0:9611:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 14 pid: 9613 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746127011.665577:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994359552:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.665591:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127011.667916:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.667916:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.668030:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991915520 00000100:00100000:3.0:1746127011.668037:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991915520 00000100:00100000:0.0:1746127011.668046:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991915648 00000100:00100000:0.0:1746127011.668050:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991915648 00000100:00100000:0.0:1746127011.668090:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22280 00000100:00100000:0.0:1746127011.668098:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991915648:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127011.668153:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.668170:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac6c00/0x34dc807b6efb643 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540e2 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.668216:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994359680:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127011.668278:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2540 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.668322:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17416 00000100:00100000:3.0:1746127011.668327:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4609:x1830945991915520:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127011.668339:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.668351:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c200/0x34dc807b6efb64a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540db expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.668413:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668424:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668433:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668443:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668448:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668452:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668534:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668540:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668544:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127011.668551:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127011.668610:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668616:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668625:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668630:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009665c800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.668633:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668639:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668648:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127011.668651:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.668655:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668659:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c800/0x34dc807b6efb651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668682:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668686:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668690:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668694:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009665ce00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.668696:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668699:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668708:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7300) 00010000:00010000:3.0:1746127011.668709:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.668711:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.668715:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665ce00/0x34dc807b6efb658 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.669699:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665c200/0x34dc807b6efb64a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 33 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.669711:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.669717:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.669719:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127011.669721:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665da00, rc 0) 00000100:00100000:3.0:1746127011.670360:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4609:x1830945991915520:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2031us (2450us total) trans 8589938381 rc 0/0 00000100:00100000:3.0:1746127011.670367:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17416 00000100:00100000:3.0:1746127011.671868:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994359296:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127011.672896:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.672927:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991915776 00000100:00100000:0.0:1746127011.672933:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991915776 00000100:00100000:1.0:1746127011.672946:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994359680:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127011.672965:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 23 pid: 12340 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.672972:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6c00/0x34dc807b6efb643 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e2 expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.672988:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6c00/0x34dc807b6efb643 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e2 expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.673011:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac6c00, rc 0) 00000100:00100000:3.0:1746127011.673063:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994359424:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.673070:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994359552:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.673089:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 11 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.673104:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7800, rc 0) 00000100:00100000:3.0:1746127011.673151:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4600:x1830945991915264:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7885us (10283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.673158:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22279 00000100:00100000:3.0:1746127011.673205:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.673259:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991915648:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5162us (5348us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127011.673264:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22280 00000100:00100000:0.0:1746127011.673490:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991915904 00000100:00100000:0.0:1746127011.673494:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991915904 00010000:00010000:0.0:1746127011.673507:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 15 pid: 9613 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746127011.673537:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10471 00000100:00100000:2.0:1746127011.673545:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945991915776:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.673557:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.673570:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 23 pid: 12340 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.673580:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 23 pid: 12340 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.673596:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009918a200/0x34dc807b6efb619 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b1 expref: 23 pid: 12340 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.673609:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.673624:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2029:x1830945991915776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 81us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.673629:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10471 00000100:00100000:2.0:1746127011.673639:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10472 00000100:00100000:2.0:1746127011.673643:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991915904:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.673648:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.673653:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 15 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.673659:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 15 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.673668:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096643e00/0x34dc807b6efb4de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54017 expref: 15 pid: 9613 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.673674:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.673683:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991915904:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 40us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.673687:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10472 00000100:00100000:0.0:1746127011.677549:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.677647:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991916032 00000100:00100000:2.0:1746127011.677657:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991916032 00010000:00010000:2.0:1746127011.677693:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 11 pid: 3148 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746127011.677720:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10473 00000100:00100000:2.0:1746127011.677725:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991916032:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.677738:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.677758:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 11 pid: 3148 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.677768:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 11 pid: 3148 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.677795:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6600/0x34dc807b6efb627 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540c6 expref: 11 pid: 3148 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.677806:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.677808:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.677814:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 10 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.677821:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 10 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.677849:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 10 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.677859:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994359808:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127011.677943:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.678179:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.678247:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991916160 00000100:00100000:0.0:1746127011.678250:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991916160 00000100:00100000:0.0:1746127011.678282:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22281 00000100:00100000:0.0:1746127011.678287:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4605:x1830945991916160:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127011.678299:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127011.678311:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540e9 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.678329:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 12 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.678335:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127011.678337:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127011.678340:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.678356:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 12 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.678365:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 12 pid: 9611 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.678373:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994359936:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127011.678403:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.683205:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994359808:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127011.683212:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994359936:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.683228:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127011.683237:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.683252:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341ac00, rc 0) 00000100:00100000:3.0:1746127011.683614:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2027:x1830945991916032:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5886us (6074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.683614:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4605:x1830945991916160:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5325us (5435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.683623:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10473 00000100:00100000:2.0:1746127011.683623:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22281 00000100:00100000:0.0:1746127011.686483:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.686532:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991916416 00000100:00100000:2.0:1746127011.686542:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991916416 00000100:00100000:0.0:1746127011.686542:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.686570:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991916544 00000100:00100000:0.0:1746127011.686572:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991916544 00002000:00100000:2.0:1746127011.686589:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3805184->4194303) req@ffff880130a7aa00 x1830945991916416/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.686599:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7aa00 with x1830945991916416 ext(3805184->4194303) 00000100:00100000:0.0:1746127011.686602:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22282 00010000:00010000:2.0:1746127011.686608:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 11 pid: 9611 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.686609:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4600:x1830945991916544:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127011.686623:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 11 pid: 9611 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.686623:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746127011.686630:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a7aa00 00010000:00010000:0.0:1746127011.686639:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540f0 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.686644:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1989 00000100:00100000:2.0:1746127011.686649:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991916416:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:0.0:1746127011.686667:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.686675:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.686682:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 37 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.686687:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.686689:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.686692:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->3739647] (req 3145728->3739647) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 14 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.686720:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 37 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.686729:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 37 pid: 12340 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746127011.686740:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360064:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.688805:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 14 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.688820:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 14 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746127011.688832:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360192:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.688885:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.688893:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 12 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746127011.688906:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360320:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.688924:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.690920:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360064:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.694569:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.694661:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360192:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.694672:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360320:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.694705:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [3145728->3739647] (req 3145728->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 14 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.694724:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012341aa00, rc 0) 00000100:00100000:3.0:1746127011.694770:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4600:x1830945991916544:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8161us (8226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.694777:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22282 00000100:00100000:2.0:1746127011.694850:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991916672 00000100:00100000:2.0:1746127011.694857:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991916672 00010000:00010000:2.0:1746127011.694889:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 38 pid: 12340 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746127011.694920:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10474 00000100:00100000:2.0:1746127011.694926:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991916672:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.694938:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.694957:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 38 pid: 12340 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.694966:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 38 pid: 12340 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.694988:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009918b800/0x34dc807b6efb620 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540b8 expref: 38 pid: 12340 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746127011.695011:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.695032:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2027:x1830945991916672:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 107us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.695037:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10474 00000100:00100000:2.0:1746127011.697936:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.697976:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991916416:12345-192.168.203.42@tcp:4:cat.0 Request processed in 11324us (11499us total) trans 21474842995 rc 0/0 00000100:00100000:0.0:1746127011.697987:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1989 00002000:00100000:0.0:1746127011.698012:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3805184->4194303) req@ffff880130a7aa00 x1830945991916416/t21474842995(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/448 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746127011.698019:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991916800 00002000:00100000:0.0:1746127011.698022:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7aa00 with x1830945991916416 ext(3805184->4194303) 00000100:00100000:3.0:1746127011.698026:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991916800 00010000:00010000:0.0:1746127011.698031:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 13 pid: 9611 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.698045:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 13 pid: 9611 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746127011.698051:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a7aa00 00010000:00010000:3.0:1746127011.698052:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 13 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746127011.698090:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10475 00000100:00100000:3.0:1746127011.698101:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991916800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127011.698113:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127011.698153:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 13 pid: 1964 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746127011.698171:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 13 pid: 1964 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746127011.698192:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8c8e00/0x34dc807b6efb4d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5401e expref: 13 pid: 1964 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746127011.698214:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.698389:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.698649:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991916928 00000100:00100000:1.0:1746127011.698653:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991916928 00010000:00010000:1.0:1746127011.698671:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 14 pid: 1964 timeout: 1006 lvb_type: 1 00000100:00100000:1.0:1746127011.698689:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10476 00000100:00100000:1.0:1746127011.698694:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991916928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.698703:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.698710:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 14 pid: 1964 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.698718:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 14 pid: 1964 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.698731:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac6200/0x34dc807b6efb635 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540cd expref: 14 pid: 1964 timeout: 1006 lvb_type: 1 00010000:00010000:1.0:1746127011.698744:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.698747:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127011.698753:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.698761:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127011.698790:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 13 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.698802:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994360448:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127011.698862:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991916800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 761us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.698869:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10475 00000100:00100000:1.0:1746127011.699714:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7cf2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.702196:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.702240:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991917056 00000100:00100000:0.0:1746127011.702247:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991917056 00010000:00010000:0.0:1746127011.702278:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 13 pid: 9611 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746127011.702302:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10477 00000100:00100000:0.0:1746127011.702309:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991917056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127011.702321:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746127011.702337:0:7247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127009 -> 1746127010 00002000:00010000:0.0:1746127011.702340:0:7247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127009 -> 1746127010 00010000:00010000:0.0:1746127011.702346:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 13 pid: 9611 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.702358:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 13 pid: 9611 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.702380:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7800/0x34dc807b6efb63c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540d4 expref: 13 pid: 9611 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.702399:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.702401:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127011.702407:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.702414:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127011.702442:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127011.702452:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994360576:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127011.702513:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094afdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127011.708151:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123477800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994360448:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127011.708175:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127011.708816:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991916928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10119us (10424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.708827:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10476 00000100:00100000:0.0:1746127011.709065:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994360576:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127011.709079:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127011.709096:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991917056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6787us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.709103:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10477 00000100:00100000:3.0:1746127011.709310:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.710344:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.710391:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991917312 00000100:00100000:2.0:1746127011.710397:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991917312 00000100:00100000:0.0:1746127011.710554:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991917568 00000100:00100000:0.0:1746127011.710558:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991917568 00002000:00100000:0.0:1746127011.710590:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3735552->3739647) req@ffff88009ab0d180 x1830945991917568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.710599:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d180 with x1830945991917568 ext(3735552->3739647) 00002000:00010000:0.0:1746127011.710604:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0d180 00000100:00100000:0.0:1746127011.710622:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8928 00000100:00100000:0.0:1746127011.710628:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991917568:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127011.710740:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991917568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 112us (397us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127011.710745:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8928 00002000:00100000:0.0:1746127011.710750:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3735552->3739647) req@ffff88009ab0d180 x1830945991917568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/4536 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.710756:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0d180 with x1830945991917568 ext(3735552->3739647) 00002000:00010000:0.0:1746127011.710759:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ab0d180 00002000:00100000:2.0:1746127011.710983:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0f800 x1830945991917312/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.710989:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0f800 with x1830945991917312 ext(4194304->4829183) 00002000:00010000:2.0:1746127011.710992:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0f800 00000100:00100000:2.0:1746127011.711011:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8929 00000100:00100000:2.0:1746127011.711016:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991917312:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127011.718668:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991917312:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7639us (9347us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127011.718681:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8929 00002000:00100000:2.0:1746127011.718693:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009ab0f800 x1830945991917312/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.718702:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0f800 with x1830945991917312 ext(4194304->4829183) 00002000:00010000:2.0:1746127011.718709:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0f800 00000100:00100000:0.0:1746127011.719688:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.719777:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991917824 00000100:00100000:1.0:1746127011.719785:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991917824 00000100:00100000:1.0:1746127011.719826:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6666 00000100:00100000:1.0:1746127011.719834:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4600:x1830945991917824:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127011.720038:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4600:x1830945991917824:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 205us (353us total) trans 8589938382 rc 0/0 00000100:00100000:1.0:1746127011.720045:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6666 00000100:00100000:0.0:1746127011.728113:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.729848:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991917952 00000100:00100000:3.0:1746127011.729859:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991917952 00000100:00100000:3.0:1746127011.729906:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22283 00000100:00100000:3.0:1746127011.729913:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991917952:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.729929:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.729947:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7000/0x34dc807b6efb67b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540f7 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.730006:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360704:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.731059:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.742355:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360704:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127011.742397:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7000/0x34dc807b6efb67b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f7 expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.742417:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7000/0x34dc807b6efb67b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f7 expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.742435:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7000, rc 0) 00000100:00100000:3.0:1746127011.742484:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991917952:12345-192.168.203.42@tcp:101:cat.0 Request processed in 12571us (14382us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.742493:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22283 00000100:00100000:0.0:1746127011.745953:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.746048:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991918080 00000100:00100000:3.0:1746127011.746059:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991918080 00000100:00100000:3.0:1746127011.746609:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22284 00000100:00100000:3.0:1746127011.746618:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991918080:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.746636:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.746656:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6c00/0x34dc807b6efb682 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e540fe expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.746714:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360832:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.746813:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.748975:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994360832:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127011.749020:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6c00/0x34dc807b6efb682 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540fe expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.749032:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6c00/0x34dc807b6efb682 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540fe expref: 14 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.749046:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6c00, rc 0) 00000100:00100000:3.0:1746127011.749089:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991918080:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2471us (3145us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.749097:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22284 00000100:00100000:0.0:1746127011.794877:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.795210:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991918208 00000100:00100000:3.0:1746127011.795220:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991918208 00000100:00100000:3.0:1746127011.795269:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22285 00000100:00100000:3.0:1746127011.795277:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:4609:x1830945991918208:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127011.795295:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.795313:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54105 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.795342:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 11 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.795349:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.795350:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.795354:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3633152->4194303] (req 3633152->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.795384:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 11 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.795395:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 11 pid: 3148 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.795412:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994360960:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.795520:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.797917:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994360960:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127011.797952:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3633152->4194303] (req 3633152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.797972:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6a00, rc 0) 00000100:00100000:3.0:1746127011.798034:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:4609:x1830945991918208:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2756us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.798043:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22285 00000100:00100000:0.0:1746127011.800378:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.800430:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.800477:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.800825:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991918336 00000100:00100000:2.0:1746127011.800929:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991918336 00000100:00100000:3.0:1746127011.801031:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991918464 00000100:00100000:3.0:1746127011.801036:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991918464 00000100:00100000:3.0:1746127011.801071:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991918592 00000100:00100000:3.0:1746127011.801073:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991918592 00000100:00100000:3.0:1746127011.801087:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22286 00000100:00100000:3.0:1746127011.801093:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945991918464:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.801113:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.801157:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efb690 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5410c expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.801182:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127011.801192:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efb690 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5410c expref: 24 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.801202:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efb690 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5410c expref: 24 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.801219:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7e00, rc 0) 00000100:00100000:3.0:1746127011.801258:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945991918464:12345-192.168.203.42@tcp:101:cat.0 Request processed in 165us (827us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.801265:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22286 00000100:00100000:3.0:1746127011.801278:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22287 00000100:00100000:3.0:1746127011.801282:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991918592:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.801289:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.801298:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efb697 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54113 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.801335:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994361088:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.801381:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746127011.801652:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.801673:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10478 00000100:00100000:2.0:1746127011.801679:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991918336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.801687:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.801707:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.801717:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.801735:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012341ac00/0x34dc807b6efb66d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540e9 expref: 12 pid: 3148 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.801747:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.801748:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.801754:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 22 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.801761:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 22 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.801784:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 22 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.801796:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994361216:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127011.801834:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.806066:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.806109:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991918848 00000100:00100000:0.0:1746127011.806117:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991918848 00002000:00100000:0.0:1746127011.806181:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3633152->3637247) req@ffff880130a7bb80 x1830945991918848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.806197:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7bb80 with x1830945991918848 ext(3633152->3637247) 00002000:00010000:0.0:1746127011.806202:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7bb80 00000100:00100000:0.0:1746127011.806226:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8930 00000100:00100000:0.0:1746127011.806233:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991918848:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127011.806366:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991918848:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 133us (310us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127011.806372:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8930 00002000:00100000:0.0:1746127011.806376:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (3633152->3637247) req@ffff880130a7bb80 x1830945991918848/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/4536 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.806383:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a7bb80 with x1830945991918848 ext(3633152->3637247) 00002000:00010000:0.0:1746127011.806385:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a7bb80 00002000:00010000:3.0:1746127011.806612:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746127009 -> 1746127010 00002000:00010000:3.0:1746127011.806615:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127009 -> 1746127010 00002000:00010000:3.0:1746127011.806617:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746127009 -> 1746127010 00000100:00100000:3.0:1746127011.806631:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994361088:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127011.806661:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efb697 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54113 expref: 38 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.806674:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7400/0x34dc807b6efb697 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54113 expref: 38 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.806688:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7400, rc 0) 00000100:00100000:3.0:1746127011.806710:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991918592:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5427us (6233us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.806717:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22287 00000100:00100000:2.0:1746127011.806788:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994361216:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127011.806802:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.806821:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991918336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5143us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.806829:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10478 00000100:00100000:0.0:1746127011.813304:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.813363:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.813456:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991919232 00000100:00100000:2.0:1746127011.813462:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991919360 00000100:00100000:1.0:1746127011.813466:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991919232 00000100:00100000:2.0:1746127011.813467:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991919360 00002000:00100000:2.0:1746127011.813509:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880130a79c00 x1830945991919360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.813509:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a79180 x1830945991919232/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 504/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.813519:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79c00 with x1830945991919360 ext(0->1048575) 00002000:00100000:1.0:1746127011.813519:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79180 with x1830945991919232 ext(1048576->2097151) 00002000:00010000:2.0:1746127011.813524:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79c00 00002000:00010000:1.0:1746127011.813524:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a79180 00000100:00100000:2.0:1746127011.813581:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8931 00000100:00100000:2.0:1746127011.813588:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991919360:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127011.813599:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8932 00000100:00100000:1.0:1746127011.813605:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2028:x1830945991919232:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127011.814234:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.814254:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991919488 00000100:00100000:3.0:1746127011.814257:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991919488 00000100:00100000:3.0:1746127011.814288:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22288 00000100:00100000:3.0:1746127011.814293:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4609:x1830945991919488:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127011.814302:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.814319:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5411a expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.814343:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.814350:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127011.814352:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127011.814355:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->3489791] (req 3145728->3489791) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.814385:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.814394:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 12 pid: 3148 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746127011.814405:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994361344:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127011.814468:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.820987:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.821031:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994361344:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127011.821036:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991919616 00000100:00100000:0.0:1746127011.821043:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991919616 00010000:00010000:3.0:1746127011.821060:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->3489791] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 40 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.821077:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7200, rc 0) 00002000:00100000:0.0:1746127011.821080:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3739647) req@ffff880130a78700 x1830945991919616/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127011.821089:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78700 with x1830945991919616 ext(3145728->3739647) 00010000:00010000:0.0:1746127011.821095:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 13 pid: 3148 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746127011.821108:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 13 pid: 3148 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746127011.821120:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a78700 00000100:00100000:3.0:1746127011.821147:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4609:x1830945991919488:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 6853us (6914us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.821155:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22288 00000100:00100000:1.0:1746127011.821164:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2028:x1830945991919232:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7557us (7868us total) trans 0 rc 827392/827392 00000100:00100000:1.0:1746127011.821171:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8932 00002000:00100000:1.0:1746127011.821177:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff880130a79180 x1830945991919232/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 504/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.821184:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79180 with x1830945991919232 ext(1048576->2097151) 00002000:00010000:1.0:1746127011.821188:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a79180 00000100:00100000:0.0:1746127011.821367:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1990 00000100:00100000:0.0:1746127011.822209:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991919616:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127011.823086:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991919360:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9495us (9719us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.823094:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8931 00002000:00100000:2.0:1746127011.823101:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff880130a79c00 x1830945991919360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.823109:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a79c00 with x1830945991919360 ext(0->1048575) 00002000:00010000:2.0:1746127011.823113:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a79c00 00000100:00100000:2.0:1746127011.834499:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991919616:12345-192.168.203.42@tcp:4:cat.0 Request processed in 12281us (13511us total) trans 17179875717 rc 0/0 00000100:00100000:2.0:1746127011.834514:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1990 00002000:00100000:2.0:1746127011.834525:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3739647) req@ffff880130a78700 x1830945991919616/t17179875717(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:17/0 lens 488/448 e 0 to 0 dl 1746127022 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.834534:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78700 with x1830945991919616 ext(3145728->3739647) 00010000:00010000:2.0:1746127011.834544:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 15 pid: 3148 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.834561:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 15 pid: 3148 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746127011.834567:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130a78700 00000100:00100000:0.0:1746127011.836954:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.837093:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991919744 00000100:00100000:2.0:1746127011.837102:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991919744 00010000:00010000:2.0:1746127011.842805:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 15 pid: 3148 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746127011.842874:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10479 00000100:00100000:2.0:1746127011.842888:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991919744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127011.842904:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127011.842924:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 15 pid: 3148 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.842935:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 15 pid: 3148 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746127011.842963:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012341aa00/0x34dc807b6efb674 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540f0 expref: 15 pid: 3148 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746127011.843091:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.843123:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991920000 00000100:00100000:1.0:1746127011.843143:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991920000 00002000:00100000:1.0:1746127011.843186:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880123477800 x1830945991920000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.843194:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477800 with x1830945991920000 ext(2097152->3145727) 00002000:00010000:1.0:1746127011.843199:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123477800 00000100:00100000:1.0:1746127011.843213:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8933 00000100:00100000:1.0:1746127011.843219:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991920000:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127011.843897:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.843900:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127011.843908:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 37 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.843916:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 37 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.844099:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 37 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.844111:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994361472:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127011.844217:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1746127011.857637:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994361472:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127011.857664:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127011.857714:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991919744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 14830us (20767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.857725:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10479 00000100:00100000:0.0:1746127011.862191:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.862689:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991920000:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19467us (19595us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127011.862702:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8933 00002000:00100000:1.0:1746127011.862716:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff880123477800 x1830945991920000/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.862726:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880123477800 with x1830945991920000 ext(2097152->3145727) 00002000:00010000:1.0:1746127011.862732:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880123477800 00000100:00100000:1.0:1746127011.862757:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991920256 00000100:00100000:1.0:1746127011.862764:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991920256 00002000:00100000:1.0:1746127011.862797:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3485696->3489791) req@ffff880130a78e00 x1830945991920256/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.862805:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78e00 with x1830945991920256 ext(3485696->3489791) 00002000:00010000:1.0:1746127011.862808:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a78e00 00000100:00100000:1.0:1746127011.862824:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8934 00000100:00100000:1.0:1746127011.862830:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991920256:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127011.862943:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2026:x1830945991920256:12345-192.168.203.42@tcp:3:cat.0 Request processed in 112us (764us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127011.862949:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8934 00002000:00100000:1.0:1746127011.862953:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3485696->3489791) req@ffff880130a78e00 x1830945991920256/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/4536 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.862961:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a78e00 with x1830945991920256 ext(3485696->3489791) 00002000:00010000:1.0:1746127011.862963:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a78e00 00000100:00100000:0.0:1746127011.866692:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.866797:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991920512 00000100:00100000:2.0:1746127011.866807:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991920512 00000100:00100000:2.0:1746127011.866869:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6667 00000100:00100000:2.0:1746127011.866878:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4609:x1830945991920512:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127011.867117:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4609:x1830945991920512:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 240us (435us total) trans 8589938383 rc 0/0 00000100:00100000:2.0:1746127011.867123:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6667 00000100:00100000:0.0:1746127011.869784:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.871165:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991920768 00000100:00100000:2.0:1746127011.871177:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991920768 00002000:00100000:2.0:1746127011.871227:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff8801220f1f80 x1830945991920768/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.871238:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1f80 with x1830945991920768 ext(2097152->3145727) 00002000:00010000:2.0:1746127011.871244:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801220f1f80 00000100:00100000:2.0:1746127011.871275:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8935 00000100:00100000:2.0:1746127011.871283:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991920768:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127011.877815:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.878349:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991921024 00000100:00100000:1.0:1746127011.878359:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991921024 00002000:00100000:1.0:1746127011.878405:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3633151) req@ffff880095ca8a80 x1830945991921024/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127011.878416:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8a80 with x1830945991921024 ext(3145728->3633151) 00000100:00100000:2.0:1746127011.878483:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.878519:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991921280 00000100:00100000:2.0:1746127011.878522:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991921280 00002000:00100000:2.0:1746127011.878541:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3489792->4194303) req@ffff8800a2fdb480 x1830945991921280/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.878548:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb480 with x1830945991921280 ext(3489792->4194303) 00002000:00010000:2.0:1746127011.878552:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fdb480 00000100:00100000:2.0:1746127011.878586:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8936 00000100:00100000:2.0:1746127011.878593:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991921280:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:1.0:1746127011.878720:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca8a80 00000100:00100000:1.0:1746127011.878741:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8937 00000100:00100000:1.0:1746127011.878748:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945991921024:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127011.888307:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991920768:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17012us (18519us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127011.888320:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8935 00000100:00100000:1.0:1746127011.888329:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945991921024:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9582us (10523us total) trans 0 rc 487424/487424 00002000:00100000:2.0:1746127011.888332:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->3145727) req@ffff8801220f1f80 x1830945991920768/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127011.888335:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8937 00002000:00100000:1.0:1746127011.888339:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3633151) req@ffff880095ca8a80 x1830945991921024/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 487424/487424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.888342:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801220f1f80 with x1830945991920768 ext(2097152->3145727) 00002000:00100000:1.0:1746127011.888345:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ca8a80 with x1830945991921024 ext(3145728->3633151) 00002000:00010000:2.0:1746127011.888348:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801220f1f80 00002000:00010000:1.0:1746127011.888348:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ca8a80 00000100:00100000:2.0:1746127011.893173:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2028:x1830945991921280:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14569us (14678us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746127011.893187:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8936 00002000:00100000:2.0:1746127011.893197:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (3489792->4194303) req@ffff8800a2fdb480 x1830945991921280/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.893207:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb480 with x1830945991921280 ext(3489792->4194303) 00002000:00010000:2.0:1746127011.893213:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fdb480 00000100:00100000:0.0:1746127011.896985:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.897560:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991921536 00000100:00100000:2.0:1746127011.897570:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991921536 00002000:00100000:2.0:1746127011.897615:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880095cab800 x1830945991921536/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/0 e 0 to 0 dl 1746127022 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.897626:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab800 with x1830945991921536 ext(4194304->4829183) 00002000:00010000:2.0:1746127011.897632:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab800 00000100:00100000:2.0:1746127011.897660:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8938 00000100:00100000:2.0:1746127011.897667:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991921536:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127011.902525:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991921536:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4847us (5539us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127011.902537:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8938 00002000:00100000:2.0:1746127011.902548:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880095cab800 x1830945991921536/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:17/0 lens 488/440 e 0 to 0 dl 1746127022 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127011.902558:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cab800 with x1830945991921536 ext(4194304->4829183) 00002000:00010000:2.0:1746127011.902564:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cab800 00010000:00010000:2.0:1746127011.910161:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127011.939717:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.939934:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991921792 00000100:00100000:3.0:1746127011.939943:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991921792 00000100:00100000:3.0:1746127011.940045:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17417 00000100:00100000:3.0:1746127011.940054:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+10:4619:x1830945991921792:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127011.940082:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.940101:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094504c00/0x34dc807b6efb6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54121 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.940217:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940231:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940242:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940254:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940259:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940267:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940497:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940514:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940521:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127011.940530:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127011.940597:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940604:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940609:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940615:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094505200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.940618:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940624:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940633:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127011.940635:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.940639:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940648:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940673:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940678:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940682:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940686:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094504800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.940688:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940692:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940697:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7a00) 00010000:00010000:3.0:1746127011.940699:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.940701:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940705:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.940737:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094504c00/0x34dc807b6efb6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.940746:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 12 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.940757:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.940759:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127011.940761:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094504e00, rc 0) 00000100:00100000:3.0:1746127011.940819:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4619:x1830945991921792:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 766us (1118us total) trans 8589938384 rc 0/0 00000100:00100000:3.0:1746127011.940825:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17417 00000100:00100000:0.0:1746127011.972558:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.972640:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991921920 00000100:00100000:3.0:1746127011.972649:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991921920 00000100:00100000:3.0:1746127011.972712:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17418 00000100:00100000:3.0:1746127011.972721:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4621:x1830945991921920:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.972748:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.972768:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094504c00/0x34dc807b6efb6c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54128 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.972829:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972841:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972853:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972865:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972871:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972879:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972948:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972956:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.972961:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127011.973009:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127011.973013:0:13448:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127011.973029:0:13448:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973038:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973045:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973050:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973056:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973061:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094504800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.973064:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973071:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973082:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127011.973085:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.973089:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973094:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb6cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973121:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973126:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973162:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973166:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094505200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127011.973168:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973173:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973180:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009dbe7300) 00010000:00010000:3.0:1746127011.973182:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127011.973184:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973189:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb6d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127011.973219:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094504c00/0x34dc807b6efb6c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.973229:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 7 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127011.973234:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127011.973236:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127011.973238:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505c00, rc 0) 00000100:00100000:3.0:1746127011.973294:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4621:x1830945991921920:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 574us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127011.973299:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17418 00000100:00100000:0.0:1746127011.979256:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.979359:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991922048 00000100:00100000:3.0:1746127011.979369:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991922048 00000100:00100000:3.0:1746127011.979425:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22289 00000100:00100000:3.0:1746127011.979433:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991922048:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127011.979450:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.979469:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094505000/0x34dc807b6efb6e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5412f expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.979523:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994361600:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.979612:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.979943:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.979974:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.980032:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991922176 00000100:00100000:2.0:1746127011.980036:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991922176 00000100:00100000:2.0:1746127011.980056:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991922304 00000100:00100000:2.0:1746127011.980058:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991922304 00000100:00100000:2.0:1746127011.980071:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22290 00000100:00100000:2.0:1746127011.980076:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991922176:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.980084:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.980095:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb6eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54136 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.980150:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994361728:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127011.980184:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127011.980278:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22291 00000100:00100000:1.0:1746127011.980286:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991922304:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127011.980293:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.980301:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6000/0x34dc807b6efb6f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5413d expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.980324:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994361856:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127011.980348:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5600 going to sleep for 11 seconds 00002000:00010000:2.0:1746127011.982958:0:1964:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127009 -> 1746127010 00000100:00100000:2.0:1746127011.982987:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994361728:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.983102:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994361600:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127011.983161:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094505000/0x34dc807b6efb6e4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5412f expref: 15 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.983174:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094505000/0x34dc807b6efb6e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5412f expref: 15 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127011.983193:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505000, rc 0) 00000100:00100000:3.0:1746127011.983236:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991922048:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3803us (3989us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127011.983244:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22289 00010000:00010000:2.0:1746127011.983909:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb6eb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54136 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.983920:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb6eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54136 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.983938:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915be00, rc 0) 00000100:00100000:1.0:1746127011.983955:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994361856:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127011.983962:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2029:x1830945991922176:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3885us (4019us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127011.983968:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22290 00010000:00010000:1.0:1746127011.983973:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6000/0x34dc807b6efb6f2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5413d expref: 13 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.983982:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd6000/0x34dc807b6efb6f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5413d expref: 13 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.984011:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd6000, rc 0) 00000100:00100000:1.0:1746127011.984039:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991922304:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3754us (4063us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127011.984044:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22291 00000100:00100000:2.0:1746127011.987487:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.987514:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.987529:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991922432 00000100:00100000:2.0:1746127011.987530:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991922560 00000100:00100000:2.0:1746127011.987537:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991922560 00000100:00100000:1.0:1746127011.987537:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991922432 00000100:00100000:1.0:1746127011.987577:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22292 00000100:00100000:1.0:1746127011.987583:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991922432:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127011.987599:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127011.987617:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6efb6f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54144 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127011.987668:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994361984:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127011.987760:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127011.988068:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22293 00000100:00100000:2.0:1746127011.988074:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991922560:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127011.988082:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.988092:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb700 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5414b expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127011.988118:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994362112:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.988148:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127011.988168:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991922688 00000100:00100000:3.0:1746127011.988170:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991922688 00000100:00100000:2.0:1746127011.988176:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127011.988188:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22294 00000100:00100000:3.0:1746127011.988193:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991922688:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127011.988199:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127011.988206:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094505800/0x34dc807b6efb707 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54152 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127011.988229:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994362240:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127011.988249:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127011.989189:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127011.989341:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991922944 00000100:00100000:2.0:1746127011.989344:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991922944 00000100:00100000:2.0:1746127011.989374:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17419 00000100:00100000:2.0:1746127011.989378:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4621:x1830945991922944:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127011.989389:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127011.989648:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97a00/0x34dc807b6efb70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54159 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.989746:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.989759:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.989765:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.989770:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.989777:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.989801:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 8 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.989811:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 8 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127011.989820:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362368:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.989886:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 11 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.989894:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 11 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127011.989901:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362496:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.989926:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127011.989934:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 32 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127011.989941:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362624:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.989955:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127011.990262:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994361984:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127011.990286:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994362240:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127011.990287:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6efb6f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54144 expref: 17 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.990297:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7000/0x34dc807b6efb6f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54144 expref: 17 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.990305:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094505800/0x34dc807b6efb707 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54152 expref: 17 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127011.990308:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7000, rc 0) 00010000:00010000:0.0:1746127011.990314:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094505800/0x34dc807b6efb707 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54152 expref: 16 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127011.990330:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505800, rc 0) 00000100:00100000:1.0:1746127011.990337:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991922432:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2753us (2858us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127011.990346:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22292 00000100:00100000:0.0:1746127011.990347:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991922688:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2154us (2200us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127011.990353:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22294 00000100:00100000:2.0:1746127011.991022:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994362112:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127011.991043:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb700 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5414b expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.991052:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb700 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5414b expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127011.991060:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e96000, rc 0) 00000100:00100000:2.0:1746127011.991095:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991922560:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3021us (3579us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127011.991101:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22293 00000100:00100000:2.0:1746127011.995044:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362368:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.995056:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362496:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127011.995063:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362624:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127011.995093:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127011.999273:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.999313:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127011.999355:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127011.999451:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923200 00000100:00100000:2.0:1746127011.999492:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923072 00000100:00100000:2.0:1746127011.999501:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923072 00010000:00010000:2.0:1746127011.999544:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 9 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127011.999546:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923200 00010000:00010000:1.0:1746127011.999562:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 12 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127011.999584:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923328 00000100:00100000:1.0:1746127011.999587:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923328 00000100:00100000:2.0:1746127011.999588:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10480 00000100:00100000:2.0:1746127011.999595:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2026:x1830945991923072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.999596:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 33 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127011.999608:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127011.999610:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10481 00010000:00010000:2.0:1746127011.999614:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 9 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127011.999614:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991923200:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127011.999620:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127011.999623:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 12 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127011.999629:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 9 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746127011.999661:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10482 00000100:00100000:0.0:1746127011.999667:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991923328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127011.999672:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127011.999675:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 33 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127011.999699:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 12 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127011.999719:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505c00/0x34dc807b6efb6dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54128 expref: 9 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127011.999719:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 33 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127011.999731:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009665da00/0x34dc807b6efb65f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540db expref: 33 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127011.999735:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127011.999739:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.999746:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.999751:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127011.999751:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127011.999753:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.999757:0:7246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127011.999760:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127011.999788:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094504e00/0x34dc807b6efb6ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54121 expref: 12 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127011.999791:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2026:x1830945991923072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 197us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127011.999797:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10480 00010000:00010000:1.0:1746127011.999797:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127011.999799:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.999805:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.999812:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127011.999835:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127011.999845:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127011.999852:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127011.999865:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991923328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 198us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127011.999870:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10482 00000004:00200000:2.0:1746127011.999871:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:1.0:1746127011.999919:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991923200:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 305us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127011.999925:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10481 00010000:00010000:2.0:1746127011.999990:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e97a00/0x34dc807b6efb70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.000013:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.000023:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127012.000025:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127012.000028:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e96c00, rc 0) 00000100:00100000:2.0:1746127012.000060:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4621:x1830945991922944:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 10681us (10872us total) trans 8589938385 rc 0/0 00000100:00100000:2.0:1746127012.000066:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17419 00000100:00100000:0.0:1746127012.004898:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.005304:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923456 00000100:00100000:2.0:1746127012.005313:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923456 00000100:00100000:2.0:1746127012.005377:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22295 00000100:00100000:2.0:1746127012.005385:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4623:x1830945991923456:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.005403:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.005423:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54160 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.005455:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 37 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.005463:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.005464:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.005468:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.005500:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 37 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.005511:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 37 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746127012.005599:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.005765:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923584 00000100:00100000:3.0:1746127012.005770:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923584 00000100:00100000:3.0:1746127012.005801:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17420 00000100:00100000:3.0:1746127012.005806:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4621:x1830945991923584:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127012.005819:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.005833:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505800/0x34dc807b6efb72a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54167 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.005917:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.005933:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.005939:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.005954:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.005961:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 9 pid: 7259 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.005972:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362880:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.006066:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.006219:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994362752:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.006257:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.007978:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994362752:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127012.008018:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.008033:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915ac00, rc 0) 00000100:00100000:0.0:1746127012.008069:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4623:x1830945991923456:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2684us (3181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.008078:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22295 00000100:00100000:2.0:1746127012.008187:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.008432:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923712 00000100:00100000:1.0:1746127012.008440:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923712 00010000:00010000:1.0:1746127012.008467:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 10 pid: 7259 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.008490:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10483 00000100:00100000:1.0:1746127012.008496:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2027:x1830945991923712:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127012.008506:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127012.008512:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 10 pid: 7259 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.008519:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 10 pid: 7259 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.008539:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.008543:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127012.008552:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127012.008557:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127012.008571:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127012.008737:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e96c00/0x34dc807b6efb715 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54159 expref: 10 pid: 7259 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.008766:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994362880:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127012.008779:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.008786:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.008791:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:3.0:1746127012.008837:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127012.008841:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127012.008858:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.008885:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505800/0x34dc807b6efb72a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.008895:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.008901:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127012.008904:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127012.008906:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505000, rc 0) 00000100:00100000:3.0:1746127012.008930:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4621:x1830945991923584:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3123us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.008936:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17420 00000100:00100000:1.0:1746127012.009343:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991923712:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 845us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.009351:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10483 00000100:00100000:2.0:1746127012.009694:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.009915:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923840 00000100:00100000:0.0:1746127012.009920:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923840 00002000:00100000:0.0:1746127012.009973:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1064960->1286143) req@ffff8800a2fdbb80 x1830945991923840/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.009982:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdbb80 with x1830945991923840 ext(1064960->1286143) 00010000:00010000:0.0:1746127012.009990:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 38 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127012.010039:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 38 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:0.0:1746127012.010046:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2fdbb80 00000100:00100000:0.0:1746127012.010071:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1991 00000100:00100000:0.0:1746127012.010078:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:2027:x1830945991923840:12345-192.168.203.42@tcp:4:cat.0 00000100:00080000:2.0:1746127012.010233:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746127012.013728:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.013973:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.014028:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.014207:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991923968 00000100:00100000:1.0:1746127012.014217:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991923968 00000100:00100000:1.0:1746127012.014277:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991924096 00000100:00100000:1.0:1746127012.014280:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991924096 00000100:00100000:1.0:1746127012.014312:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991924224 00000100:00100000:1.0:1746127012.014314:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991924224 00000100:00100000:1.0:1746127012.014329:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22296 00000100:00100000:1.0:1746127012.014336:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991923968:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127012.014355:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1746127012.014365:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746127012.014374:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6efb738 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5416e expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.014390:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22297 00000100:00100000:3.0:1746127012.014395:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991924096:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127012.014402:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.014412:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094504e00/0x34dc807b6efb73f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54175 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.014428:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994363008:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127012.014433:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994363136:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127012.014733:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22298 00000100:00100000:2.0:1746127012.014740:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991924224:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127012.014746:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.014754:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009915b200/0x34dc807b6efb746 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5417c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.014778:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994363264:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127012.015272:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.015459:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1746127012.016057:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.017259:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991923840:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7174us (7558us total) trans 17179875718 rc 0/0 00000100:00100000:0.0:1746127012.018329:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1991 00002000:00100000:0.0:1746127012.018343:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1064960->1286143) req@ffff8800a2fdbb80 x1830945991923840/t17179875718(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.018353:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdbb80 with x1830945991923840 ext(1064960->1286143) 00010000:00010000:0.0:1746127012.018364:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 40 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127012.018379:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 40 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:0.0:1746127012.018387:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2fdbb80 00000100:00100000:3.0:1746127012.018964:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994363136:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127012.019003:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094504e00/0x34dc807b6efb73f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54175 expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.019020:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094504e00/0x34dc807b6efb73f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54175 expref: 15 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.019042:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094504e00, rc 0) 00000100:00100000:3.0:1746127012.019079:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991924096:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4684us (5105us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.019085:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22297 00000100:00100000:1.0:1746127012.019542:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994363008:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127012.019560:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6efb738 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5416e expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.019569:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cfd7600/0x34dc807b6efb738 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5416e expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.019589:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cfd7600, rc 0) 00000100:00100000:1.0:1746127012.019610:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991923968:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5274us (5893us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127012.019615:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22296 00000100:00100000:2.0:1746127012.019883:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994363264:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127012.019901:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009915b200/0x34dc807b6efb746 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5417c expref: 13 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.019909:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009915b200/0x34dc807b6efb746 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5417c expref: 13 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.019929:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915b200, rc 0) 00000100:00100000:2.0:1746127012.019954:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991924224:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5215us (5926us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127012.019961:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22298 00000100:00100000:0.0:1746127012.021974:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.022044:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991924352 00000100:00100000:2.0:1746127012.022052:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991924352 00000100:00100000:0.0:1746127012.022079:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.022407:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22299 00000100:00100000:2.0:1746127012.022417:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4619:x1830945991924352:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.022436:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.022456:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54183 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.022485:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.022493:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.022499:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 22 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.022505:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.022506:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.022509:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.022541:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 22 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.022552:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 22 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.022565:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994363392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.022709:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991924480 00000100:00100000:1.0:1746127012.022714:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991924480 00010000:00010000:1.0:1746127012.022738:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 40 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.023239:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 12 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.023248:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 12 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.023256:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994363520:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.023285:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 13 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.023292:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 13 pid: 12333 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746127012.023299:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994363648:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.023315:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.023614:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.023776:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10484 00000100:00100000:1.0:1746127012.023786:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2026:x1830945991924480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127012.023797:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127012.023818:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 40 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.023828:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 40 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.023849:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880076179400/0x34dc807b6efb5fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1286143) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54095 expref: 40 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.023862:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.023864:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.023870:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.023877:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.023904:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 14 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.023912:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994363776:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127012.023939:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.024145:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991924736 00000100:00100000:3.0:1746127012.024150:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991924736 00000100:00100000:3.0:1746127012.024190:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17421 00000100:00100000:3.0:1746127012.024196:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4621:x1830945991924736:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127012.024208:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.024221:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb754 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5418a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.024313:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024326:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024335:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024346:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024351:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024357:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024362:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094505200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127012.024366:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024371:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024378:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127012.024380:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127012.024383:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024387:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505200/0x34dc807b6efb75b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127012.024409:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb754 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5418a expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.024415:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094504800/0x34dc807b6efb754 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5418a expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.024423:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094504800, rc 0) 00000100:00100000:3.0:1746127012.024446:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4621:x1830945991924736:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 250us (833us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.024451:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17421 00000100:00100000:3.0:1746127012.025883:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994363392:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.025894:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994363520:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.025903:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994363648:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127012.025940:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.025955:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009915be00, rc 0) 00000100:00100000:3.0:1746127012.025989:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4619:x1830945991924352:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3574us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.026009:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22299 00000100:00100000:0.0:1746127012.027653:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.027810:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991924864 00000100:00100000:3.0:1746127012.027817:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991924864 00010000:00010000:3.0:1746127012.027849:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 14 pid: 12333 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746127012.027875:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10485 00000100:00100000:3.0:1746127012.027882:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991924864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.027894:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.027916:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 14 pid: 12333 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746127012.027927:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 14 pid: 12333 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746127012.027954:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebe800/0x34dc807b6efb4d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54010 expref: 14 pid: 12333 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746127012.027968:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.028011:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991924864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 128us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.028017:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10485 00000100:00100000:1.0:1746127012.028186:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994363776:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127012.028202:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127012.028271:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991924480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4487us (6191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.028278:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10484 00000100:00100000:0.0:1746127012.030565:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.030601:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.030642:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.030703:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991925376 00000100:00100000:1.0:1746127012.030711:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991925376 00000100:00100000:1.0:1746127012.030761:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6668 00000100:00100000:1.0:1746127012.030769:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4621:x1830945991925376:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1746127012.030958:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4621:x1830945991925376:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 188us (354us total) trans 8589938386 rc 0/0 00000100:00100000:1.0:1746127012.030964:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6668 00000100:00100000:1.0:1746127012.030983:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991925120 00000100:00100000:1.0:1746127012.030986:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991925120 00010000:00010000:1.0:1746127012.031018:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 23 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.031036:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991924992 00000100:00100000:1.0:1746127012.031038:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991924992 00010000:00010000:1.0:1746127012.031047:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 12 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.031061:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10486 00000100:00100000:1.0:1746127012.031065:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991925120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127012.031073:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127012.031088:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 23 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.031097:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 23 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.031116:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efb60b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540a3 expref: 23 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.031147:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127012.031161:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2027:x1830945991925120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 96us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.031167:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10486 00000100:00100000:1.0:1746127012.031175:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10487 00000100:00100000:1.0:1746127012.031179:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991924992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127012.031183:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127012.031188:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 12 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.031195:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 12 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.031210:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efb612 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e540aa expref: 12 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.031218:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.031220:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.031226:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.031233:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.031260:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.031270:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994363904:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127012.031317:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00080000:3.0:1746127012.031576:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746127012.031969:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.032507:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991925632 00000100:00100000:1.0:1746127012.032513:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991925632 00002000:00100000:1.0:1746127012.032550:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012d22c380 x1830945991925632/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.032559:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c380 with x1830945991925632 ext(1048576->2097151) 00002000:00010000:1.0:1746127012.032564:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22c380 00000100:00100000:1.0:1746127012.032594:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8939 00000100:00100000:1.0:1746127012.032599:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991925632:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127012.034215:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123476680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994363904:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127012.034236:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127012.034291:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2028:x1830945991924992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3109us (3646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.034300:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10487 00000100:00100000:0.0:1746127012.036462:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.038605:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991925888 00000100:00100000:3.0:1746127012.038619:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991925888 00002000:00100000:3.0:1746127012.038671:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (2019328->2023423) req@ffff88012d22c000 x1830945991925888/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.038680:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c000 with x1830945991925888 ext(2019328->2023423) 00002000:00010000:3.0:1746127012.038685:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22c000 00000100:00100000:3.0:1746127012.038720:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8940 00000100:00100000:3.0:1746127012.038728:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991925888:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127012.038903:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991925888:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 175us (2448us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127012.038909:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8940 00002000:00100000:3.0:1746127012.038915:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (2019328->2023423) req@ffff88012d22c000 x1830945991925888/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.038922:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c000 with x1830945991925888 ext(2019328->2023423) 00002000:00010000:3.0:1746127012.038925:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22c000 00000100:00100000:1.0:1746127012.043307:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2026:x1830945991925632:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 10695us (11328us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127012.043321:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8939 00002000:00100000:1.0:1746127012.043332:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012d22c380 x1830945991925632/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.043342:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c380 with x1830945991925632 ext(1048576->2097151) 00002000:00010000:1.0:1746127012.043348:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d22c380 00000100:00100000:0.0:1746127012.044065:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.045194:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991926016 00000100:00100000:3.0:1746127012.045206:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991926016 00000100:00100000:3.0:1746127012.045255:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22300 00000100:00100000:3.0:1746127012.045262:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4619:x1830945991926016:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127012.045281:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.045299:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54191 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.045329:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.045337:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127012.045338:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127012.045342:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2564095] (req 2097152->2564095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.045373:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.045384:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 21 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.045395:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994364032:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.045467:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.047610:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994364032:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127012.047642:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->2564095] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.047660:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094504000, rc 0) 00000100:00100000:3.0:1746127012.047704:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4619:x1830945991926016:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2441us (3640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.047712:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22300 00000100:00100000:0.0:1746127012.049344:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.049449:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991926144 00000100:00100000:1.0:1746127012.049458:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991926144 00002000:00100000:1.0:1746127012.049570:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3633152->4194303) req@ffff88012d22c700 x1830945991926144/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.049580:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c700 with x1830945991926144 ext(3633152->4194303) 00010000:00010000:1.0:1746127012.049589:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 22 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.049603:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 22 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.049609:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d22c700 00000100:00100000:1.0:1746127012.049641:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1992 00000100:00100000:1.0:1746127012.049647:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2026:x1830945991926144:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127012.049962:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.050113:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991926400 00000100:00100000:2.0:1746127012.050118:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991926400 00002000:00100000:2.0:1746127012.050164:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2019327) req@ffff88012d22e300 x1830945991926400/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.050171:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22e300 with x1830945991926400 ext(1048576->2019327) 00002000:00010000:2.0:1746127012.050175:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22e300 00000100:00100000:2.0:1746127012.050190:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8941 00000100:00100000:2.0:1746127012.050196:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991926400:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127012.061722:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2026:x1830945991926144:12345-192.168.203.42@tcp:4:cat.0 Request processed in 12063us (12376us total) trans 21474842996 rc 0/0 00000100:00100000:1.0:1746127012.061735:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1992 00002000:00100000:1.0:1746127012.061747:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3633152->4194303) req@ffff88012d22c700 x1830945991926144/t21474842996(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.061762:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22c700 with x1830945991926144 ext(3633152->4194303) 00010000:00010000:1.0:1746127012.061771:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 24 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.061789:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 24 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.061795:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d22c700 00000100:00100000:3.0:1746127012.062318:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991926400:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 12114us (12350us total) trans 0 rc 970752/970752 00000100:00100000:3.0:1746127012.062329:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8941 00002000:00100000:3.0:1746127012.062339:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2019327) req@ffff88012d22e300 x1830945991926400/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 970752/970752 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.062347:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d22e300 with x1830945991926400 ext(1048576->2019327) 00002000:00010000:3.0:1746127012.062352:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d22e300 00000100:00100000:2.0:1746127012.073716:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.075759:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.075785:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991926528 00000100:00100000:0.0:1746127012.075794:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991926528 00000100:00100000:2.0:1746127012.075814:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1746127012.075833:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 24 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746127012.075861:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10488 00000100:00100000:0.0:1746127012.075868:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945991926528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127012.075882:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127012.075905:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 24 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127012.075917:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 24 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127012.075944:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efb689 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54105 expref: 24 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127012.075966:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.075968:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127012.075976:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991926656 00010000:00010000:0.0:1746127012.075976:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.075984:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.075985:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991926656 00000100:00100000:1.0:1746127012.076004:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991926784 00000100:00100000:1.0:1746127012.076009:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991926784 00010000:00010000:0.0:1746127012.076041:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.076050:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22301 00000100:00100000:0.0:1746127012.076054:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c428700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994364160:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127012.076057:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991926656:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127012.076057:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22302 00000100:00100000:1.0:1746127012.076063:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991926784:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127012.076071:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.076074:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.076086:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094505600/0x34dc807b6efb769 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54198 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.076087:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e88e800/0x34dc807b6efb770 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5419f expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.076116:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994364288:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127012.076154:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994364416:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127012.076155:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746127012.076170:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5900 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.076207:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.079691:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c428700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994364160:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.079717:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.079767:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945991926528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3898us (6059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.079778:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10488 00000100:00100000:1.0:1746127012.079912:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880123474000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994364288:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127012.080056:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e88e800/0x34dc807b6efb770 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5419f expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.080069:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e88e800/0x34dc807b6efb770 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5419f expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.080090:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e88e800, rc 0) 00000100:00100000:1.0:1746127012.080150:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991926784:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4064us (4312us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127012.080158:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22302 00000100:00100000:3.0:1746127012.080292:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994364416:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127012.080323:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094505600/0x34dc807b6efb769 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54198 expref: 13 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.080767:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094505600/0x34dc807b6efb769 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54198 expref: 13 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.080793:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505600, rc 0) 00000100:00100000:3.0:1746127012.081568:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2028:x1830945991926656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5510us (5820us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.081577:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22301 00000100:00100000:0.0:1746127012.082861:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.082906:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991927040 00000100:00100000:3.0:1746127012.082912:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991927040 00002000:00100000:3.0:1746127012.082942:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2560000->2564095) req@ffff88009c429880 x1830945991927040/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.082951:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429880 with x1830945991927040 ext(2560000->2564095) 00002000:00010000:3.0:1746127012.082956:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c429880 00000100:00100000:3.0:1746127012.083025:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8942 00000100:00100000:3.0:1746127012.083032:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991927040:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127012.083239:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991927040:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 206us (379us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127012.083244:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8942 00002000:00100000:3.0:1746127012.083249:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2560000->2564095) req@ffff88009c429880 x1830945991927040/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.083255:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429880 with x1830945991927040 ext(2560000->2564095) 00002000:00010000:3.0:1746127012.083258:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c429880 00000100:00100000:0.0:1746127012.087265:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.087319:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.087381:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991927552 00000100:00100000:2.0:1746127012.087390:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991927552 00000100:00100000:3.0:1746127012.087425:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991927296 00000100:00100000:3.0:1746127012.087435:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991927296 00002000:00100000:2.0:1746127012.087444:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2564096->3145727) req@ffff88009c428a80 x1830945991927552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.087453:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428a80 with x1830945991927552 ext(2564096->3145727) 00002000:00010000:2.0:1746127012.087458:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428a80 00000100:00100000:2.0:1746127012.087499:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8943 00000100:00100000:2.0:1746127012.087506:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991927552:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127012.087710:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6669 00000100:00100000:1.0:1746127012.087721:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+11:4619:x1830945991927296:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127012.087916:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4619:x1830945991927296:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 198us (662us total) trans 8589938387 rc 0/0 00000100:00100000:1.0:1746127012.087922:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6669 00000100:00100000:0.0:1746127012.092866:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991927552:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5352us (5538us total) trans 0 rc 581632/581632 00000100:00100000:0.0:1746127012.092878:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8943 00002000:00100000:0.0:1746127012.092887:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2564096->3145727) req@ffff88009c428a80 x1830945991927552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 581632/581632 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.092896:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428a80 with x1830945991927552 ext(2564096->3145727) 00002000:00010000:0.0:1746127012.092900:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428a80 00000100:00100000:0.0:1746127012.094735:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.094844:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991927808 00000100:00100000:1.0:1746127012.094853:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991927808 00000100:00100000:1.0:1746127012.095190:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17422 00000100:00100000:1.0:1746127012.095200:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4626:x1830945991927808:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127012.095225:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.095243:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efb777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541a6 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.095320:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095332:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095342:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095355:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095361:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095366:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095472:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095480:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.095485:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127012.095494:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000100:00100000:0.0:1746127012.095701:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.095789:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991927936 00000100:00100000:2.0:1746127012.095800:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991927936 00000100:00100000:2.0:1746127012.095852:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22303 00000100:00100000:2.0:1746127012.095859:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4623:x1830945991927936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.095875:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.095890:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541ad expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.095919:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 38 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.095925:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.095926:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.095930:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.095954:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 38 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.095964:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 38 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.095975:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994364544:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.096075:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00010000:00010000:1.0:1746127012.096282:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096290:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096296:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096301:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baff800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.096306:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096312:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096323:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127012.096326:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.096331:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096334:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baff800/0x34dc807b6efb77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096415:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096420:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096425:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096429:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.096431:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096436:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096443:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094be0400) 00010000:00010000:1.0:1746127012.096444:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.096447:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096450:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82a00/0x34dc807b6efb785 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.096602:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efb777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 35 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.096619:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 34 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.096625:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.096627:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127012.096629:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b82800, rc 0) 00000100:00100000:1.0:1746127012.096677:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4626:x1830945991927808:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1479us (1951us total) trans 8589938388 rc 0/0 00000100:00100000:1.0:1746127012.096684:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17422 00000100:00100000:0.0:1746127012.100567:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.100570:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994364544:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.100616:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 16 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.100633:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e97000, rc 0) 00000100:00100000:2.0:1746127012.100704:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4623:x1830945991927936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4844us (5002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.100712:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22303 00000100:00100000:1.0:1746127012.101293:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928064 00000100:00100000:1.0:1746127012.101301:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928064 00002000:00100000:1.0:1746127012.101339:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3489791) req@ffff88009c42a680 x1830945991928064/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.101348:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42a680 with x1830945991928064 ext(3145728->3489791) 00010000:00010000:1.0:1746127012.101355:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 39 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.101367:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 39 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.101373:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c42a680 00000100:00100000:1.0:1746127012.101408:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1993 00000100:00100000:1.0:1746127012.101415:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:2026:x1830945991928064:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127012.108768:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2026:x1830945991928064:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7275us (8131us total) trans 17179875719 rc 0/0 00000100:00100000:1.0:1746127012.108786:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1993 00002000:00100000:1.0:1746127012.108799:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3145728->3489791) req@ffff88009c42a680 x1830945991928064/t17179875719(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.108809:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42a680 with x1830945991928064 ext(3145728->3489791) 00010000:00010000:1.0:1746127012.108819:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 41 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.108837:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 41 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.108845:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c42a680 00000100:00100000:0.0:1746127012.113704:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.114225:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928192 00000100:00100000:2.0:1746127012.114236:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928192 00010000:00010000:2.0:1746127012.114277:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 41 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.114323:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10489 00000100:00100000:2.0:1746127012.114331:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991928192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.114347:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.114368:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 41 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.114380:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 41 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.114403:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7200/0x34dc807b6efb69e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5411a expref: 41 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.114438:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.114440:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.114447:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.114454:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.114486:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.114499:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994364672:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.115553:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.120497:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994364672:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.120862:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.120909:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2027:x1830945991928192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6577us (7215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.120921:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10489 00000100:00100000:0.0:1746127012.121107:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.121433:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928320 00000100:00100000:2.0:1746127012.121439:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928320 00000100:00100000:2.0:1746127012.121484:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22304 00000100:00100000:2.0:1746127012.121492:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:4626:x1830945991928320:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.121509:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.121526:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541b4 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.121557:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 12 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.121565:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 11 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.121572:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 24 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.121577:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.121579:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.121582:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [204800->610303] (req 204800->610303) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 24 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.121616:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 24 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.121627:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 24 pid: 11152 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.121640:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994364800:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.121721:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 11 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.121729:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 11 pid: 11152 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.121736:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994364928:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.121760:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 12 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.121768:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 12 pid: 1507 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746127012.121776:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994365056:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.121794:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.123453:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994364800:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.123465:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994364928:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.123472:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994365056:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.123502:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [204800->610303] (req 204800->610303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 24 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.123520:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e96000, rc 0) 00000100:00100000:2.0:1746127012.123567:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4626:x1830945991928320:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2075us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.123575:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22304 00000100:00100000:1.0:1746127012.125830:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.125927:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.126255:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.126361:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.126392:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.126407:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928832 00000100:00100000:1.0:1746127012.126415:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928832 00000100:00100000:3.0:1746127012.126440:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928960 00000100:00100000:3.0:1746127012.126445:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928960 00000100:00100000:1.0:1746127012.126456:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22305 00000100:00100000:1.0:1746127012.126464:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991928832:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:3.0:1746127012.126471:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22306 00000100:00100000:3.0:1746127012.126476:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+40:2028:x1830945991928960:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127012.126484:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.126485:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.126501:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc11400/0x34dc807b6efb7a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541bb expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.126504:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541c2 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.126525:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.126525:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.126526:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.126535:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc11400/0x34dc807b6efb7a8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541bb expref: 25 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.126536:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 41 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.126546:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc11400/0x34dc807b6efb7a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541bb expref: 25 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.126551:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 41 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.126560:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505c00, rc 0) 00010000:00010000:1.0:1746127012.126560:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11400, rc 0) 00000100:00100000:1.0:1746127012.126602:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991928832:12345-192.168.203.42@tcp:101:cat.0 Request processed in 138us (240us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127012.126608:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22305 00000100:00100000:1.0:1746127012.126666:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.126677:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991929088 00000100:00100000:1.0:1746127012.126680:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991929088 00000100:00100000:3.0:1746127012.126691:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2028:x1830945991928960:12345-192.168.203.42@tcp:101:cat.0 Request processed in 213us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.126695:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22307 00000100:00100000:1.0:1746127012.126700:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2028:x1830945991929088:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127012.126786:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928448 00000100:00100000:2.0:1746127012.126790:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928448 00000100:00100000:3.0:1746127012.126812:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22306 00010000:00010000:2.0:1746127012.126812:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 12 pid: 11152 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.126835:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928576 00000100:00100000:2.0:1746127012.126837:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928576 00010000:00010000:2.0:1746127012.126846:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 13 pid: 1507 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746127012.126858:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991928704 00000100:00100000:2.0:1746127012.126860:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991928704 00010000:00010000:2.0:1746127012.126867:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 25 pid: 11152 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.126870:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10490 00000100:00100000:3.0:1746127012.126877:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2029:x1830945991928448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127012.126880:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10491 00000100:00100000:2.0:1746127012.126884:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2029:x1830945991928576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.126886:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.126891:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.126906:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 12 pid: 11152 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746127012.127026:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10492 00000100:00100000:0.0:1746127012.127034:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991928704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127012.127042:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.127276:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 12 pid: 11152 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.127297:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 13 pid: 1507 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.127306:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 13 pid: 1507 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.127320:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c8c00/0x34dc807b6efb4c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e53ffb expref: 13 pid: 1507 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746127012.127346:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 25 pid: 11152 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.127351:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c35c000/0x34dc807b6efb5cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5406b expref: 12 pid: 11152 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127012.127355:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 25 pid: 11152 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.127365:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.127365:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d2c3000/0x34dc807b6efb578 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5403a expref: 25 pid: 11152 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.127367:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.127371:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 25 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.127378:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 24 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.127386:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127012.127400:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127012.127417:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2026:x1830945991928704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 384us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.127423:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10492 00000100:00100000:0.0:1746127012.127476:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.127489:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991929344 00000100:00100000:0.0:1746127012.127492:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991929344 00010000:00010000:3.0:1746127012.127536:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 23 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.127547:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994365184:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.127590:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991928576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 704us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.127594:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.127596:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10491 00010000:00010000:1.0:1746127012.127786:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.127795:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6efb7b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541c9 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.127822:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365312:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127012.127862:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1746127012.127926:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.127982:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991929216 00000100:00100000:3.0:1746127012.127986:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991929216 00000100:00100000:3.0:1746127012.128015:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22308 00000100:00100000:3.0:1746127012.128020:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2029:x1830945991929216:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127012.128027:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.128033:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094505800/0x34dc807b6efb7bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541d0 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.128058:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994365440:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127012.128082:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.128172:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22309 00000100:00100000:0.0:1746127012.128178:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991929344:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.128185:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.128193:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541d7 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.128204:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.128206:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.128210:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 42 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.128220:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 42 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.128233:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ac7e00, rc 0) 00000100:00100000:0.0:1746127012.128251:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991929344:12345-192.168.203.42@tcp:101:cat.0 Request processed in 74us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.128256:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22309 00000100:00100000:0.0:1746127012.128485:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.128509:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991929728 00000100:00100000:0.0:1746127012.128512:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991929728 00002000:00100000:0.0:1746127012.128714:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c429180 x1830945991929728/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.128724:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429180 with x1830945991929728 ext(2097152->4194303) 00002000:00010000:0.0:1746127012.128858:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c429180 00000100:00100000:1.0:1746127012.129569:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8944 00000100:00100000:1.0:1746127012.129578:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991929728:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.130156:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.130293:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991929856 00000100:00100000:2.0:1746127012.130298:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991929856 00002000:00100000:2.0:1746127012.130322:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c428000 x1830945991929856/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.130331:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428000 with x1830945991929856 ext(3145728->4194303) 00002000:00010000:2.0:1746127012.130335:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428000 00000100:00100000:2.0:1746127012.130360:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8945 00000100:00100000:2.0:1746127012.130366:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991929856:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127012.132824:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9611:1830945994365440:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127012.132862:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094505800/0x34dc807b6efb7bd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d0 expref: 26 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.132876:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094505800/0x34dc807b6efb7bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d0 expref: 26 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.132889:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094505800, rc 0) 00000100:00100000:3.0:1746127012.132928:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2029:x1830945991929216:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4906us (5000us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.132936:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22308 00000100:00100000:3.0:1746127012.132975:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994365184:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127012.132984:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.133018:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880123474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2029:x1830945991928448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6141us (7198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.133026:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10490 00002000:00010000:3.0:1746127012.133429:0:1964:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746127009 -> 1746127010 00002000:00010000:3.0:1746127012.133433:0:1964:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127009 -> 1746127010 00002000:00010000:3.0:1746127012.133435:0:1964:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746127009 -> 1746127010 00000100:00100000:3.0:1746127012.133446:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365312:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127012.133470:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6efb7b6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c9 expref: 24 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.133480:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007dc10c00/0x34dc807b6efb7b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c9 expref: 24 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.133487:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc10c00, rc 0) 00000100:00100000:3.0:1746127012.133507:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991929088:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6806us (6841us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.133513:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22307 00000100:00100000:0.0:1746127012.136387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.137190:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991930112 00000100:00100000:3.0:1746127012.137202:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991930112 00002000:00100000:3.0:1746127012.137246:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (204800->208895) req@ffff88009c42b480 x1830945991930112/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.137256:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b480 with x1830945991930112 ext(204800->208895) 00002000:00010000:3.0:1746127012.137261:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42b480 00000100:00100000:3.0:1746127012.137286:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8946 00000100:00100000:3.0:1746127012.137293:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991930112:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127012.140326:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2028:x1830945991930112:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 3019us (3934us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127012.140340:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8946 00002000:00100000:3.0:1746127012.140352:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (204800->208895) req@ffff88009c42b480 x1830945991930112/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.140360:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42b480 with x1830945991930112 ext(204800->208895) 00002000:00010000:3.0:1746127012.140366:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42b480 00000100:00100000:2.0:1746127012.147399:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991929856:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17021us (17231us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127012.147412:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8945 00002000:00100000:2.0:1746127012.147424:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff88009c428000 x1830945991929856/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.147434:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428000 with x1830945991929856 ext(3145728->4194303) 00002000:00010000:2.0:1746127012.147441:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c428000 00000100:00100000:0.0:1746127012.150341:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.150510:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991930496 00000100:00100000:2.0:1746127012.150521:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991930496 00000100:00100000:0.0:1746127012.150561:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:2.0:1746127012.150565:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009c42ad80 x1830945991930496/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 504/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.150576:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42ad80 with x1830945991930496 ext(0->1048575) 00002000:00010000:2.0:1746127012.150582:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42ad80 00000100:00100000:2.0:1746127012.150615:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991930624 00000100:00100000:2.0:1746127012.150617:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991930624 00002000:00100000:2.0:1746127012.150630:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c42aa00 x1830945991930624/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.150637:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42aa00 with x1830945991930624 ext(1048576->2097151) 00002000:00010000:2.0:1746127012.150640:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c42aa00 00000100:00100000:1.0:1746127012.150643:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8947 00000100:00100000:1.0:1746127012.150659:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991930496:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.150724:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991929728:12345-192.168.203.42@tcp:3:cat.0 Request processed in 21147us (22238us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746127012.150943:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8944 00002000:00100000:0.0:1746127012.150954:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009c429180 x1830945991929728/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127012.150955:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8948 00000100:00100000:2.0:1746127012.150962:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991930624:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:0.0:1746127012.150963:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429180 with x1830945991929728 ext(2097152->4194303) 00002000:00010000:0.0:1746127012.150968:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c429180 00000100:00100000:1.0:1746127012.165252:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945991930496:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14589us (14906us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746127012.165267:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8947 00002000:00100000:1.0:1746127012.165279:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009c42ad80 x1830945991930496/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 504/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.165287:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42ad80 with x1830945991930496 ext(0->1048575) 00002000:00010000:1.0:1746127012.165293:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c42ad80 00000100:00100000:2.0:1746127012.165976:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.166057:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991930752 00000100:00100000:0.0:1746127012.166065:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991930752 00000100:00100000:0.0:1746127012.166108:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22310 00000100:00100000:0.0:1746127012.166114:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991930752:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.166146:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.166164:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efb7cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541de expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127012.166218:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c429c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365568:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127012.166296:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.166878:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991930624:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15915us (16315us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127012.166887:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8948 00002000:00100000:2.0:1746127012.166895:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009c42aa00 x1830945991930624/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.166904:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c42aa00 with x1830945991930624 ext(1048576->2097151) 00002000:00010000:2.0:1746127012.166907:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c42aa00 00002000:00010000:2.0:1746127012.172012:0:1964:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746127009 -> 1746127010 00002000:00010000:2.0:1746127012.172020:0:1964:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127009 -> 1746127010 00002000:00010000:2.0:1746127012.172022:0:1964:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746127009 -> 1746127010 00000100:00100000:2.0:1746127012.172054:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c429c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365568:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127012.172090:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efb7cb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541de expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.172104:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efb7cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541de expref: 12 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.172153:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc400, rc 0) 00000100:00100000:2.0:1746127012.172214:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2027:x1830945991930752:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6099us (6239us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127012.172222:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22310 00000100:00100000:0.0:1746127012.182280:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.182406:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991931008 00000100:00100000:2.0:1746127012.182416:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991931008 00002000:00100000:2.0:1746127012.182464:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009c429c00 x1830945991931008/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.182476:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429c00 with x1830945991931008 ext(4194304->4829183) 00002000:00010000:2.0:1746127012.182481:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c429c00 00000100:00100000:2.0:1746127012.182512:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8949 00000100:00100000:2.0:1746127012.182518:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991931008:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.183227:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.183302:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991931264 00000100:00100000:3.0:1746127012.183307:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991931264 00000100:00100000:3.0:1746127012.183351:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6670 00000100:00100000:3.0:1746127012.183358:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:4626:x1830945991931264:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127012.183557:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4626:x1830945991931264:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 199us (330us total) trans 8589938389 rc 0/0 00000100:00100000:3.0:1746127012.183565:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6670 00000100:00100000:0.0:1746127012.187364:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.187668:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991931392 00000100:00100000:2.0:1746127012.187677:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991931392 00000100:00100000:2.0:1746127012.187724:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22311 00000100:00100000:2.0:1746127012.187732:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:4630:x1830945991931392:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.187750:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.187768:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541e5 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.187797:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.187804:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.187806:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.187809:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 24 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.187839:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 12 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.187851:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 12 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.187863:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365696:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.188938:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991931008:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6414us (6665us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127012.188949:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8949 00002000:00100000:3.0:1746127012.188960:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009c429c00 x1830945991931008/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.188969:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c429c00 with x1830945991931008 ext(4194304->4829183) 00002000:00010000:3.0:1746127012.188974:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c429c00 00000100:00100000:2.0:1746127012.189079:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.191279:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365696:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.191396:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 24 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.191827:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bff200, rc 0) 00000100:00100000:2.0:1746127012.191889:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4630:x1830945991931392:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4157us (4534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.191897:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22311 00000100:00100000:0.0:1746127012.192233:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.192422:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.192516:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991931520 00000100:00100000:3.0:1746127012.192522:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991931520 00002000:00100000:3.0:1746127012.192557:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (2019328->2097151) req@ffff88009c428e00 x1830945991931520/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.192566:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428e00 with x1830945991931520 ext(2019328->2097151) 00010000:00010000:3.0:1746127012.192572:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 11 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.192582:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 11 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.192589:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c428e00 00000100:00100000:3.0:1746127012.192604:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1994 00000100:00100000:3.0:1746127012.192609:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+11:2026:x1830945991931520:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127012.192684:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.192703:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991931648 00000100:00100000:0.0:1746127012.192705:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991931648 00000100:00100000:0.0:1746127012.192780:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991931776 00000100:00100000:0.0:1746127012.192782:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991931776 00000100:00100000:2.0:1746127012.192807:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22312 00000100:00100000:2.0:1746127012.192813:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991931648:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.192820:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.192834:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bffc00/0x34dc807b6efb7d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541ec expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.192874:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365824:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127012.192923:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.192943:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22313 00000100:00100000:2.0:1746127012.192948:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991931776:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.192954:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.192960:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb7e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541f3 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.192978:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994365952:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127012.193008:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.195537:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994365824:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127012.195537:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994365952:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127012.195567:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bffc00/0x34dc807b6efb7d9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ec expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.195572:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb7e0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541f3 expref: 16 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.195580:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bffc00/0x34dc807b6efb7d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ec expref: 16 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.195582:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb7e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541f3 expref: 16 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.195601:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfec00, rc 0) 00010000:00010000:3.0:1746127012.195602:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bffc00, rc 0) 00000100:00100000:3.0:1746127012.195647:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991931648:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2833us (3224us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127012.195649:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2029:x1830945991931776:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2700us (2964us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.195654:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22312 00000100:00100000:2.0:1746127012.195658:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22313 00000100:00100000:3.0:1746127012.196693:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2026:x1830945991931520:12345-192.168.203.42@tcp:4:cat.0 Request processed in 4081us (4459us total) trans 21474842997 rc 0/0 00000100:00100000:3.0:1746127012.196701:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1994 00002000:00100000:3.0:1746127012.196710:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (2019328->2097151) req@ffff88009c428e00 x1830945991931520/t21474842997(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.196719:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c428e00 with x1830945991931520 ext(2019328->2097151) 00010000:00010000:3.0:1746127012.196727:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 13 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.196741:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 13 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.196748:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c428e00 00000100:00100000:0.0:1746127012.204447:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.204503:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.204574:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991932032 00000100:00100000:2.0:1746127012.204584:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991932032 00000100:00100000:3.0:1746127012.204594:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991931904 00000100:00100000:3.0:1746127012.204598:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991931904 00000100:00100000:3.0:1746127012.204627:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22314 00000100:00100000:3.0:1746127012.204633:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991931904:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:2.0:1746127012.204648:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22315 00010000:00010000:3.0:1746127012.204653:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127012.204655:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991932032:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.204662:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.204674:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6efb7e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e541fa expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.204674:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bfe200/0x34dc807b6efb7ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54201 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.204729:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994366080:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127012.204729:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994366208:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127012.204989:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.205002:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.208351:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.208448:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991932160 00000100:00100000:3.0:1746127012.208457:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991932160 00010000:00010000:3.0:1746127012.208494:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.208519:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10493 00000100:00100000:3.0:1746127012.208525:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991932160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.208539:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.208560:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.208572:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.208600:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.208602:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.208610:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.208619:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.208655:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.208671:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994366336:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127012.209808:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00010000:00010000:2.0:1746127012.209931:0:12340:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff8800a2fda680 x1830945994366208) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.209953:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009915be00/0x34dc807b6efb74d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54183 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.209968:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994366208:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127012.210009:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bfe200/0x34dc807b6efb7ee lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54201 expref: 16 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.210020:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bfe200/0x34dc807b6efb7ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54201 expref: 16 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.210032:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfe200, rc 0) 00000100:00100000:3.0:1746127012.211408:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994366080:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127012.211434:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6efb7e7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541fa expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.211445:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094504800/0x34dc807b6efb7e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541fa expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.211463:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094504800, rc 0) 00000100:00100000:3.0:1746127012.211483:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2028:x1830945991931904:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6850us (6979us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.211490:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22314 00000100:00100000:2.0:1746127012.211789:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2028:x1830945991932032:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6473us (6691us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127012.211796:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22315 00000100:00100000:0.0:1746127012.215525:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.215611:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994366336:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.215619:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991932416 00000100:00100000:2.0:1746127012.215627:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991932416 00010000:00010000:3.0:1746127012.215633:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746127012.215674:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a77b80 x1830945991932416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746127012.215677:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991932160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7151us (7335us total) trans 0 rc 0/0 00002000:00100000:2.0:1746127012.215684:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77b80 with x1830945991932416 ext(1048576->2097151) 00000100:00100000:3.0:1746127012.215688:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10493 00002000:00010000:2.0:1746127012.215689:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a77b80 00000100:00100000:2.0:1746127012.215716:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8950 00000100:00100000:2.0:1746127012.215724:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945991932416:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127012.225454:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945991932416:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9722us (9930us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127012.225466:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8950 00002000:00100000:2.0:1746127012.225477:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff880130a77b80 x1830945991932416/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.225485:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77b80 with x1830945991932416 ext(1048576->2097151) 00002000:00010000:2.0:1746127012.225490:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a77b80 00000100:00100000:0.0:1746127012.230654:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.230845:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991932544 00000100:00100000:2.0:1746127012.230854:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991932544 00000100:00100000:2.0:1746127012.230901:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22316 00000100:00100000:2.0:1746127012.230908:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4630:x1830945991932544:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.230926:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.230941:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54208 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.230965:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.230973:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.230974:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.230977:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.231016:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 11 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.231028:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 11 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.231037:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994366464:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.231114:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.239029:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994366464:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.239057:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 25 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.239072:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bff600, rc 0) 00000100:00100000:2.0:1746127012.239156:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:4630:x1830945991932544:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8247us (8508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.239165:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22316 00000100:00100000:0.0:1746127012.241452:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.241507:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991932672 00000100:00100000:2.0:1746127012.241515:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991932672 00002000:00100000:2.0:1746127012.241550:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2564095) req@ffff880130a77100 x1830945991932672/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.243163:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77100 with x1830945991932672 ext(2097152->2564095) 00010000:00010000:2.0:1746127012.243177:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 12 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.243191:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 12 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746127012.243198:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a77100 00000100:00100000:2.0:1746127012.243234:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1995 00000100:00100000:2.0:1746127012.243243:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+12:2026:x1830945991932672:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127012.253033:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2026:x1830945991932672:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9784us (11579us total) trans 21474842998 rc 0/0 00000100:00100000:2.0:1746127012.253044:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1995 00002000:00100000:2.0:1746127012.253054:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2564095) req@ffff880130a77100 x1830945991932672/t21474842998(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.253063:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a77100 with x1830945991932672 ext(2097152->2564095) 00010000:00010000:2.0:1746127012.253070:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 14 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.253088:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 14 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746127012.253094:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a77100 00000100:00100000:0.0:1746127012.258732:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.259054:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991932800 00000100:00100000:3.0:1746127012.259068:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991932800 00010000:00010000:3.0:1746127012.259114:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 14 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.259621:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10494 00000100:00100000:3.0:1746127012.259631:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991932800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.259647:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.259668:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 14 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.259681:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 14 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.259705:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094504000/0x34dc807b6efb762 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54191 expref: 14 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.259732:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.259734:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.259742:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.259750:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.259784:0:26073:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.259794:0:26073:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994366592:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127012.259884:0:26073:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.263541:0:26073:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:26073:1830945994366592:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127012.263562:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.263613:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991932800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3982us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.263622:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10494 00000100:00100000:0.0:1746127012.269311:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.269364:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.269708:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991933184 00000100:00100000:2.0:1746127012.269718:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991933184 00000100:00100000:1.0:1746127012.269768:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991933312 00002000:00100000:2.0:1746127012.269769:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880130a75c00 x1830945991933184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127012.269779:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991933312 00002000:00100000:2.0:1746127012.269780:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75c00 with x1830945991933184 ext(2097152->4194303) 00002000:00010000:2.0:1746127012.269786:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75c00 00002000:00100000:1.0:1746127012.269818:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880130a76a00 x1830945991933312/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127012.269824:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8951 00002000:00100000:1.0:1746127012.269828:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76a00 with x1830945991933312 ext(2097152->4194303) 00000100:00100000:2.0:1746127012.269831:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991933184:12345-192.168.203.42@tcp:3:cat.0 00002000:00010000:1.0:1746127012.269833:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a76a00 00000100:00100000:1.0:1746127012.269859:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8952 00000100:00100000:1.0:1746127012.269866:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991933312:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127012.296380:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991933184:12345-192.168.203.42@tcp:3:cat.0 Request processed in 26536us (27067us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127012.296394:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8951 00002000:00100000:2.0:1746127012.296406:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880130a75c00 x1830945991933184/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.296416:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75c00 with x1830945991933184 ext(2097152->4194303) 00002000:00010000:2.0:1746127012.296422:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75c00 00000100:00100000:1.0:1746127012.297800:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991933312:12345-192.168.203.42@tcp:3:cat.0 Request processed in 27821us (28321us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127012.297810:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8952 00002000:00100000:1.0:1746127012.297818:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff880130a76a00 x1830945991933312/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.297826:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76a00 with x1830945991933312 ext(2097152->4194303) 00002000:00010000:1.0:1746127012.297831:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a76a00 00000100:00100000:0.0:1746127012.314620:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.314739:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991933568 00000100:00100000:1.0:1746127012.314750:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991933568 00002000:00100000:1.0:1746127012.314803:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880130a75880 x1830945991933568/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.314813:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75880 with x1830945991933568 ext(4194304->4829183) 00002000:00010000:1.0:1746127012.314819:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a75880 00000100:00100000:1.0:1746127012.316027:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8953 00000100:00100000:1.0:1746127012.316047:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991933568:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.321860:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.322169:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991933824 00000100:00100000:1.0:1746127012.322178:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991933824 00000100:00100000:1.0:1746127012.322407:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17423 00000100:00100000:1.0:1746127012.322420:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+12:4634:x1830945991933824:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127012.322446:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.322463:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb7fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5420f expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.322536:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.322548:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.322557:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.322570:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.322574:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.322582:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323042:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323052:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323058:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127012.323067:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127012.323157:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323163:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323169:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323174:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be42000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.323177:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323538:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323550:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127012.323553:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.323557:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323565:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323581:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323585:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323590:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323594:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be42600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.323597:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323601:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323607:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b41ee200) 00010000:00010000:1.0:1746127012.323608:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.323610:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323614:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42600/0x34dc807b6efb80a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.323651:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb7fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.323660:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 14 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.323670:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.323672:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127012.323674:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be43800, rc 0) 00000100:00100000:1.0:1746127012.323725:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+14:4634:x1830945991933824:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1307us (1876us total) trans 8589938390 rc 0/0 00000100:00100000:1.0:1746127012.323731:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17423 00000100:00100000:1.0:1746127012.324923:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991933568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8876us (10310us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127012.324934:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8953 00002000:00100000:1.0:1746127012.324944:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880130a75880 x1830945991933568/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.324953:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75880 with x1830945991933568 ext(4194304->4829183) 00002000:00010000:1.0:1746127012.324959:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130a75880 00000100:00100000:0.0:1746127012.335550:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.335596:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991934080 00000100:00100000:1.0:1746127012.335607:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991934080 00000100:00100000:1.0:1746127012.335923:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17424 00000100:00100000:1.0:1746127012.335932:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:4636:x1830945991934080:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127012.335955:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.335972:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb81f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54216 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.336077:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.336091:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.336098:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.336104:0:13448:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.336110:0:13448:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.336164:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 13 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.336175:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 13 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.336185:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994366720:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127012.336279:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.336286:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 36 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.336292:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994366848:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127012.336311:0:13448:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.336317:0:13448:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 8 pid: 7259 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.336324:0:13448:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994366976:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.336336:0:13448:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008cff2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.340960:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.341098:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991934208 00000100:00100000:3.0:1746127012.341106:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991934208 00000100:00100000:1.0:1746127012.341118:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994366720:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.341163:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994366848:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.341174:0:13448:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13448:1830945994366976:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127012.341203:0:13448:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127012.341613:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 14 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746127012.341626:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.342844:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.342944:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991934336 00000100:00100000:0.0:1746127012.342950:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991934336 00010000:00010000:0.0:1746127012.342974:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 37 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746127012.343025:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10495 00000100:00100000:0.0:1746127012.343033:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+14:2027:x1830945991934208:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127012.343047:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127012.343053:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10496 00010000:00010000:0.0:1746127012.343054:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 14 pid: 13448 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.343062:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+37:2026:x1830945991934336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127012.343065:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 14 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.343070:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127012.343076:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 37 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746127012.343088:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43800/0x34dc807b6efb811 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5420f expref: 14 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.343095:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 37 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.343108:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b82800/0x34dc807b6efb78c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541a6 expref: 37 pid: 13448 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.343125:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.343142:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.343151:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.343157:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127012.343167:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127012.343171:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.343178:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.343182:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127012.343199:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2026:x1830945991934336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.343203:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+13:2027:x1830945991934208:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 171us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.343206:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10496 00000100:00100000:0.0:1746127012.343210:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10495 00000100:00100000:3.0:1746127012.343581:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991934464 00000100:00100000:3.0:1746127012.343586:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991934464 00010000:00010000:3.0:1746127012.343606:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 9 pid: 7259 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.343637:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10497 00000100:00100000:3.0:1746127012.343642:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2027:x1830945991934464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.343651:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.343654:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 9 pid: 7259 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.343662:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 9 pid: 7259 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.343674:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094505000/0x34dc807b6efb731 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54167 expref: 9 pid: 7259 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.343686:0:26073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127012.343689:0:26073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127012.343696:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127012.343703:0:26073:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127012.343721:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.343742:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2027:x1830945991934464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.343748:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10497 00010000:00010000:1.0:1746127012.343831:0:13448:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.343838:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127012.343856:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127012.343975:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x34dc807b6efb81f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 37 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.343988:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 36 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.344005:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.344008:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746127012.344010:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450dc00, rc 0) 00000100:00100000:1.0:1746127012.344040:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4636:x1830945991934080:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8110us (8500us total) trans 8589938391 rc 0/0 00000100:00100000:1.0:1746127012.344046:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17424 00000100:00100000:0.0:1746127012.351299:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.351359:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991934592 00000100:00100000:2.0:1746127012.351368:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991934592 00000100:00100000:2.0:1746127012.351424:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22317 00000100:00100000:2.0:1746127012.351432:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4636:x1830945991934592:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.351453:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.351470:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5421d expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.351501:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.351510:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 43 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.351515:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.351517:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.351520:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1748992->1933311] (req 1748992->1933311) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 43 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.351550:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 43 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.351561:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 43 pid: 1507 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746127012.351572:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994367104:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.351685:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.351694:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 15 pid: 1964 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.351706:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994367232:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.351725:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.359255:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.359285:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994367104:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127012.359295:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.359296:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994367232:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.359329:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1748992->1933311] (req 1748992->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 43 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.359348:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfe800, rc 0) 00000100:00100000:2.0:1746127012.359399:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4636:x1830945991934592:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 7968us (8114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.359409:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22317 00000100:00100000:1.0:1746127012.359738:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991934720 00000100:00100000:1.0:1746127012.359744:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991934720 00010000:00010000:1.0:1746127012.359771:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 16 pid: 1964 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.359808:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991934848 00000100:00100000:1.0:1746127012.359811:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991934848 00010000:00010000:1.0:1746127012.359821:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 43 pid: 1507 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746127012.359845:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10498 00000100:00100000:1.0:1746127012.359852:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991934720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127012.359864:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127012.359870:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10499 00000100:00100000:2.0:1746127012.359875:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991934848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.359881:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127012.359883:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 16 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.359887:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 43 pid: 1507 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746127012.359893:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 16 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.360093:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 43 pid: 1507 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746127012.360116:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009915ac00/0x34dc807b6efb723 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54160 expref: 16 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.360119:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094505c00/0x34dc807b6efb7af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541c2 expref: 43 pid: 1507 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.360153:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.360155:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.360162:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.360170:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.360379:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127012.360442:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 42 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.360454:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994367360:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127012.360504:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2028:x1830945991934720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 651us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.360510:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10498 00000100:00100000:2.0:1746127012.360687:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.362167:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994367360:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.362183:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.362219:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991934848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2343us (2922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.362227:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10499 00000100:00100000:0.0:1746127012.363323:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.363384:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991935104 00000100:00100000:1.0:1746127012.363392:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991935104 00002000:00100000:1.0:1746127012.363433:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1748992->1753087) req@ffff880130a75f80 x1830945991935104/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.363448:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75f80 with x1830945991935104 ext(1748992->1753087) 00002000:00010000:1.0:1746127012.363454:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75f80 00000100:00100000:1.0:1746127012.363485:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8954 00000100:00100000:1.0:1746127012.363492:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991935104:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127012.363626:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991935104:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 134us (307us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127012.363631:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8954 00002000:00100000:1.0:1746127012.363636:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1748992->1753087) req@ffff880130a75f80 x1830945991935104/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.363643:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75f80 with x1830945991935104 ext(1748992->1753087) 00002000:00010000:1.0:1746127012.363646:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a75f80 00000100:00100000:0.0:1746127012.368628:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.368780:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991935360 00000100:00100000:1.0:1746127012.368790:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991935360 00002000:00100000:1.0:1746127012.368841:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1929216->1933311) req@ffff880130a76300 x1830945991935360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.368851:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76300 with x1830945991935360 ext(1929216->1933311) 00002000:00010000:1.0:1746127012.368858:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a76300 00000100:00100000:1.0:1746127012.368900:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8955 00000100:00100000:1.0:1746127012.368908:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991935360:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127012.369082:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991935360:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 174us (467us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127012.369089:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8955 00002000:00100000:1.0:1746127012.369095:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1929216->1933311) req@ffff880130a76300 x1830945991935360/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.369102:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a76300 with x1830945991935360 ext(1929216->1933311) 00002000:00010000:1.0:1746127012.369105:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130a76300 00000100:00100000:0.0:1746127012.437260:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.437374:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991935488 00000100:00100000:2.0:1746127012.437383:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991935488 00000100:00100000:2.0:1746127012.437987:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22318 00000100:00100000:2.0:1746127012.438005:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4634:x1830945991935488:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.438025:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.438043:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54224 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.439363:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 41 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.439374:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.439376:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.439380:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1626112->2097151] (req 1626112->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 16 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.439415:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 41 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.439428:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 41 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.439442:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994367488:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127012.440515:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.440985:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.440985:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991935744 00000100:00100000:0.0:1746127012.441000:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991935744 00000100:00100000:1.0:1746127012.441086:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17425 00000100:00100000:1.0:1746127012.441093:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+13:4641:x1830945991935744:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127012.441112:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.441127:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42200/0x34dc807b6efb842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5422b expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.441402:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441413:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441423:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441434:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441439:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441445:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441532:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441539:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441545:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127012.441554:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127012.441616:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441622:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441628:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441633:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be42000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.441637:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441643:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441652:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127012.441655:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.441659:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441663:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42000/0x34dc807b6efb849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441688:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441693:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441701:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441704:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be43000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.441706:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441710:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441715:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b41ee100) 00010000:00010000:1.0:1746127012.441717:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.441719:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441724:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be43000/0x34dc807b6efb850 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.441756:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42200/0x34dc807b6efb842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 16 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.441765:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 15 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.441770:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.441771:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127012.441773:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be42e00, rc 0) 00000100:00100000:1.0:1746127012.441822:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4641:x1830945991935744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 728us (1308us total) trans 8589938392 rc 0/0 00000100:00100000:1.0:1746127012.441828:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17425 00000100:00100000:2.0:1746127012.442010:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994367488:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.442031:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1626112->2097151] (req 1626112->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 16 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.442042:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfee00, rc 0) 00000100:00100000:2.0:1746127012.442067:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4634:x1830945991935488:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4063us (4818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.442073:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22318 00000100:00100000:0.0:1746127012.443411:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.443881:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991935872 00000100:00100000:1.0:1746127012.443888:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991935872 00002000:00100000:1.0:1746127012.443928:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1748992->1933311) req@ffff88012ced5880 x1830945991935872/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.443938:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5880 with x1830945991935872 ext(1748992->1933311) 00010000:00010000:1.0:1746127012.443945:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 42 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.443958:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 42 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.443965:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ced5880 00000100:00100000:1.0:1746127012.444000:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1996 00000100:00100000:1.0:1746127012.444007:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991935872:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127012.444050:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.444163:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991936128 00000100:00100000:3.0:1746127012.444168:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991936128 00000100:00100000:3.0:1746127012.444194:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6671 00000100:00100000:3.0:1746127012.444199:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4641:x1830945991936128:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127012.444331:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4641:x1830945991936128:12345-192.168.203.42@tcp:35:cat.0 Request processed in 131us (281us total) trans 8589938393 rc 0/0 00000100:00100000:3.0:1746127012.444351:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6671 00000100:00100000:2.0:1746127012.446872:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.446909:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.446928:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.446954:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.446984:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991936384 00000100:00100000:2.0:1746127012.447002:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991936384 00000100:00100000:1.0:1746127012.447004:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991936640 00000100:00100000:1.0:1746127012.447008:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991936640 00000100:00100000:0.0:1746127012.447343:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991936256 00000100:00100000:0.0:1746127012.447347:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991936256 00000100:00100000:3.0:1746127012.447763:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991936512 00000100:00100000:3.0:1746127012.447770:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991936512 00000100:00100000:1.0:1746127012.448044:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22319 00000100:00100000:1.0:1746127012.448053:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991936384:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127012.448071:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.448089:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450c800/0x34dc807b6efb865 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54239 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127012.448240:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22320 00000100:00100000:0.0:1746127012.448246:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991936640:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.448254:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.448264:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54247 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.448277:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.448279:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.448287:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 16 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.448302:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 16 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.448317:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096658800, rc 0) 00000100:00100000:0.0:1746127012.448360:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991936640:12345-192.168.203.42@tcp:101:cat.0 Request processed in 114us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.448366:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22320 00000100:00100000:0.0:1746127012.448381:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22321 00000100:00100000:0.0:1746127012.448386:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991936256:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.448392:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.448399:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efb873 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54232 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127012.448428:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ced6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994367616:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127012.448472:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c30d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746127012.448713:0:9611:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994367744:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127012.448740:0:9611:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073300 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.449253:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22322 00000100:00100000:3.0:1746127012.449260:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991936512:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127012.449268:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.449277:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54240 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.449291:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.449293:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.449298:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 17 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.449312:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 17 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.449320:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b9e600, rc 0) 00000100:00100000:3.0:1746127012.449340:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991936512:12345-192.168.203.42@tcp:101:cat.0 Request processed in 81us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.449344:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22322 00000100:00100000:1.0:1746127012.451097:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991935872:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 7084us (7681us total) trans 17179875720 rc 0/0 00000100:00100000:1.0:1746127012.451112:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1996 00002000:00100000:1.0:1746127012.451121:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1748992->1933311) req@ffff88012ced5880 x1830945991935872/t17179875720(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.451156:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5880 with x1830945991935872 ext(1748992->1933311) 00010000:00010000:1.0:1746127012.451164:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 44 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.451177:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 44 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.451184:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ced5880 00002000:00010000:2.0:1746127012.451481:0:9611:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127010 -> 1746127011 00002000:00010000:2.0:1746127012.451485:0:9611:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127010 -> 1746127011 00000100:00100000:2.0:1746127012.451498:0:9611:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9611:1830945994367744:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127012.451523:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450c800/0x34dc807b6efb865 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54239 expref: 17 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.451533:0:9611:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450c800/0x34dc807b6efb865 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54239 expref: 17 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.451545:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450c800, rc 0) 00000100:00100000:2.0:1746127012.451564:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991936384:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3513us (4699us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127012.451569:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22319 00002000:00010000:0.0:1746127012.451791:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746127010 -> 1746127011 00002000:00010000:0.0:1746127012.451794:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746127010 -> 1746127011 00000100:00100000:0.0:1746127012.451806:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ced6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994367616:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127012.451824:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efb873 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54232 expref: 16 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.451832:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800994bc400/0x34dc807b6efb873 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54232 expref: 16 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.451844:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800994bc400, rc 0) 00000100:00100000:0.0:1746127012.452083:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991936256:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3695us (5152us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127012.452091:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22321 00000100:00100000:0.0:1746127012.455259:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.455343:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991936768 00000100:00100000:2.0:1746127012.455352:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991936768 00010000:00010000:2.0:1746127012.455391:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 44 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.455872:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10500 00000100:00100000:2.0:1746127012.455881:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991936768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.455898:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.455920:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 44 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.455933:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 44 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.455957:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bfe800/0x34dc807b6efb834 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->1933311) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5421d expref: 44 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.455970:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.455972:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.455980:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.455987:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.456031:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.456042:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994367872:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.456122:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.456354:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.456813:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991936896 00000100:00100000:1.0:1746127012.456818:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991936896 00000100:00100000:1.0:1746127012.456853:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22323 00000100:00100000:1.0:1746127012.456859:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4641:x1830945991936896:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127012.456877:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.456891:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5424e expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.456912:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 24 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.456918:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127012.456928:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127012.456932:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 16 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.456967:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 24 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.456977:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 24 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.456985:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994368000:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.457027:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.459753:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.459884:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994367872:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.459906:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127012.459914:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.459947:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991936768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4066us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.459957:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10500 00000100:00100000:1.0:1746127012.460057:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994368000:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127012.460081:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 16 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.460096:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be42200, rc 0) 00000100:00100000:3.0:1746127012.460266:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991937152 00000100:00100000:3.0:1746127012.460276:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991937152 00002000:00100000:3.0:1746127012.460322:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1626112->1630207) req@ffff88012ced4000 x1830945991937152/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.460335:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4000 with x1830945991937152 ext(1626112->1630207) 00002000:00010000:3.0:1746127012.460339:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4000 00000100:00100000:3.0:1746127012.460363:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991937280 00000100:00100000:3.0:1746127012.460366:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991937280 00002000:00100000:3.0:1746127012.460384:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (204800->610303) req@ffff88012ced4e00 x1830945991937280/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.460391:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4e00 with x1830945991937280 ext(204800->610303) 00010000:00010000:3.0:1746127012.460396:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 25 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.460408:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 25 pid: 1507 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.460414:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ced4e00 00000100:00100000:3.0:1746127012.460435:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1997 00000100:00100000:3.0:1746127012.460507:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991937280:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:0.0:1746127012.460581:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8956 00000100:00100000:0.0:1746127012.460588:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991937152:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.460696:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991937152:12345-192.168.203.42@tcp:3:cat.0 Request processed in 109us (952us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127012.460701:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8956 00002000:00100000:0.0:1746127012.460705:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1626112->1630207) req@ffff88012ced4000 x1830945991937152/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.460711:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4000 with x1830945991937152 ext(1626112->1630207) 00002000:00010000:0.0:1746127012.460714:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4000 00000100:00100000:1.0:1746127012.460864:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4641:x1830945991936896:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4003us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.460870:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22323 00000100:00100000:2.0:1746127012.467619:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.467696:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991937408 00000100:00100000:1.0:1746127012.467704:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991937408 00000100:00100000:1.0:1746127012.467746:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22324 00000100:00100000:1.0:1746127012.467754:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4634:x1830945991937408:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127012.467772:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.467791:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54255 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.467819:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 11 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.467828:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.467835:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 42 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.467842:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.467843:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.467846:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1425407] (req 1048576->1425407) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.467875:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 42 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.467887:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 42 pid: 9611 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.467899:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368128:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127012.469205:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.469219:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 17 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.469229:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368256:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.469266:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991937280:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8762us (9350us total) trans 21474842999 rc 0/0 00000100:00100000:3.0:1746127012.469276:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1997 00010000:00010000:1.0:1746127012.469279:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 11 pid: 12333 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746127012.469286:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (204800->610303) req@ffff88012ced4e00 x1830945991937280/t21474842999(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746127012.469286:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 11 pid: 12333 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746127012.469293:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368384:192.168.203.42@tcp:104: 00002000:00100000:3.0:1746127012.469295:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4e00 with x1830945991937280 ext(204800->610303) 00010000:00010000:3.0:1746127012.469303:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 27 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.469310:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d073300 going to sleep for 11 seconds 00010000:00010000:3.0:1746127012.469313:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 27 pid: 1507 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.469319:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ced4e00 00000100:00100000:1.0:1746127012.470730:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368128:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.471586:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368256:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.471785:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368384:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127012.471821:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [1048576->1425407] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 17 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.471837:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450ce00, rc 0) 00000100:00100000:1.0:1746127012.471888:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4634:x1830945991937408:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4134us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.471896:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22324 00000100:00100000:0.0:1746127012.472072:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.472157:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.472175:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.472380:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991937664 00000100:00100000:2.0:1746127012.472387:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991937664 00010000:00010000:2.0:1746127012.472415:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 12 pid: 12333 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746127012.472432:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991937536 00000100:00100000:2.0:1746127012.472434:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991937536 00010000:00010000:2.0:1746127012.472443:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 27 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.472459:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991937792 00000100:00100000:2.0:1746127012.472461:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991937792 00010000:00010000:2.0:1746127012.472468:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 17 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.472482:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10501 00000100:00100000:2.0:1746127012.472487:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991937664:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.472498:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.472517:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 12 pid: 12333 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.472526:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 12 pid: 12333 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.472548:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bebec00/0x34dc807b6efb4c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54009 expref: 12 pid: 12333 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.472562:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.472567:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10502 00000100:00100000:3.0:1746127012.472576:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991937536:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127012.472583:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991937664:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 96us (513us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127012.472584:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746127012.472589:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10501 00010000:00010000:3.0:1746127012.472599:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 27 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.472600:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10503 00000100:00100000:2.0:1746127012.472604:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2028:x1830945991937792:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.472608:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 27 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.472610:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.472615:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 17 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.472620:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e96000/0x34dc807b6efb7a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 204800->610303) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541b4 expref: 27 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.472624:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 17 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.472635:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efb604 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5409c expref: 17 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.472636:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.472638:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.472642:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127012.472645:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.472652:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.472652:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991937792:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 48us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.472657:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10503 00010000:00010000:3.0:1746127012.472680:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.472692:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994368512:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127012.472740:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.475282:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.475329:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991937920 00000100:00100000:2.0:1746127012.475338:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991937920 00010000:00010000:2.0:1746127012.475371:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 43 pid: 9611 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.475413:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10504 00000100:00100000:2.0:1746127012.475421:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991937920:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.475437:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.475456:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 43 pid: 9611 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.475467:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 43 pid: 9611 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.475490:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d2c3e00/0x34dc807b6efb5f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5408e expref: 43 pid: 9611 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.475504:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.475506:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.475513:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.475521:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.475556:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.475567:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994368640:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.475640:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.476322:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994368512:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127012.476338:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.476374:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991937536:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3799us (4216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.476380:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10502 00000100:00100000:2.0:1746127012.477334:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7246:1830945994368640:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.477348:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.477381:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991937920:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1961us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.477389:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10504 00000100:00100000:0.0:1746127012.477827:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.477859:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.478017:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991938304 00000100:00100000:2.0:1746127012.478023:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991938304 00000100:00100000:3.0:1746127012.478228:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991938432 00000100:00100000:3.0:1746127012.478232:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991938432 00002000:00100000:3.0:1746127012.478255:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1626111) req@ffff88012ced5c00 x1830945991938432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.478263:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5c00 with x1830945991938432 ext(1048576->1626111) 00002000:00010000:3.0:1746127012.478268:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced5c00 00000100:00100000:3.0:1746127012.478294:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8957 00000100:00100000:3.0:1746127012.478301:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991938432:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:2.0:1746127012.478796:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012ced7800 x1830945991938304/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.478804:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced7800 with x1830945991938304 ext(0->1048575) 00002000:00010000:2.0:1746127012.478808:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced7800 00000100:00100000:2.0:1746127012.478822:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8958 00000100:00100000:2.0:1746127012.478828:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991938304:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127012.484341:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.484616:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991938688 00000100:00100000:0.0:1746127012.484627:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991938688 00002000:00100000:0.0:1746127012.484677:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1421312->1425407) req@ffff880095c04380 x1830945991938688/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.484688:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04380 with x1830945991938688 ext(1421312->1425407) 00002000:00010000:0.0:1746127012.484694:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c04380 00000100:00100000:0.0:1746127012.484713:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8959 00000100:00100000:0.0:1746127012.484722:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991938688:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.484875:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991938688:12345-192.168.203.42@tcp:3:cat.0 Request processed in 154us (544us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127012.484882:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8959 00002000:00100000:0.0:1746127012.484888:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1421312->1425407) req@ffff880095c04380 x1830945991938688/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.484896:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c04380 with x1830945991938688 ext(1421312->1425407) 00002000:00010000:0.0:1746127012.484899:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c04380 00000100:00100000:3.0:1746127012.485082:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991938432:12345-192.168.203.42@tcp:3:cat.0 Request processed in 6781us (7221us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746127012.485089:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8957 00002000:00100000:3.0:1746127012.485094:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1626111) req@ffff88012ced5c00 x1830945991938432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.485101:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5c00 with x1830945991938432 ext(1048576->1626111) 00002000:00010000:3.0:1746127012.485105:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced5c00 00000100:00100000:2.0:1746127012.488567:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991938304:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9729us (10731us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127012.488579:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8958 00002000:00100000:2.0:1746127012.488590:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012ced7800 x1830945991938304/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.488598:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced7800 with x1830945991938304 ext(0->1048575) 00002000:00010000:2.0:1746127012.488603:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced7800 00000100:00100000:0.0:1746127012.491336:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.492442:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991938944 00000100:00100000:1.0:1746127012.492453:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991938944 00000100:00100000:1.0:1746127012.492514:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6672 00000100:00100000:1.0:1746127012.492522:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4634:x1830945991938944:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127012.492789:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4634:x1830945991938944:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 266us (1460us total) trans 8589938394 rc 0/0 00000100:00100000:1.0:1746127012.492797:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6672 00000100:00100000:0.0:1746127012.493925:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.494171:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991939200 00000100:00100000:2.0:1746127012.494177:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991939200 00002000:00100000:2.0:1746127012.494213:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1425408->2097151) req@ffff88012ced6680 x1830945991939200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.494222:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6680 with x1830945991939200 ext(1425408->2097151) 00002000:00010000:2.0:1746127012.494227:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced6680 00000100:00100000:2.0:1746127012.494254:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8960 00000100:00100000:2.0:1746127012.494260:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991939200:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.497207:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.497263:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991939456 00000100:00100000:3.0:1746127012.497271:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991939456 00002000:00100000:3.0:1746127012.497307:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012cc9ca80 x1830945991939456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.497317:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9ca80 with x1830945991939456 ext(1048576->2097151) 00002000:00010000:3.0:1746127012.497322:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9ca80 00000100:00100000:3.0:1746127012.497349:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8961 00000100:00100000:3.0:1746127012.497355:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991939456:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127012.504411:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991939200:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10138us (10476us total) trans 0 rc 671744/671744 00000100:00100000:3.0:1746127012.504423:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8960 00002000:00100000:3.0:1746127012.504437:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1425408->2097151) req@ffff88012ced6680 x1830945991939200/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.504448:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced6680 with x1830945991939200 ext(1425408->2097151) 00002000:00010000:3.0:1746127012.504454:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced6680 00000100:00100000:3.0:1746127012.506707:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991939456:12345-192.168.203.42@tcp:3:cat.0 Request processed in 9342us (9502us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127012.506719:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8961 00002000:00100000:3.0:1746127012.506728:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88012cc9ca80 x1830945991939456/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.506737:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9ca80 with x1830945991939456 ext(1048576->2097151) 00002000:00010000:3.0:1746127012.506742:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9ca80 00000100:00100000:0.0:1746127012.520003:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.520575:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991939712 00000100:00100000:3.0:1746127012.520584:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991939712 00002000:00100000:3.0:1746127012.520748:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012cc9c700 x1830945991939712/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.520759:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c700 with x1830945991939712 ext(2097152->4194303) 00002000:00010000:3.0:1746127012.520765:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9c700 00000100:00100000:3.0:1746127012.520790:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8962 00000100:00100000:3.0:1746127012.520798:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991939712:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127012.537797:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991939712:12345-192.168.203.42@tcp:3:cat.0 Request processed in 16989us (17807us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127012.537810:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8962 00002000:00100000:3.0:1746127012.537821:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88012cc9c700 x1830945991939712/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.537832:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9c700 with x1830945991939712 ext(2097152->4194303) 00002000:00010000:3.0:1746127012.537837:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9c700 00000100:00100000:0.0:1746127012.544965:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.545646:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991939968 00000100:00100000:3.0:1746127012.545656:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991939968 00002000:00100000:3.0:1746127012.545702:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012cc9d180 x1830945991939968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.545712:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d180 with x1830945991939968 ext(4194304->4829183) 00002000:00010000:3.0:1746127012.545719:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9d180 00000100:00100000:3.0:1746127012.545875:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8963 00000100:00100000:3.0:1746127012.545883:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991939968:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.558458:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.558723:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991940224 00000100:00100000:1.0:1746127012.558733:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991940224 00000100:00100000:1.0:1746127012.558795:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17426 00000100:00100000:1.0:1746127012.558803:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:4645:x1830945991940224:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127012.558830:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.558854:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b000/0x34dc807b6efb88f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5425c expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.558931:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.558943:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.558953:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.558966:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.558972:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.558977:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.559081:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.559090:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.559097:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127012.559106:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127012.559999:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560006:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560012:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560018:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2aa00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.560021:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560027:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560038:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127012.560041:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.560044:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127012.560049:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991939968:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14164us (15092us total) trans 0 rc 634880/634880 00010000:00010000:1.0:1746127012.560049:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127012.560059:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8963 00002000:00100000:3.0:1746127012.560069:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88012cc9d180 x1830945991939968/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.560078:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9d180 with x1830945991939968 ext(4194304->4829183) 00002000:00010000:3.0:1746127012.560082:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9d180 00010000:00010000:1.0:1746127012.560452:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560458:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560467:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560471:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2b200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.560473:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560478:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560486:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b41ee200) 00010000:00010000:1.0:1746127012.560488:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.560490:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560494:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb89d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.560533:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b000/0x34dc807b6efb88f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 39 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.560768:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 38 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.560776:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.560778:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127012.560781:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2a600, rc 0) 00000100:00100000:1.0:1746127012.560893:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4645:x1830945991940224:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2090us (2444us total) trans 8589938395 rc 0/0 00000100:00100000:1.0:1746127012.560899:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17426 00000100:00100000:0.0:1746127012.562673:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.562830:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991940480 00000100:00100000:1.0:1746127012.562838:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991940480 00000100:00100000:1.0:1746127012.562937:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6673 00000100:00100000:1.0:1746127012.562945:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+38:4645:x1830945991940480:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1746127012.563408:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4645:x1830945991940480:12345-192.168.203.42@tcp:35:cat.0 Request processed in 462us (741us total) trans 8589938396 rc 0/0 00000100:00100000:1.0:1746127012.563415:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6673 00000100:00100000:0.0:1746127012.569417:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.569457:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.569499:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.571369:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991940608 00000100:00100000:2.0:1746127012.571381:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991940608 00000100:00100000:2.0:1746127012.571429:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991940864 00000100:00100000:2.0:1746127012.571431:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991940864 00000100:00100000:2.0:1746127012.571446:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22325 00000100:00100000:2.0:1746127012.571454:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2028:x1830945991940608:12345-192.168.203.42@tcp:101:cat.0 00000100:00100000:1.0:1746127012.571455:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991940736 00000100:00100000:1.0:1746127012.571461:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991940736 00010000:00010000:2.0:1746127012.571472:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.571496:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54263 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.571508:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22326 00000100:00100000:3.0:1746127012.571518:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2028:x1830945991940864:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.571521:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.571523:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.571527:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.571532:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 27 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.571547:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 27 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.571548:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbfca00/0x34dc807b6efb8b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54271 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.571557:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bfec00, rc 0) 00000100:00100000:3.0:1746127012.571592:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994368768:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127012.571610:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945991940608:12345-192.168.203.42@tcp:101:cat.0 Request processed in 156us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.571615:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22325 00000100:00100000:1.0:1746127012.571742:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22327 00000100:00100000:1.0:1746127012.571749:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991940736:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127012.571756:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.571764:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880077c2b000/0x34dc807b6efb8c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5426a expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.571795:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368896:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127012.571853:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.571958:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746127012.573854:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127010 -> 1746127011 00000100:00100000:1.0:1746127012.573878:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994368896:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127012.573906:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880077c2b000/0x34dc807b6efb8c0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5426a expref: 45 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.573918:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880077c2b000/0x34dc807b6efb8c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5426a expref: 45 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.573929:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2b000, rc 0) 00000100:00100000:1.0:1746127012.574236:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2028:x1830945991940736:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2486us (4776us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127012.574243:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22327 00002000:00010000:3.0:1746127012.574505:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime: 1746127009 -> 1746127011 00002000:00010000:3.0:1746127012.574509:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime: 1746127009 -> 1746127011 00002000:00010000:3.0:1746127012.574510:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime: 1746127009 -> 1746127011 00000100:00100000:3.0:1746127012.574519:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994368768:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127012.574539:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfca00/0x34dc807b6efb8b9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54271 expref: 43 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.574546:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfca00/0x34dc807b6efb8b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54271 expref: 43 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.574556:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfca00, rc 0) 00000100:00100000:3.0:1746127012.574573:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2028:x1830945991940864:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3058us (5074us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127012.574578:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22326 00000100:00100000:0.0:1746127012.581658:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.585120:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991941120 00000100:00100000:3.0:1746127012.585148:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991941120 00002000:00100000:3.0:1746127012.585201:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012cc9fb80 x1830945991941120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.585211:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9fb80 with x1830945991941120 ext(0->1048575) 00002000:00010000:3.0:1746127012.585217:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9fb80 00000100:00100000:3.0:1746127012.585248:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8964 00000100:00100000:3.0:1746127012.585257:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991941120:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.592268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.592320:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991941376 00000100:00100000:1.0:1746127012.592330:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991941376 00000100:00100000:1.0:1746127012.592391:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17427 00000100:00100000:1.0:1746127012.592400:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+39:4648:x1830945991941376:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127012.592427:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.592446:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54278 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.592520:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592533:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592544:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592556:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592562:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592567:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592659:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b000/0x34dc807b6efb8dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592668:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b000/0x34dc807b6efb8dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592674:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b000/0x34dc807b6efb8dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:1.0:1746127012.592682:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127012.592756:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592762:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592768:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592773:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2aa00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.592777:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592783:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592792:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127012.592795:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.592799:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592803:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2aa00/0x34dc807b6efb8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592829:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592834:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592842:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592846:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c2a800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127012.592848:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592853:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592859:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b41ee100) 00010000:00010000:1.0:1746127012.592861:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127012.592863:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592867:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a800/0x34dc807b6efb8d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127012.592901:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b200/0x34dc807b6efb8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54278 expref: 42 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.592911:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b000/0x34dc807b6efb8dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54278 expref: 41 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.592917:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127012.592919:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127012.592921:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c2b000, rc 0) 00000100:00100000:1.0:1746127012.592978:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4648:x1830945991941376:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 580us (729us total) trans 8589938397 rc 0/0 00000100:00100000:1.0:1746127012.592985:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17427 00000100:00100000:0.0:1746127012.595704:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991941120:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10438us (14046us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127012.595714:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.595716:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8964 00002000:00100000:0.0:1746127012.595728:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88012cc9fb80 x1830945991941120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.595737:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9fb80 with x1830945991941120 ext(0->1048575) 00002000:00010000:0.0:1746127012.595743:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc9fb80 00000100:00100000:1.0:1746127012.595871:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991941760 00000100:00100000:1.0:1746127012.595879:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991941760 00000100:00100000:1.0:1746127012.595921:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6674 00000100:00100000:1.0:1746127012.595928:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4648:x1830945991941760:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127012.596112:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4648:x1830945991941760:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 184us (397us total) trans 8589938398 rc 0/0 00000100:00100000:1.0:1746127012.596117:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6674 00000100:00100000:2.0:1746127012.596432:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.596482:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991941504 00000100:00100000:0.0:1746127012.596486:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991941504 00000100:00100000:0.0:1746127012.596523:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1041 00000100:00100000:0.0:1746127012.596529:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2027:x1830945991941504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127012.596540:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127012.596563:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2b000/0x34dc807b6efb8dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54278 expref: 42 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.596579:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127012.596584:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127012.596603:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:2027:x1830945991941504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.596608:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1041 00000100:00100000:0.0:1746127012.599434:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.599481:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991941888 00000100:00100000:3.0:1746127012.599493:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991941888 00000100:00100000:3.0:1746127012.599536:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22328 00000100:00100000:3.0:1746127012.599544:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4648:x1830945991941888:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127012.599560:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127012.599577:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5427f expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.599605:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.599613:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 43 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.599618:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.599620:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.599623:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3125248->3145727] (req 3125248->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.599649:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 43 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127012.599660:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 43 pid: 3148 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746127012.599671:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994369024:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127012.599757:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 15 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.599765:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 15 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.599773:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994369152:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.599790:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.603882:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.603957:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991942016 00000100:00100000:1.0:1746127012.603967:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991942016 00000100:00100000:2.0:1746127012.604331:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22329 00000100:00100000:2.0:1746127012.604343:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4645:x1830945991942016:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.604366:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.604388:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54286 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.604421:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.604428:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.604430:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.604433:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.604465:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.604476:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.604493:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994369280:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.604589:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127012.607760:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994369024:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127012.607770:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994369152:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127012.607798:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3125248->3145727] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 45 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.607815:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbfcc00, rc 0) 00000100:00100000:3.0:1746127012.607869:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4648:x1830945991941888:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8324us (8441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.607878:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22328 00000100:00100000:0.0:1746127012.611543:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.612024:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991942144 00000100:00100000:3.0:1746127012.612033:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991942144 00010000:00010000:3.0:1746127012.612070:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 45 pid: 3148 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746127012.612121:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10505 00000100:00100000:3.0:1746127012.612159:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991942144:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127012.612208:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.612242:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.612247:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991942272 00000100:00100000:1.0:1746127012.612256:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991942272 00000100:00100000:1.0:1746127012.612264:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991942400 00000100:00100000:1.0:1746127012.612266:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991942400 00010000:00010000:1.0:1746127012.612280:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 17 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.612297:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10506 00000100:00100000:1.0:1746127012.612302:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991942400:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127012.612312:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127012.612330:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 17 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.612340:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 17 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.612362:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e97000/0x34dc807b6efb793 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541ad expref: 17 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.612386:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.612397:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994369280:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127012.612422:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991942400:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 119us (178us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127012.612423:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.612428:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10506 00010000:00010000:2.0:1746127012.612435:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6ce00, rc 0) 00000100:00100000:2.0:1746127012.612458:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4645:x1830945991942016:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8119us (8586us total) trans 0 rc 0/0 00002000:00100000:1.0:1746127012.612462:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9f:0x0] (1626112->2097151) req@ffff88012cc9ea00 x1830945991942272/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746127012.612465:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22329 00002000:00100000:1.0:1746127012.612471:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9ea00 with x1830945991942272 ext(1626112->2097151) 00010000:00010000:1.0:1746127012.612476:0:9617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.612484:0:9617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 15 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.612489:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cc9ea00 00000100:00100000:1.0:1746127012.612505:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1998 00000100:00100000:1.0:1746127012.612509:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2027:x1830945991942272:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:3.0:1746127012.612619:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.612630:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 44 pid: 3148 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746127012.612639:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 44 pid: 3148 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746127012.612655:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098ac7e00/0x34dc807b6efb7c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541d7 expref: 44 pid: 3148 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746127012.612668:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.612670:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.612676:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.612683:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.612711:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.612721:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994369408:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127012.613465:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.617284:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.617335:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994369408:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.617353:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.617405:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991942144:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5276us (5873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127012.617409:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991942656 00000100:00100000:2.0:1746127012.617414:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10505 00000100:00100000:1.0:1746127012.617417:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991942656 00002000:00100000:1.0:1746127012.617457:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3125248->3129343) req@ffff88012cc9e680 x1830945991942656/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.617467:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9e680 with x1830945991942656 ext(3125248->3129343) 00002000:00010000:1.0:1746127012.617472:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9e680 00000100:00100000:2.0:1746127012.618232:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8965 00000100:00100000:2.0:1746127012.618242:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991942656:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127012.618372:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2027:x1830945991942656:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 133us (1098us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127012.618378:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8965 00002000:00100000:2.0:1746127012.618383:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3125248->3129343) req@ffff88012cc9e680 x1830945991942656/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.618390:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9e680 with x1830945991942656 ext(3125248->3129343) 00002000:00010000:2.0:1746127012.618393:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc9e680 00000100:00100000:1.0:1746127012.620275:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991942272:12345-192.168.203.42@tcp:4:cat.0 Request processed in 7758us (8058us total) trans 17179875721 rc 0/0 00000100:00100000:1.0:1746127012.620287:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1998 00002000:00100000:1.0:1746127012.620296:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1626112->2097151) req@ffff88012cc9ea00 x1830945991942272/t17179875721(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.620305:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc9ea00 with x1830945991942272 ext(1626112->2097151) 00010000:00010000:1.0:1746127012.620313:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.620326:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.620333:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cc9ea00 00000100:00100000:0.0:1746127012.623566:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.623753:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.623793:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991942784 00000100:00100000:2.0:1746127012.623803:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991942784 00000100:00100000:3.0:1746127012.624172:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991942912 00000100:00100000:3.0:1746127012.624176:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991942912 00010000:00010000:3.0:1746127012.624202:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.624228:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10507 00000100:00100000:3.0:1746127012.624235:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2029:x1830945991942912:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.624249:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.624267:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.624278:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.624304:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bfee00/0x34dc807b6efb83b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54224 expref: 17 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.624548:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.624551:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.624559:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 42 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.624568:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 42 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.624603:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 42 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.624615:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994369536:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127012.625213:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.625547:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22330 00000100:00100000:2.0:1746127012.625557:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4648:x1830945991942784:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.625573:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.625589:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5428d expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.625612:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 28 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.625625:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 15 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.625630:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.625632:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.625635:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 28 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.625656:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 15 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.625666:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 15 pid: 3148 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746127012.625675:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994369664:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.625714:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 28 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.625721:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 28 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.625729:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994369792:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.625750:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.630071:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994369664:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.630084:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994369792:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.630116:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 28 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.630172:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6d800, rc 0) 00000100:00100000:2.0:1746127012.630240:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4648:x1830945991942784:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4682us (6683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.630249:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22330 00000100:00100000:3.0:1746127012.630768:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994369536:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127012.630779:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.630819:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991942912:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6583us (7064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.630828:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10507 00000100:00100000:0.0:1746127012.632525:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.632576:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991943040 00000100:00100000:3.0:1746127012.632585:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991943040 00010000:00010000:3.0:1746127012.632615:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 28 pid: 12340 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746127012.632656:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10508 00000100:00100000:3.0:1746127012.632663:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2026:x1830945991943040:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.632676:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.632694:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 28 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.632703:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 28 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.632726:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bff600/0x34dc807b6efb7f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54208 expref: 28 pid: 12340 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.632753:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.632783:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991943040:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 120us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.632789:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10508 00000100:00100000:0.0:1746127012.640921:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.640970:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.641057:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991943424 00000100:00100000:1.0:1746127012.641067:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991943424 00002000:00100000:1.0:1746127012.641110:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ced4700 x1830945991943424/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.641120:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4700 with x1830945991943424 ext(1048576->2097151) 00002000:00010000:1.0:1746127012.641124:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4700 00000100:00100000:2.0:1746127012.641528:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991943296 00000100:00100000:2.0:1746127012.641533:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991943296 00010000:00010000:2.0:1746127012.641557:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 16 pid: 3148 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746127012.642006:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10509 00000100:00100000:2.0:1746127012.642014:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991943296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.642028:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.642050:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 16 pid: 3148 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.642063:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 16 pid: 3148 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.642086:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096658800/0x34dc807b6efb86c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54247 expref: 16 pid: 3148 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746127012.642118:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.642121:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.642146:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 26 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.642155:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 26 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.642187:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 26 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.642198:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994369920:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.642285:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746127012.642690:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8966 00000100:00100000:1.0:1746127012.642699:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991943424:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127012.649578:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.649647:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991943680 00000100:00100000:3.0:1746127012.649656:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991943680 00002000:00100000:3.0:1746127012.649701:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3219456->3223551) req@ffff88012ced5f80 x1830945991943680/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.649711:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5f80 with x1830945991943680 ext(3219456->3223551) 00002000:00010000:3.0:1746127012.649716:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced5f80 00000100:00100000:2.0:1746127012.649744:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994369920:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127012.649754:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8967 00000100:00100000:3.0:1746127012.649761:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991943680:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:2.0:1746127012.649766:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.649807:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+15:2029:x1830945991943296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7794us (8895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.649815:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10509 00000100:00100000:3.0:1746127012.649905:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991943680:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 144us (339us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127012.649911:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8967 00002000:00100000:3.0:1746127012.649916:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3219456->3223551) req@ffff88012ced5f80 x1830945991943680/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.649921:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced5f80 with x1830945991943680 ext(3219456->3223551) 00002000:00010000:3.0:1746127012.649924:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ced5f80 00000100:00100000:1.0:1746127012.651630:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991943424:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 8927us (10652us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127012.651639:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8966 00002000:00100000:1.0:1746127012.651647:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88012ced4700 x1830945991943424/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.651660:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ced4700 with x1830945991943424 ext(1048576->2097151) 00002000:00010000:1.0:1746127012.651664:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ced4700 00000100:00100000:0.0:1746127012.661215:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.661338:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991943808 00000100:00100000:2.0:1746127012.661348:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991943808 00000100:00100000:2.0:1746127012.661409:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22331 00000100:00100000:2.0:1746127012.661417:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4645:x1830945991943808:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.661436:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.661454:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54294 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.661485:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.661491:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.661493:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.661497:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 44 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.661524:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 15 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.661535:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 15 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.661546:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994370048:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.661623:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.667916:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994370048:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.667950:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 44 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.667967:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6c400, rc 0) 00000100:00100000:2.0:1746127012.668024:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:4645:x1830945991943808:12345-192.168.203.42@tcp:101:cat.0 Request processed in 6607us (6821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.668033:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22331 00000100:00100000:0.0:1746127012.668927:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.669305:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991943936 00000100:00100000:1.0:1746127012.669312:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991943936 00002000:00100000:1.0:1746127012.669353:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1425407) req@ffff88007ece6d80 x1830945991943936/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.669361:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6d80 with x1830945991943936 ext(1048576->1425407) 00010000:00010000:1.0:1746127012.669369:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 16 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.669381:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 16 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.669388:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ece6d80 00000100:00100000:1.0:1746127012.669414:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1999 00000100:00100000:1.0:1746127012.669420:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991943936:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:1.0:1746127012.678691:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2028:x1830945991943936:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9258us (9753us total) trans 17179875722 rc 0/0 00000100:00100000:1.0:1746127012.678703:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1999 00002000:00100000:1.0:1746127012.678714:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1425407) req@ffff88007ece6d80 x1830945991943936/t17179875722(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.678724:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6d80 with x1830945991943936 ext(1048576->1425407) 00010000:00010000:1.0:1746127012.678734:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 18 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.678752:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 18 pid: 3148 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746127012.678759:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007ece6d80 00000100:00100000:0.0:1746127012.683909:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.684072:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991944064 00000100:00100000:2.0:1746127012.684081:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991944064 00010000:00010000:2.0:1746127012.684124:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 18 pid: 3148 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.684271:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10510 00000100:00100000:2.0:1746127012.684279:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991944064:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.684296:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.684315:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 18 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.684386:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 18 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.684410:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efb888 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54255 expref: 18 pid: 3148 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.684441:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.684444:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.684451:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 43 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.684459:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 43 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.684491:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 43 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.684504:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994370176:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.684594:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.689722:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994370176:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.689750:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.689813:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991944064:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5533us (5913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.689826:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10510 00000100:00100000:0.0:1746127012.690123:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.690726:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991944320 00000100:00100000:2.0:1746127012.690734:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991944320 00002000:00100000:2.0:1746127012.690778:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ece4000 x1830945991944320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.690787:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4000 with x1830945991944320 ext(1048576->2097151) 00002000:00010000:2.0:1746127012.690792:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece4000 00000100:00100000:2.0:1746127012.690890:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8968 00000100:00100000:2.0:1746127012.690898:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991944320:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127012.699815:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2026:x1830945991944320:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 8902us (9677us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127012.699832:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8968 00002000:00100000:2.0:1746127012.699845:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88007ece4000 x1830945991944320/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.699855:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece4000 with x1830945991944320 ext(1048576->2097151) 00002000:00010000:2.0:1746127012.699862:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece4000 00000100:00100000:0.0:1746127012.719614:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.719918:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.721497:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.721545:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991944576 00000100:00100000:2.0:1746127012.721553:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991944576 00000100:00100000:2.0:1746127012.721600:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17428 00000100:00100000:2.0:1746127012.721608:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4652:x1830945991944576:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.721631:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.721650:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efb906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5429b expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.721684:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991944960 00000100:00100000:3.0:1746127012.721690:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991944960 00002000:00100000:3.0:1746127012.721720:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ece6a00 x1830945991944960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 504/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746127012.721724:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00002000:00100000:3.0:1746127012.721731:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6a00 with x1830945991944960 ext(2097152->4194303) 00002000:00010000:3.0:1746127012.721736:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece6a00 00010000:00010000:2.0:1746127012.721736:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721746:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721756:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00000100:00100000:3.0:1746127012.721758:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991945088 00000100:00100000:3.0:1746127012.721761:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991945088 00010000:00010000:2.0:1746127012.721761:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721766:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00002000:00100000:3.0:1746127012.721773:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007ece7480 x1830945991945088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 504/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.721780:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece7480 with x1830945991945088 ext(2097152->4194303) 00002000:00010000:3.0:1746127012.721783:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece7480 00000100:00100000:3.0:1746127012.721793:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8969 00000100:00100000:3.0:1746127012.721798:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991944960:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:2.0:1746127012.721857:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6efb91b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721864:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6efb91b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721868:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6efb91b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127012.721875:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127012.721936:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721941:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721950:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721955:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6c200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127012.721958:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721963:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721972:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127012.721974:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127012.721978:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.721981:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb90d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722005:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722010:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722014:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722017:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6c800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127012.722019:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722023:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722031:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662ef00) 00010000:00010000:2.0:1746127012.722032:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127012.722034:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722038:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c800/0x34dc807b6efb914 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.722068:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d200/0x34dc807b6efb906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5429b expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.722077:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6efb91b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5429b expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.722082:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127012.722083:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127012.722085:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6dc00, rc 0) 00000100:00100000:2.0:1746127012.722149:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4652:x1830945991944576:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 541us (654us total) trans 8589938399 rc 0/0 00000100:00100000:2.0:1746127012.722155:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17428 00000100:00100000:2.0:1746127012.722208:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8970 00000100:00100000:2.0:1746127012.722214:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2029:x1830945991945088:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127012.729464:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.729600:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991945216 00000100:00100000:3.0:1746127012.729610:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991945216 00000100:00100000:3.0:1746127012.729664:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1042 00000100:00100000:3.0:1746127012.729671:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991945216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.729686:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.729710:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6dc00/0x34dc807b6efb91b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5429b expref: 19 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.729903:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127012.729908:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127012.729959:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991945216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 288us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.729966:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1042 00000100:00100000:2.0:1746127012.743819:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2029:x1830945991945088:12345-192.168.203.42@tcp:3:cat.0 Request processed in 21591us (23886us total) trans 0 rc 2076672/2076672 00000100:00100000:2.0:1746127012.743831:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8970 00002000:00100000:2.0:1746127012.743842:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88007ece7480 x1830945991945088/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 504/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 2076672/2076672 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.743852:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece7480 with x1830945991945088 ext(2097152->4194303) 00002000:00010000:2.0:1746127012.743857:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ece7480 00000100:00100000:3.0:1746127012.760582:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991944960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 38773us (40969us total) trans 0 rc 2019328/2019328 00000100:00100000:3.0:1746127012.760595:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8969 00002000:00100000:3.0:1746127012.760606:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88007ece6a00 x1830945991944960/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 504/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 2019328/2019328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.760616:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6a00 with x1830945991944960 ext(2097152->4194303) 00002000:00010000:3.0:1746127012.760621:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ece6a00 00000100:00100000:0.0:1746127012.783076:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.783501:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991945344 00000100:00100000:2.0:1746127012.783510:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991945344 00000100:00100000:2.0:1746127012.783564:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22332 00000100:00100000:2.0:1746127012.783571:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+15:4652:x1830945991945344:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.783590:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.783609:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542a2 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.783638:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 26 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.783646:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.783647:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.783651:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2310144->2875391] (req 2310144->2875391) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 16 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.783680:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 26 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.783690:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 26 pid: 1964 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.783702:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994370304:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.783781:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.784337:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.784391:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991945600 00000100:00100000:2.0:1746127012.784395:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991945600 00000100:00100000:2.0:1746127012.784419:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17429 00000100:00100000:2.0:1746127012.784424:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4656:x1830945991945600:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.784472:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.784484:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542a9 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.784546:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784557:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784567:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784578:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784583:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784587:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784672:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6de00/0x34dc807b6efb945 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784680:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6de00/0x34dc807b6efb945 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784685:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6de00/0x34dc807b6efb945 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127012.784698:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127012.784759:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784765:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784770:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784776:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6d400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127012.784780:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784785:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784794:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127012.784796:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127012.784800:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784804:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d400/0x34dc807b6efb937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784817:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784822:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784827:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784835:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094a6d000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127012.784837:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784841:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784846:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e900) 00010000:00010000:2.0:1746127012.784848:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127012.784850:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784854:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6d000/0x34dc807b6efb93e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.784883:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6c200/0x34dc807b6efb930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a9 expref: 21 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.784892:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6de00/0x34dc807b6efb945 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a9 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.786677:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127012.786680:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127012.786684:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6de00, rc 0) 00000100:00100000:2.0:1746127012.786755:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4656:x1830945991945600:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2327us (2416us total) trans 8589938400 rc 0/0 00000100:00100000:2.0:1746127012.786763:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17429 00000100:00100000:0.0:1746127012.787681:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.788539:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fdaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994370304:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.788568:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2310144->2875391] (req 2310144->2875391) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 16 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.788585:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6c000, rc 0) 00000100:00100000:2.0:1746127012.788618:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4652:x1830945991945344:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 5047us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.788625:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22332 00000100:00100000:3.0:1746127012.788869:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991945856 00000100:00100000:3.0:1746127012.788876:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991945856 00002000:00100000:3.0:1746127012.788912:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ece6300 x1830945991945856/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.788921:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6300 with x1830945991945856 ext(4194304->4829183) 00010000:00010000:3.0:1746127012.788927:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 27 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.788939:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 27 pid: 1964 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.788946:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ece6300 00000100:00100000:3.0:1746127012.788960:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2000 00000100:00100000:3.0:1746127012.788966:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945991945856:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127012.792796:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.793419:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991945984 00000100:00100000:3.0:1746127012.793428:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991945984 00002000:00100000:3.0:1746127012.793468:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3223551) req@ffff8800a2fdaa00 x1830945991945984/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.793479:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdaa00 with x1830945991945984 ext(3145728->3223551) 00010000:00010000:3.0:1746127012.793488:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 29 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.793502:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 29 pid: 1964 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.793510:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdaa00 00000100:00100000:3.0:1746127012.793540:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2001 00000100:00100000:3.0:1746127012.793548:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991945984:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127012.795228:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.795280:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991946112 00000100:00100000:3.0:1746127012.795285:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991946112 00000100:00100000:2.0:1746127012.795296:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.795322:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1043 00000100:00100000:3.0:1746127012.795328:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991946112:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127012.795339:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127012.795362:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991946368 00010000:00010000:3.0:1746127012.795364:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a6de00/0x34dc807b6efb945 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a9 expref: 20 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.795366:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991946368 00010000:00010000:3.0:1746127012.795383:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127012.795387:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127012.795419:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6675 00000100:00100000:1.0:1746127012.795424:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4656:x1830945991946368:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1746127012.795688:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991946112:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 358us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.795695:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1043 00000100:00100000:3.0:1746127012.796425:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991945856:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7456us (8744us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127012.796434:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2000 00002000:00100000:3.0:1746127012.796442:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ece6300 x1830945991945856/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.796451:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ece6300 with x1830945991945856 ext(4194304->4829183) 00010000:00010000:3.0:1746127012.796458:0:13835:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 29 pid: 1964 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.796463:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4656:x1830945991946368:12345-192.168.203.42@tcp:35:cat.0 Request processed in 1037us (1166us total) trans 8589938401 rc 0/0 00000100:00100000:1.0:1746127012.796469:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6675 00010000:00010000:3.0:1746127012.796471:0:13835:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 29 pid: 1964 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.796478:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007ece6300 00000100:00100000:3.0:1746127012.799146:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991945984:12345-192.168.203.42@tcp:4:cat.0 Request processed in 5574us (6335us total) trans 21474843000 rc 0/0 00000100:00100000:3.0:1746127012.799158:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2001 00002000:00100000:3.0:1746127012.799168:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->3223551) req@ffff8800a2fdaa00 x1830945991945984/t21474843000(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.799178:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdaa00 with x1830945991945984 ext(3145728->3223551) 00010000:00010000:3.0:1746127012.799187:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 29 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.799202:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 29 pid: 1964 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.799210:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fdaa00 00000100:00100000:0.0:1746127012.799790:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.799826:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.799840:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991946496 00000100:00100000:2.0:1746127012.799847:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991946496 00000100:00100000:0.0:1746127012.799852:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.799955:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.800065:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.800087:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991946624 00000100:00100000:0.0:1746127012.800090:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991946624 00000100:00100000:0.0:1746127012.800108:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991946752 00000100:00100000:0.0:1746127012.800110:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991946752 00000100:00100000:0.0:1746127012.800121:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991946880 00000100:00100000:0.0:1746127012.800122:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991946880 00000100:00100000:0.0:1746127012.800151:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991947008 00000100:00100000:0.0:1746127012.800154:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991947008 00000100:00100000:0.0:1746127012.800169:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22333 00000100:00100000:0.0:1746127012.800174:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991946496:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.800188:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.800204:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542b0 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.800228:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.800230:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.800238:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.800252:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.800262:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46400, rc 0) 00000100:00100000:0.0:1746127012.800287:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991946496:12345-192.168.203.42@tcp:101:cat.0 Request processed in 113us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.800293:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22333 00000100:00100000:0.0:1746127012.800303:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22334 00000100:00100000:0.0:1746127012.800307:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991946624:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.800313:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.800319:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542b7 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.800328:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.800329:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127012.800332:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.800341:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127012.800351:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47400, rc 0) 00000100:00100000:0.0:1746127012.800365:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991946624:12345-192.168.203.42@tcp:101:cat.0 Request processed in 57us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.800370:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22334 00000100:00100000:0.0:1746127012.800378:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22335 00000100:00100000:0.0:1746127012.800382:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991946752:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.800388:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.800397:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efb961 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542be expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127012.800435:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ece5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994370432:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127012.800488:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.800505:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22336 00000100:00100000:0.0:1746127012.800510:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991946880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.800516:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.800523:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efb968 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542c5 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127012.800552:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994370560:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127012.800571:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127012.800693:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22337 00000100:00100000:1.0:1746127012.800701:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ece7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991947008:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127012.800707:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127012.800713:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd01000/0x34dc807b6efb96f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542cc expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127012.800736:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994370688:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127012.800762:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00002000:00010000:2.0:1746127012.804276:0:3542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127010 -> 1746127011 00002000:00010000:2.0:1746127012.804285:0:3542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127010 -> 1746127011 00002000:00010000:2.0:1746127012.804287:0:3542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127010 -> 1746127011 00000100:00100000:2.0:1746127012.804313:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ece5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994370432:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127012.804352:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efb961 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542be expref: 17 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.804365:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efb961 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542be expref: 17 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.804394:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47c00, rc 0) 00000100:00100000:2.0:1746127012.804451:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2028:x1830945991946752:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4065us (4596us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127012.804458:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22335 00000100:00100000:0.0:1746127012.808446:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00010000:2.0:1746127012.808498:0:12333:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime: 1746127010 -> 1746127011 00002000:00010000:2.0:1746127012.808504:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime: 1746127010 -> 1746127011 00002000:00010000:2.0:1746127012.808507:0:12333:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime: 1746127010 -> 1746127011 00000100:00100000:2.0:1746127012.808527:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994370560:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127012.808567:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efb968 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542c5 expref: 20 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.808582:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efb968 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542c5 expref: 20 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127012.808592:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47e00, rc 0) 00000100:00100000:2.0:1746127012.808645:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2028:x1830945991946880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 8132us (8687us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127012.808653:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22336 00000100:00100000:3.0:1746127012.808679:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991947136 00000100:00100000:3.0:1746127012.808686:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991947136 00010000:00010000:1.0:1746127012.808689:0:3148:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.203.42@tcp) returned -22 from glimpse AST (req@ffff880095c07100 x1830945994370688) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 30 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.808713:0:3148:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 31 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.808730:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x54801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 31 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746127012.808737:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6d800/0x34dc807b6efb8f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5428d expref: 31 pid: 1964 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746127012.808750:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994370688:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127012.808755:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10511 00000100:00100000:3.0:1746127012.808760:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991947136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127012.808766:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127012.808769:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127012.808771:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127012.808774:0:7245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 34dc807b6efb8f8) 00010000:00010000:3.0:1746127012.808775:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127012.808775:0:3148:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127012.808782:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.808809:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991947136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 49us (373us total) trans 0 rc 116/116 00010000:00010000:1.0:1746127012.808809:0:3148:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.808814:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10511 00000100:00100000:1.0:1746127012.808821:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994370816:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127012.808880:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1746127012.820189:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.820228:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.820435:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.820476:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991947392 00000100:00100000:0.0:1746127012.820484:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991947392 00000100:00100000:2.0:1746127012.820491:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991947648 00000100:00100000:2.0:1746127012.820496:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991947648 00002000:00100000:0.0:1746127012.820531:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a2fc9180 x1830945991947392/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.820541:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9180 with x1830945991947392 ext(1048576->2097151) 00002000:00010000:0.0:1746127012.820547:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9180 00000100:00100000:0.0:1746127012.820562:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991947904 00000100:00100000:0.0:1746127012.820564:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991947904 00002000:00100000:0.0:1746127012.820731:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2310144->2314239) req@ffff8800a2fc8a80 x1830945991947904/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.820733:0:13835:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fc8e00 x1830945991947648/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.820738:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8a80 with x1830945991947904 ext(2310144->2314239) 00002000:00100000:2.0:1746127012.820741:0:13835:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8e00 with x1830945991947648 ext(1048576->2097151) 00002000:00010000:0.0:1746127012.820742:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8a80 00002000:00010000:2.0:1746127012.820745:0:13835:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc8e00 00000100:00100000:0.0:1746127012.820764:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8971 00000100:00100000:2.0:1746127012.820771:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8972 00000100:00100000:0.0:1746127012.820772:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991947392:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127012.820777:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991947904:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127012.820798:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8973 00000100:00100000:3.0:1746127012.820806:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991947648:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127012.820908:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991947904:12345-192.168.203.42@tcp:3:cat.0 Request processed in 130us (471us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127012.820914:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8972 00002000:00100000:2.0:1746127012.820919:0:29586:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9f:0x0] (2310144->2314239) req@ffff8800a2fc8a80 x1830945991947904/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.820931:0:29586:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8a80 with x1830945991947904 ext(2310144->2314239) 00002000:00010000:2.0:1746127012.820934:0:29586:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc8a80 00000100:00100000:1.0:1746127012.821739:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994370816:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127012.821777:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd01000/0x34dc807b6efb96f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542cc expref: 29 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.821790:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd01000/0x34dc807b6efb96f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542cc expref: 29 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127012.821810:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd01000, rc 0) 00000100:00100000:1.0:1746127012.821838:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ece7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2029:x1830945991947008:12345-192.168.203.42@tcp:101:cat.0 Request processed in 21138us (21773us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127012.821845:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22337 00000100:00100000:2.0:1746127012.828535:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.828852:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991948160 00000100:00100000:0.0:1746127012.828863:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991948160 00002000:00100000:0.0:1746127012.829476:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2871296->2875391) req@ffff8800a2fdb800 x1830945991948160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.829487:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb800 with x1830945991948160 ext(2871296->2875391) 00002000:00010000:0.0:1746127012.829493:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fdb800 00000100:00100000:0.0:1746127012.829608:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8974 00000100:00100000:0.0:1746127012.829616:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991948160:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127012.830263:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991948160:12345-192.168.203.42@tcp:3:cat.0 Request processed in 648us (1738us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127012.830270:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8974 00002000:00100000:0.0:1746127012.830277:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2871296->2875391) req@ffff8800a2fdb800 x1830945991948160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127012.830284:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fdb800 with x1830945991948160 ext(2871296->2875391) 00002000:00010000:0.0:1746127012.830286:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fdb800 00000100:00100000:2.0:1746127012.830388:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.831413:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991948288 00000100:00100000:0.0:1746127012.831421:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991948288 00000100:00100000:0.0:1746127012.831472:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22338 00000100:00100000:0.0:1746127012.831478:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4645:x1830945991948288:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127012.831494:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127012.831511:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542d3 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.831537:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.831545:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127012.831547:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127012.831550:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4825088->5242879] (req 4825088->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 29 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.831581:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 15 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.831593:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 15 pid: 1964 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746127012.831605:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2fc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994370944:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127012.831688:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1300 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.843646:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a2fc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994370944:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127012.843678:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [4825088->5242879] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 29 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.843700:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a46200, rc 0) 00000100:00100000:2.0:1746127012.843758:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4645:x1830945991948288:12345-192.168.203.42@tcp:101:cat.0 Request processed in 12279us (13369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.843767:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22338 00000100:00100000:1.0:1746127012.844275:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991947392:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23502us (24094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127012.844284:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8971 00002000:00100000:1.0:1746127012.844293:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a2fc9180 x1830945991947392/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.844302:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9180 with x1830945991947392 ext(1048576->2097151) 00002000:00010000:1.0:1746127012.844307:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9180 00000100:00100000:3.0:1746127012.845832:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991947648:12345-192.168.203.42@tcp:3:cat.0 Request processed in 25020us (25596us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127012.845842:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8973 00002000:00100000:3.0:1746127012.845848:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff8800a2fc8e00 x1830945991947648/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.845857:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8e00 with x1830945991947648 ext(1048576->2097151) 00002000:00010000:3.0:1746127012.845862:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc8e00 00000100:00100000:0.0:1746127012.848532:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.850051:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991948544 00000100:00100000:3.0:1746127012.850063:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991948544 00002000:00100000:3.0:1746127012.850116:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2310144->2875391) req@ffff8800a2fc8000 x1830945991948544/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.850126:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8000 with x1830945991948544 ext(2310144->2875391) 00010000:00010000:3.0:1746127012.850175:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 16 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.850189:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 16 pid: 1964 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.850197:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fc8000 00000100:00100000:3.0:1746127012.850235:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2002 00000100:00100000:3.0:1746127012.850242:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2029:x1830945991948544:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127012.850814:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127012.850868:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991948800 00000100:00100000:1.0:1746127012.850872:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991948800 00000100:00100000:1.0:1746127012.850904:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6676 00000100:00100000:1.0:1746127012.850909:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4652:x1830945991948800:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127012.851086:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4652:x1830945991948800:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 177us (273us total) trans 8589938402 rc 0/0 00000100:00100000:1.0:1746127012.851092:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6676 00000100:00100000:0.0:1746127012.863351:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.863540:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991948928 00000100:00100000:2.0:1746127012.863547:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991948928 00000100:00100000:2.0:1746127012.863612:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22339 00000100:00100000:2.0:1746127012.863620:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4656:x1830945991948928:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.863636:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.863652:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542da expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.863675:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.863677:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.863681:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.863692:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 21 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.863702:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a6c200, rc 0) 00000100:00100000:2.0:1746127012.863743:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4656:x1830945991948928:12345-192.168.203.42@tcp:101:cat.0 Request processed in 124us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.863749:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22339 00000100:00100000:3.0:1746127012.864418:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2029:x1830945991948544:12345-192.168.203.42@tcp:4:cat.0 Request processed in 14174us (15892us total) trans 21474843001 rc 0/0 00000100:00100000:3.0:1746127012.864429:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2002 00002000:00100000:3.0:1746127012.864439:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2310144->2875391) req@ffff8800a2fc8000 x1830945991948544/t21474843001(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.864448:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc8000 with x1830945991948544 ext(2310144->2875391) 00010000:00010000:3.0:1746127012.864454:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 19 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.864472:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 19 pid: 1964 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.864479:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a2fc8000 00000100:00100000:0.0:1746127012.868243:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.868346:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991949056 00000100:00100000:2.0:1746127012.868354:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991949056 00010000:00010000:2.0:1746127012.868393:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 19 pid: 1964 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.868434:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10512 00000100:00100000:2.0:1746127012.868441:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991949056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.868455:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.868477:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 19 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.868488:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 19 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.868512:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c000/0x34dc807b6efb929 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2310144->2875391) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542a2 expref: 19 pid: 1964 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.868545:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.868547:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.868554:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.868567:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.868574:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.868575:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.868578:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 18 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.868584:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 18 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.868614:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 18 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.868625:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ece5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994371072:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.868723:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.868732:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994371200:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.868750:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.871631:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ece5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994371072:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.871646:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994371200:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.871667:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.871785:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991949056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3268us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.871797:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10512 00000100:00100000:0.0:1746127012.871985:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.872262:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991949312 00000100:00100000:3.0:1746127012.872269:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991949312 00002000:00100000:3.0:1746127012.872307:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff8800a2fc9500 x1830945991949312/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.872316:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9500 with x1830945991949312 ext(4825088->4829183) 00002000:00010000:3.0:1746127012.872320:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc9500 00000100:00100000:3.0:1746127012.872336:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8975 00000100:00100000:3.0:1746127012.872340:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991949312:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127012.872462:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991949312:12345-192.168.203.42@tcp:3:cat.0 Request processed in 120us (477us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127012.872467:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8975 00002000:00100000:3.0:1746127012.872472:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4825088->4829183) req@ffff8800a2fc9500 x1830945991949312/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.872483:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9500 with x1830945991949312 ext(4825088->4829183) 00002000:00010000:3.0:1746127012.872486:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fc9500 00000100:00100000:0.0:1746127012.884107:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.884246:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991949568 00000100:00100000:3.0:1746127012.884255:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991949568 00002000:00100000:3.0:1746127012.884302:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff8800a2fcbb80 x1830945991949568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.884316:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fcbb80 with x1830945991949568 ext(2097152->3145727) 00002000:00010000:3.0:1746127012.884321:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fcbb80 00000100:00100000:3.0:1746127012.884344:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8976 00000100:00100000:3.0:1746127012.884351:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991949568:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127012.896451:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991949568:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12089us (12342us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127012.896463:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8976 00002000:00100000:3.0:1746127012.896730:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff8800a2fcbb80 x1830945991949568/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.896739:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fcbb80 with x1830945991949568 ext(2097152->3145727) 00002000:00010000:3.0:1746127012.896746:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a2fcbb80 00000100:00100000:0.0:1746127012.900582:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.900708:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991949696 00000100:00100000:2.0:1746127012.900718:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991949696 00000100:00100000:2.0:1746127012.900779:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22340 00000100:00100000:2.0:1746127012.900788:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4656:x1830945991949696:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127012.900806:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.900825:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542e1 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.900855:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.900863:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.900865:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127012.900868:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.900900:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 43 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.900911:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 43 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.900923:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994371328:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127012.902373:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1746127012.902719:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.902893:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991949952 00000100:00100000:2.0:1746127012.902900:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991949952 00000100:00100000:2.0:1746127012.903249:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17430 00000100:00100000:2.0:1746127012.903257:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+41:4659:x1830945991949952:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.903277:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.903293:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7200/0x34dc807b6efb98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542e8 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.903368:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903379:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903390:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903403:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903408:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903413:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903510:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb9a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903518:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903524:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127012.903534:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127012.903605:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903612:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903617:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903622:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbf7c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127012.903625:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903631:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903640:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127012.903643:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127012.903646:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903650:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7c00/0x34dc807b6efb992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903676:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903681:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903685:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903692:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bbf7a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127012.903694:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903698:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903704:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e100) 00010000:00010000:2.0:1746127012.903706:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127012.903708:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903716:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7a00/0x34dc807b6efb999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.903749:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7200/0x34dc807b6efb98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e8 expref: 44 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.903758:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e8 expref: 43 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127012.904970:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994371328:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127012.905005:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127012.905019:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf6200, rc 0) 00010000:00010000:2.0:1746127012.905410:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127012.905413:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127012.905415:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf7e00, rc 0) 00000100:00100000:3.0:1746127012.905713:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4656:x1830945991949696:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4924us (5137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127012.905722:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22340 00000100:00100000:2.0:1746127012.905816:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4659:x1830945991949952:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2558us (3099us total) trans 8589938403 rc 0/0 00000100:00100000:2.0:1746127012.905823:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17430 00000100:00100000:0.0:1746127012.906347:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127012.906918:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991950080 00000100:00100000:3.0:1746127012.906925:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991950080 00002000:00100000:3.0:1746127012.906962:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (3125248->3145727) req@ffff8800a2fcb480 x1830945991950080/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127012.906978:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fcb480 with x1830945991950080 ext(3125248->3145727) 00010000:00010000:3.0:1746127012.906994:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 44 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746127012.907007:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 44 pid: 1507 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746127012.907014:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2fcb480 00000100:00100000:3.0:1746127012.907271:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2003 00000100:00100000:3.0:1746127012.907278:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+44:2027:x1830945991950080:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127012.909082:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.909199:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.909231:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991950464 00000100:00100000:0.0:1746127012.909237:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991950464 00000100:00100000:0.0:1746127012.909279:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1044 00000100:00100000:0.0:1746127012.909286:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:2026:x1830945991950464:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127012.909298:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127012.909323:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bbf7e00/0x34dc807b6efb9a0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e8 expref: 43 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.909342:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127012.909346:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127012.909380:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:2026:x1830945991950464:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 93us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127012.909386:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1044 00000100:00100000:3.0:1746127012.909563:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991950336 00000100:00100000:3.0:1746127012.909567:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991950336 00000100:00100000:3.0:1746127012.909596:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6677 00000100:00100000:3.0:1746127012.909600:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+42:4659:x1830945991950336:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127012.909726:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4659:x1830945991950336:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 125us (652us total) trans 8589938404 rc 0/0 00000100:00100000:3.0:1746127012.909731:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6677 00000100:00100000:2.0:1746127012.909818:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991950080:12345-192.168.203.42@tcp:4:cat.0 Request processed in 2540us (3471us total) trans 17179875723 rc 0/0 00000100:00100000:2.0:1746127012.909829:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2003 00002000:00100000:2.0:1746127012.909836:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (3125248->3145727) req@ffff8800a2fcb480 x1830945991950080/t17179875723(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:18/0 lens 488/448 e 0 to 0 dl 1746127023 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.909844:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fcb480 with x1830945991950080 ext(3125248->3145727) 00010000:00010000:2.0:1746127012.909851:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 46 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.909863:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 46 pid: 1507 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746127012.909869:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a2fcb480 00010000:00010000:2.0:1746127012.911407:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127012.915914:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.916323:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991950592 00000100:00100000:2.0:1746127012.916332:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991950592 00010000:00010000:2.0:1746127012.916368:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 46 pid: 1507 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746127012.916399:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10513 00000100:00100000:2.0:1746127012.916406:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991950592:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.916421:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.916443:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 46 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.916454:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 46 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.916484:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbfcc00/0x34dc807b6efb8ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5427f expref: 46 pid: 1507 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746127012.916513:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.916515:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127012.916522:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 19 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.916530:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 19 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.916560:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 19 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127012.916571:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994371456:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127012.916920:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1746127012.932365:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994371456:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127012.932388:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.932456:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991950592:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 16048us (16551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.932467:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10513 00000100:00100000:0.0:1746127012.936775:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127012.937459:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.937561:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991950976 00000100:00100000:2.0:1746127012.937570:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991950976 00002000:00100000:2.0:1746127012.937626:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122386a00 x1830945991950976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127012.937719:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991951104 00000100:00100000:1.0:1746127012.937723:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991951104 00002000:00100000:1.0:1746127012.937747:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880122387480 x1830945991951104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.937756:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387480 with x1830945991951104 ext(3145728->4194303) 00002000:00010000:1.0:1746127012.937761:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122387480 00000100:00100000:1.0:1746127012.937783:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8977 00000100:00100000:1.0:1746127012.937791:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991951104:12345-192.168.203.42@tcp:3:cat.0 00002000:00100000:2.0:1746127012.937905:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122386a00 with x1830945991950976 ext(2097152->4194303) 00002000:00010000:2.0:1746127012.937909:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122386a00 00000100:00100000:2.0:1746127012.937933:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8978 00000100:00100000:2.0:1746127012.937941:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991950976:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127012.946257:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991951104:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8455us (8786us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127012.946269:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8977 00002000:00100000:1.0:1746127012.946280:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880122387480 x1830945991951104/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127012.946288:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387480 with x1830945991951104 ext(3145728->4194303) 00002000:00010000:1.0:1746127012.946294:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122387480 00000100:00100000:2.0:1746127012.958716:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991950976:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20762us (21936us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127012.958731:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8978 00002000:00100000:2.0:1746127012.958745:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880122386a00 x1830945991950976/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.958755:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122386a00 with x1830945991950976 ext(2097152->4194303) 00002000:00010000:2.0:1746127012.958762:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880122386a00 00000100:00100000:0.0:1746127012.967249:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.967400:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991951360 00000100:00100000:2.0:1746127012.967411:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991951360 00002000:00100000:2.0:1746127012.967463:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880122386d80 x1830945991951360/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/0 e 0 to 0 dl 1746127023 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.967473:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122386d80 with x1830945991951360 ext(4194304->4829183) 00002000:00010000:2.0:1746127012.967479:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122386d80 00000100:00100000:2.0:1746127012.967502:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8979 00000100:00100000:2.0:1746127012.967510:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991951360:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127012.975435:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991951360:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7914us (8185us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127012.975447:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8979 00002000:00100000:2.0:1746127012.975459:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880122386d80 x1830945991951360/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:18/0 lens 488/440 e 0 to 0 dl 1746127023 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127012.975469:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122386d80 with x1830945991951360 ext(4194304->4829183) 00002000:00010000:2.0:1746127012.975474:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122386d80 00000100:00100000:0.0:1746127012.981525:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.981703:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991951616 00000100:00100000:2.0:1746127012.981712:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991951616 00000100:00100000:2.0:1746127012.981773:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17431 00000100:00100000:2.0:1746127012.981782:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4662:x1830945991951616:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127012.981809:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127012.981829:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efb9ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542ef expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.981907:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.981919:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.981931:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.981945:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.981951:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.981961:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.982064:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6efb9c3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.982072:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6efb9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127012.982076:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6efb9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127012.982083:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127012.982197:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982204:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982210:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982216:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009664d200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127012.982219:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982226:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982236:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127012.982239:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127012.982243:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982248:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982273:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982278:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982283:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982290:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009664dc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127012.982293:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982298:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982304:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e100) 00010000:00010000:0.0:1746127012.982305:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127012.982308:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982312:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:0.0:1746127012.982346:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664c400/0x34dc807b6efb9ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542ef expref: 24 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.982360:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6efb9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542ef expref: 23 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127012.982366:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127012.982368:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746127012.982370:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d400, rc 0) 00000100:00100000:0.0:1746127012.982421:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4662:x1830945991951616:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 641us (907us total) trans 8589938405 rc 0/0 00000100:00100000:0.0:1746127012.982427:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17431 00000100:00100000:0.0:1746127012.984478:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127012.984662:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991951744 00000100:00100000:2.0:1746127012.984670:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991951744 00000100:00100000:2.0:1746127012.984728:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1045 00000100:00100000:2.0:1746127012.984735:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991951744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127012.984748:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127012.984771:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6efb9c3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542ef expref: 23 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127012.984802:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127012.984806:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127012.984844:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991951744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127012.984850:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1045 00000100:00100000:0.0:1746127013.001338:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.001415:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991952000 00000100:00100000:2.0:1746127013.001424:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991952000 00000100:00100000:2.0:1746127013.001504:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17432 00000100:00100000:2.0:1746127013.001513:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+43:4666:x1830945991952000:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.001537:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.001559:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6efb9d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542f6 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746127013.001575:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746127013.001635:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001647:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001657:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001671:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001676:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001681:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001771:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6efb9e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001779:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6efb9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001783:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6efb9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127013.001791:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127013.001855:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001861:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001870:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001875:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009664dc00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.001878:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001884:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001897:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127013.001900:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.001904:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001908:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664dc00/0x34dc807b6efb9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001936:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001941:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001945:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001949:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009664d200 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.001951:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001955:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001965:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e100) 00010000:00010000:2.0:1746127013.001971:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.001973:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.001978:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d200/0x34dc807b6efb9df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.002022:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d400/0x34dc807b6efb9d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542f6 expref: 46 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.002033:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6efb9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542f6 expref: 45 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.002038:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.002040:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127013.002042:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d000, rc 0) 00000100:00100000:2.0:1746127013.002107:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4666:x1830945991952000:12345-192.168.203.42@tcp:101:cat.0 Request processed in 596us (779us total) trans 8589938406 rc 0/0 00000100:00100000:2.0:1746127013.002114:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17432 00000100:00100000:0.0:1746127013.002397:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.002488:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991952128 00000100:00100000:2.0:1746127013.002492:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991952128 00000100:00100000:2.0:1746127013.002513:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22341 00000100:00100000:2.0:1746127013.002518:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4659:x1830945991952128:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127013.002527:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.002537:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e542fd expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.002566:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.002574:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 17 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.002579:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.002581:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.002584:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 30 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.002612:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 17 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.002623:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 17 pid: 12340 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746127013.002635:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994371584:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.002723:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.002731:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 30 pid: 1964 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.002739:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994371712:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.002866:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.003833:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994371584:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.003842:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994371712:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.003862:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 30 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.003873:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664de00, rc 0) 00000100:00100000:2.0:1746127013.003905:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4659:x1830945991952128:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 1386us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.003911:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22341 00000100:00100000:0.0:1746127013.004981:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.005029:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.005043:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991952384 00000100:00100000:1.0:1746127013.005049:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991952384 00000100:00100000:0.0:1746127013.005062:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.005091:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6678 00000100:00100000:1.0:1746127013.005095:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4666:x1830945991952384:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746127013.005107:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.005155:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991952512 00000100:00100000:0.0:1746127013.005159:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991952512 00010000:00010000:0.0:1746127013.005189:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 18 pid: 12340 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746127013.005209:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991952640 00000100:00100000:0.0:1746127013.005211:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991952640 00000100:00100000:0.0:1746127013.005224:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991952768 00000100:00100000:0.0:1746127013.005226:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991952768 00010000:00010000:0.0:1746127013.005235:0:7246:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 30 pid: 1964 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.005249:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10514 00000100:00100000:0.0:1746127013.005253:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991952512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127013.005258:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4666:x1830945991952384:12345-192.168.203.42@tcp:35:cat.0 Request processed in 162us (281us total) trans 8589938407 rc 0/0 00000100:00100000:1.0:1746127013.005262:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6678 00010000:00010000:0.0:1746127013.005263:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746127013.005275:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10515 00000100:00100000:1.0:1746127013.005279:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2026:x1830945991952768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.005281:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 18 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.005283:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.005290:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 30 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.005292:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 18 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.005300:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 30 pid: 1964 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.005409:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1046 00000100:00100000:2.0:1746127013.005416:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991952640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1746127013.005421:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746127013.005424:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.005441:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009664d000/0x34dc807b6efb9e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542f6 expref: 46 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.005453:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.005456:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.005473:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2026:x1830945991952640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 58us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.005478:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1046 00010000:00010000:1.0:1746127013.006225:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bff200/0x34dc807b6efb7d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e541e5 expref: 30 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.006235:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.006235:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b9e600/0x34dc807b6efb87a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54240 expref: 18 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.006238:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.006244:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.006251:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.006260:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127013.006277:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 29 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.006285:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991952512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1030us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.006286:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994371840:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127013.006291:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10514 00000100:00100000:1.0:1746127013.006338:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.007881:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7247:1830945994371840:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127013.007884:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1746127013.007899:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.007939:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991952768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2658us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.007947:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10515 00000100:00100000:0.0:1746127013.008372:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.008414:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991953152 00000100:00100000:3.0:1746127013.008423:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991953152 00002000:00100000:3.0:1746127013.008478:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1761280->1765375) req@ffff880122387b80 x1830945991953152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.008488:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387b80 with x1830945991953152 ext(1761280->1765375) 00000100:00100000:2.0:1746127013.008488:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991952896 00002000:00010000:3.0:1746127013.008492:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122387b80 00000100:00100000:2.0:1746127013.008493:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991952896 00000100:00100000:3.0:1746127013.008522:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8980 00000100:00100000:3.0:1746127013.008528:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991953152:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127013.008645:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22342 00000100:00100000:2.0:1746127013.008653:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991952896:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.008662:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746127013.008696:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991953152:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 168us (323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127013.008702:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8980 00002000:00100000:3.0:1746127013.008706:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9e:0x0] (1761280->1765375) req@ffff880122387b80 x1830945991953152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.008713:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122387b80 with x1830945991953152 ext(1761280->1765375) 00002000:00010000:3.0:1746127013.008715:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880122387b80 00010000:00010000:2.0:1746127013.008730:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a44600/0x34dc807b6efb9fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54304 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.008772:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994371968:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127013.008833:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.012344:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.012376:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991953280 00000100:00100000:0.0:1746127013.012385:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991953280 00000100:00100000:0.0:1746127013.012428:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22343 00000100:00100000:0.0:1746127013.012435:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2029:x1830945991953280:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127013.012454:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.012477:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5430b expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.012500:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.012501:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.012511:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.012527:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 46 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.012538:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47e00, rc 0) 00000100:00100000:0.0:1746127013.012978:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991953280:12345-192.168.203.42@tcp:101:cat.0 Request processed in 541us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.012994:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22343 00002000:00010000:3.0:1746127013.013022:0:12333:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime: 1746127010 -> 1746127011 00002000:00010000:3.0:1746127013.013027:0:12333:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime: 1746127010 -> 1746127011 00002000:00010000:3.0:1746127013.013028:0:12333:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime: 1746127010 -> 1746127011 00000100:00100000:3.0:1746127013.013048:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994371968:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127013.013075:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a44600/0x34dc807b6efb9fb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54304 expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.013086:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a44600/0x34dc807b6efb9fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54304 expref: 30 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.013112:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a44600, rc 0) 00000100:00100000:3.0:1746127013.013677:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2028:x1830945991952896:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5023us (5793us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127013.013688:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22342 00000100:00100000:0.0:1746127013.017030:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.017808:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991953408 00000100:00100000:3.0:1746127013.017818:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991953408 00000100:00100000:3.0:1746127013.017892:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22344 00000100:00100000:3.0:1746127013.017901:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4662:x1830945991953408:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127013.017919:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.017938:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54312 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.017968:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.017976:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 21 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.017982:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.017984:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.017999:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 21 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.018029:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 21 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.018040:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 21 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746127013.018053:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994372096:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.018164:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.018176:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 45 pid: 1964 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.018183:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994372224:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127013.018206:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00080000:0.0:1746127013.018271:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746127013.018354:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.018494:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991953536 00000100:00100000:0.0:1746127013.018497:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991953536 00000100:00100000:0.0:1746127013.018533:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22345 00000100:00100000:0.0:1746127013.018539:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4659:x1830945991953536:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127013.018548:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.018559:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54319 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.018576:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 30 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.018583:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 16 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.018588:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.018589:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.018592:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 30 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.018608:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 16 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.018616:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 16 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.018624:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994372352:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127013.019031:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 30 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.019040:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 30 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.019048:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994372480:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127013.019069:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.022716:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.022730:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994372096:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127013.022741:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994372224:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.022747:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127013.022771:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 21 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.022788:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800809d7000, rc 0) 00000100:00100000:3.0:1746127013.022831:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+21:4662:x1830945991953408:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4932us (5810us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.022835:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991953792 00000100:00100000:3.0:1746127013.022840:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22344 00000100:00100000:0.0:1746127013.022842:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991953792 00000100:00100000:3.0:1746127013.022864:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991953664 00000100:00100000:3.0:1746127013.022866:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991953664 00010000:00010000:0.0:1746127013.022868:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 46 pid: 1964 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.022889:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10516 00000100:00100000:3.0:1746127013.022892:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22346 00000100:00100000:0.0:1746127013.022896:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991953792:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127013.022897:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4666:x1830945991953664:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127013.022907:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.022911:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.022922:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54320 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.022927:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 47 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.022935:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 48 pid: 1964 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.023057:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994372352:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.023086:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880122385f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994372480:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.023102:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 30 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.023113:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a47c00, rc 0) 00000100:00100000:2.0:1746127013.023158:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4659:x1830945991953536:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4618us (4807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.023164:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22345 00000100:00100000:1.0:1746127013.023196:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127013.023295:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.023302:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.023309:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127013.023312:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [1585152->2097151] (req 1585152->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.023338:0:12340:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.023350:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6ce00/0x34dc807b6efb8f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54286 expref: 48 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.023353:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 7 type: EXT [1585152->2097151] (req 1585152->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.023359:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127013.023360:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc32e00, rc 0) 00010000:00010000:0.0:1746127013.023365:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.023373:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991953920 00000100:00100000:3.0:1746127013.023376:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4666:x1830945991953664:12345-192.168.203.42@tcp:101:cat.0 Request processed in 478us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.023376:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991953920 00000100:00100000:3.0:1746127013.023381:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22346 00000100:00100000:0.0:1746127013.023381:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991953792:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 487us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.023387:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10516 00010000:00010000:1.0:1746127013.023389:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 21 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746127013.023396:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991954048 00000100:00100000:0.0:1746127013.023397:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991954048 00010000:00010000:0.0:1746127013.023405:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 30 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.023412:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10517 00000100:00100000:1.0:1746127013.023416:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2028:x1830945991953920:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127013.023420:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10518 00010000:00010000:1.0:1746127013.023422:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127013.023423:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991954048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.023429:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 21 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.023430:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.023437:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 21 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.023441:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 30 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.023447:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 30 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.023448:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a46400/0x34dc807b6efb953 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b0 expref: 21 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.023456:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.023458:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.023459:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a46200/0x34dc807b6efb976 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4825088->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542d3 expref: 30 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.023464:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.023465:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127013.023471:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.023477:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991954048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.023481:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10518 00010000:00010000:1.0:1746127013.023488:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.023499:0:10641:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.023522:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994372736:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127013.023561:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.024559:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.024747:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991954176 00000100:00100000:3.0:1746127013.024751:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991954176 00010000:00010000:3.0:1746127013.024769:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 17 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.024789:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10519 00000100:00100000:3.0:1746127013.024795:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991954176:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.025454:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.025540:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 17 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.025557:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 17 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.025578:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a6c200/0x34dc807b6efb97d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542da expref: 17 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.025594:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.025596:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.025602:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.025609:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.025649:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 28 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.025729:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994372864:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127013.025861:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.026031:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994372736:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127013.026045:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.026070:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991953920:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2652us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.026076:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10517 00000100:00100000:1.0:1746127013.026618:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.026694:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991954432 00000100:00100000:3.0:1746127013.026699:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991954432 00002000:00100000:3.0:1746127013.026734:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1687552->1691647) req@ffff880095c06a00 x1830945991954432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.026742:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06a00 with x1830945991954432 ext(1687552->1691647) 00010000:00010000:3.0:1746127013.026749:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.026761:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746127013.026768:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c06a00 00000100:00100000:3.0:1746127013.026782:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2004 00000100:00100000:3.0:1746127013.026787:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991954432:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127013.026905:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991954432:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 117us (287us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127013.026911:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2004 00002000:00100000:3.0:1746127013.026916:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1687552->1691647) req@ffff880095c06a00 x1830945991954432/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.026923:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06a00 with x1830945991954432 ext(1687552->1691647) 00010000:00010000:3.0:1746127013.026927:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.026935:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746127013.026940:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c06a00 00000100:00100000:3.0:1746127013.027670:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994372864:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127013.027683:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.028163:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991954176:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3365us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.028175:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10519 00000100:00100000:1.0:1746127013.031397:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.031446:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991954816 00000100:00100000:2.0:1746127013.031455:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991954816 00002000:00100000:2.0:1746127013.031502:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2428928->2433023) req@ffff880095c05c00 x1830945991954816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.031513:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c05c00 with x1830945991954816 ext(2428928->2433023) 00002000:00010000:2.0:1746127013.031518:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c05c00 00000100:00100000:2.0:1746127013.031554:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8981 00000100:00100000:2.0:1746127013.031562:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991954816:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127013.031717:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2026:x1830945991954816:12345-192.168.203.42@tcp:3:cat.0 Request processed in 155us (329us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127013.031724:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8981 00002000:00100000:2.0:1746127013.031730:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2428928->2433023) req@ffff880095c05c00 x1830945991954816/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.031737:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c05c00 with x1830945991954816 ext(2428928->2433023) 00002000:00010000:2.0:1746127013.031740:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c05c00 00000100:00100000:0.0:1746127013.032120:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.032797:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.033375:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991954944 00000100:00100000:3.0:1746127013.033382:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991954944 00002000:00100000:3.0:1746127013.033419:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1687552->2097151) req@ffff880122385f80 x1830945991954944/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.033428:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385f80 with x1830945991954944 ext(1687552->2097151) 00010000:00010000:3.0:1746127013.033437:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.033451:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746127013.033457:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880122385f80 00000100:00100000:3.0:1746127013.033873:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2005 00000100:00100000:3.0:1746127013.033881:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991954944:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127013.034238:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991955072 00000100:00100000:2.0:1746127013.034243:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991955072 00000100:00100000:2.0:1746127013.034510:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22347 00000100:00100000:2.0:1746127013.034516:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4662:x1830945991955072:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127013.034525:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.034542:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54327 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.034565:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.034572:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 23 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.034579:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.034581:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.034584:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.034614:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 23 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.034630:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 23 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746127013.034642:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994372992:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.034711:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 45 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.034719:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 45 pid: 1964 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.034727:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994373120:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.034744:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.037663:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994372992:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.037676:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994373120:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.037704:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.037721:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a45600, rc 0) 00000100:00100000:2.0:1746127013.037759:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4662:x1830945991955072:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3242us (4962us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.037767:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22347 00000100:00100000:3.0:1746127013.039257:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2028:x1830945991954944:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 5370us (7131us total) trans 17179875724 rc 0/0 00000100:00100000:3.0:1746127013.039267:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2005 00002000:00100000:3.0:1746127013.039278:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1687552->2097151) req@ffff880122385f80 x1830945991954944/t17179875724(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.039288:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122385f80 with x1830945991954944 ext(1687552->2097151) 00010000:00010000:3.0:1746127013.039296:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.039314:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746127013.039320:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880122385f80 00000100:00100000:0.0:1746127013.044960:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.045014:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.045535:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.045600:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991955200 00000100:00100000:0.0:1746127013.045600:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991955328 00000100:00100000:3.0:1746127013.045609:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991955200 00000100:00100000:0.0:1746127013.045609:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991955328 00000100:00100000:1.0:1746127013.045620:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991955456 00000100:00100000:1.0:1746127013.045624:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991955456 00010000:00010000:3.0:1746127013.045645:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 46 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.045645:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.045645:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 24 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.045683:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10520 00000100:00100000:3.0:1746127013.045688:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10521 00000100:00100000:1.0:1746127013.045690:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991955456:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127013.045692:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10522 00000100:00100000:3.0:1746127013.045693:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991955328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746127013.045696:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2027:x1830945991955200:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.045703:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.045703:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.045703:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.045720:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 24 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.045720:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.045720:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 46 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.045731:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 24 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.045731:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.045739:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 46 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.045751:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a47400/0x34dc807b6efb95a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542b7 expref: 24 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.045751:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800809d7000/0x34dc807b6efba09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54312 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.045754:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a6c400/0x34dc807b6efb8ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54294 expref: 46 pid: 1964 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.045767:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.045767:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.045769:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.045769:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.045776:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.045776:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.045784:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.045788:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.045795:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127013.045810:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 22 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.045810:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 45 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.045820:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994373376:192.168.203.42@tcp:105: 00000100:00100000:1.0:1746127013.045820:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994373248:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127013.045832:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2027:x1830945991955200:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 136us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.045839:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10522 00000100:00100000:3.0:1746127013.045872:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.046016:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.048797:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994373248:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127013.048819:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.048867:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991955456:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3177us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.048877:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10520 00000100:00100000:3.0:1746127013.048920:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994373376:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127013.048932:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.048949:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991955328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3256us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.048955:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10521 00000100:00100000:0.0:1746127013.049285:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.049320:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.049351:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991955840 00000100:00100000:3.0:1746127013.049358:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991955840 00002000:00100000:3.0:1746127013.049392:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1093632->1097727) req@ffff8800a2fcad80 x1830945991955840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.049403:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fcad80 with x1830945991955840 ext(1093632->1097727) 00002000:00010000:3.0:1746127013.049407:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fcad80 00000100:00100000:3.0:1746127013.049420:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991955968 00000100:00100000:3.0:1746127013.049422:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991955968 00002000:00100000:3.0:1746127013.049429:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1585152->2097151) req@ffff8800a2fc9880 x1830945991955968/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.049436:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9880 with x1830945991955968 ext(1585152->2097151) 00002000:00010000:3.0:1746127013.049439:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9880 00000100:00100000:3.0:1746127013.049448:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8982 00000100:00100000:3.0:1746127013.049453:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991955840:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127013.049495:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8983 00000100:00100000:0.0:1746127013.049503:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991955968:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127013.049570:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991955840:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 116us (286us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127013.049576:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8982 00002000:00100000:3.0:1746127013.049580:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa0:0x0] (1093632->1097727) req@ffff8800a2fcad80 x1830945991955840/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.049587:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fcad80 with x1830945991955840 ext(1093632->1097727) 00002000:00010000:3.0:1746127013.049589:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fcad80 00000100:00100000:0.0:1746127013.051836:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.051955:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991956224 00000100:00100000:3.0:1746127013.051963:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991956224 00000100:00100000:3.0:1746127013.052051:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6679 00000100:00080000:0.0:1746127013.052056:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746127013.052058:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+22:4662:x1830945991956224:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127013.052068:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:2028:x1830945991955968:12345-192.168.203.42@tcp:3:cat.0 Request processed in 2565us (2746us total) trans 0 rc 512000/512000 00000100:00100000:1.0:1746127013.052078:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8983 00002000:00100000:1.0:1746127013.052086:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1585152->2097151) req@ffff8800a2fc9880 x1830945991955968/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 512000/512000 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.052094:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a2fc9880 with x1830945991955968 ext(1585152->2097151) 00002000:00010000:1.0:1746127013.052099:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a2fc9880 00000100:00100000:3.0:1746127013.052377:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4662:x1830945991956224:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 318us (548us total) trans 8589938408 rc 0/0 00000100:00100000:3.0:1746127013.052383:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6679 00000100:00100000:0.0:1746127013.056976:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.057164:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991956352 00000100:00100000:2.0:1746127013.057174:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991956352 00000100:00100000:2.0:1746127013.057222:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22348 00000100:00100000:2.0:1746127013.057229:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4666:x1830945991956352:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.057247:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.057266:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5432e expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.057299:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.057306:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.057307:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.057311:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.057340:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.057351:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.057364:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994373504:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.058126:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.060329:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.060336:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994373504:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.060367:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.060381:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991956480 00010000:00010000:3.0:1746127013.060385:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664d000, rc 0) 00000100:00100000:1.0:1746127013.060387:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991956480 00002000:00100000:1.0:1746127013.060425:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1097727) req@ffff880122384a80 x1830945991956480/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.060433:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384a80 with x1830945991956480 ext(1048576->1097727) 00000100:00100000:3.0:1746127013.060437:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4666:x1830945991956352:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3207us (3471us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127013.060440:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 21 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.060448:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22348 00010000:00010000:1.0:1746127013.060451:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 21 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746127013.060457:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880122384a80 00000100:00100000:1.0:1746127013.060486:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2006 00000100:00100000:1.0:1746127013.060492:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991956480:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746127013.062639:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991956480:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 2141us (2312us total) trans 17179875725 rc 0/0 00000100:00100000:1.0:1746127013.062648:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2006 00002000:00100000:1.0:1746127013.062657:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->1097727) req@ffff880122384a80 x1830945991956480/t17179875725(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.062665:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880122384a80 with x1830945991956480 ext(1048576->1097727) 00010000:00010000:1.0:1746127013.062673:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.062688:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746127013.062694:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880122384a80 00000100:00100000:0.0:1746127013.063995:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.064114:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991956608 00000100:00100000:3.0:1746127013.064123:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991956608 00010000:00010000:3.0:1746127013.064180:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.064243:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10523 00000100:00100000:3.0:1746127013.064250:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991956608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.064267:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.064282:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.064292:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.064316:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a45600/0x34dc807b6efba1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54327 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.064430:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.064432:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.064439:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.064448:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.064480:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.064492:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994373632:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127013.065127:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.067479:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994373632:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127013.067505:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.067546:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880122384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2027:x1830945991956608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3295us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.067557:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10523 00000100:00100000:0.0:1746127013.068983:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.069057:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991956992 00000100:00100000:1.0:1746127013.069066:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991956992 00002000:00100000:1.0:1746127013.069107:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009942c700 x1830945991956992/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.069117:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c700 with x1830945991956992 ext(1048576->2097151) 00002000:00010000:1.0:1746127013.069123:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c700 00000100:00100000:1.0:1746127013.069503:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8984 00000100:00100000:1.0:1746127013.069511:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991956992:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127013.071082:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.071336:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991957120 00000100:00100000:3.0:1746127013.071343:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991957120 00002000:00100000:3.0:1746127013.071381:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1761279) req@ffff88007ede2680 x1830945991957120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.071391:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2680 with x1830945991957120 ext(1048576->1761279) 00002000:00010000:3.0:1746127013.071397:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede2680 00000100:00100000:3.0:1746127013.071420:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8985 00000100:00100000:3.0:1746127013.071427:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991957120:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127013.077945:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991956992:12345-192.168.203.42@tcp:3:cat.0 Request processed in 8423us (8955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127013.077957:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8984 00002000:00100000:1.0:1746127013.077969:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009942c700 x1830945991956992/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.077978:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c700 with x1830945991956992 ext(1048576->2097151) 00002000:00010000:1.0:1746127013.077984:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c700 00000100:00100000:3.0:1746127013.078949:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991957120:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7514us (7865us total) trans 0 rc 712704/712704 00000100:00100000:3.0:1746127013.078958:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8985 00002000:00100000:3.0:1746127013.078964:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->1761279) req@ffff88007ede2680 x1830945991957120/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 712704/712704 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.078972:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede2680 with x1830945991957120 ext(1048576->1761279) 00002000:00010000:3.0:1746127013.078977:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ede2680 00000100:00100000:0.0:1746127013.089763:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.089820:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.089888:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991957376 00000100:00100000:1.0:1746127013.089898:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991957376 00002000:00100000:1.0:1746127013.089945:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2433024->4194303) req@ffff88009942fb80 x1830945991957376/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.089955:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942fb80 with x1830945991957376 ext(2433024->4194303) 00002000:00010000:1.0:1746127013.089960:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942fb80 00000100:00100000:3.0:1746127013.089973:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991957632 00000100:00100000:3.0:1746127013.089977:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991957632 00002000:00100000:3.0:1746127013.090005:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009942f480 x1830945991957632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.090013:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f480 with x1830945991957632 ext(2097152->4194303) 00002000:00010000:3.0:1746127013.090016:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942f480 00000100:00100000:3.0:1746127013.090046:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8986 00000100:00100000:3.0:1746127013.090053:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991957632:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127013.090229:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8987 00000100:00100000:1.0:1746127013.090235:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991957376:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127013.098370:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.098526:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991957888 00000100:00100000:1.0:1746127013.098536:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991957888 00000100:00100000:1.0:1746127013.098584:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17433 00000100:00100000:1.0:1746127013.098592:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4671:x1830945991957888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.098618:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.098637:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120000/0x34dc807b6efba2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54335 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.098714:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098727:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098737:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098749:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098754:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098759:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098856:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6efba41 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098865:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6efba41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098872:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6efba41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127013.098884:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127013.098955:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098961:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098967:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098972:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.098977:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f121600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127013.098981:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099001:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099012:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127013.099014:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127013.099019:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099023:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f121600/0x34dc807b6efba33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099040:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099045:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099053:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099057:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f120a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127013.099059:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099064:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099070:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130829800) 00010000:00010000:1.0:1746127013.099072:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746127013.099074:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099078:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120a00/0x34dc807b6efba3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.099114:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120000/0x34dc807b6efba2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54335 expref: 26 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.099124:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6efba41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54335 expref: 25 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.099146:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.099148:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746127013.099150:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f120800, rc 0) 00000100:00100000:1.0:1746127013.099191:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4671:x1830945991957888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 600us (833us total) trans 8589938409 rc 0/0 00000100:00100000:1.0:1746127013.099197:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17433 00000100:00100000:3.0:1746127013.113503:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991957632:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23439us (23671us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746127013.113515:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8986 00002000:00100000:3.0:1746127013.113526:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff88009942f480 x1830945991957632/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.113535:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f480 with x1830945991957632 ext(2097152->4194303) 00002000:00010000:3.0:1746127013.113541:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942f480 00000100:00100000:2.0:1746127013.113828:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991957376:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23592us (24074us total) trans 0 rc 1761280/1761280 00000100:00100000:2.0:1746127013.113836:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8987 00002000:00100000:2.0:1746127013.113842:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2433024->4194303) req@ffff88009942fb80 x1830945991957376/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1761280/1761280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.113850:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942fb80 with x1830945991957376 ext(2433024->4194303) 00002000:00010000:2.0:1746127013.113854:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942fb80 00000100:00100000:0.0:1746127013.114937:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.115015:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991958144 00000100:00100000:3.0:1746127013.115023:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991958144 00000100:00100000:3.0:1746127013.115399:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6680 00000100:00100000:3.0:1746127013.115407:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4671:x1830945991958144:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746127013.115801:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.115833:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991958272 00000100:00100000:0.0:1746127013.115837:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991958272 00000100:00100000:0.0:1746127013.116584:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1047 00000100:00100000:0.0:1746127013.116593:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2026:x1830945991958272:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.116606:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127013.116835:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4671:x1830945991958144:12345-192.168.203.42@tcp:35:cat.0 Request processed in 1427us (1899us total) trans 8589938410 rc 0/0 00000100:00100000:3.0:1746127013.116842:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6680 00010000:00010000:0.0:1746127013.116925:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f120800/0x34dc807b6efba41 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54335 expref: 26 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.116946:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.116951:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.116969:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+25:2026:x1830945991958272:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 377us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.116976:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1047 00000100:00100000:0.0:1746127013.120010:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.120114:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.120218:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991958400 00000100:00100000:3.0:1746127013.120226:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991958400 00000100:00100000:1.0:1746127013.120233:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991958528 00000100:00100000:1.0:1746127013.120238:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991958528 00000100:00100000:1.0:1746127013.120281:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22349 00000100:00100000:1.0:1746127013.120288:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991958528:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.120307:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.120326:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54343 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.120349:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.120351:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.120359:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.120374:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.120384:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e980e00, rc 0) 00000100:00100000:1.0:1746127013.120443:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991958528:12345-192.168.203.42@tcp:101:cat.0 Request processed in 155us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.120448:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22349 00000100:00100000:1.0:1746127013.120463:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22350 00000100:00100000:1.0:1746127013.120468:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991958400:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.120474:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.120480:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5433c expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.120489:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.120491:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.120499:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.120507:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.120514:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e981a00, rc 0) 00000100:00100000:1.0:1746127013.120529:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991958400:12345-192.168.203.42@tcp:101:cat.0 Request processed in 61us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.120534:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22350 00000100:00100000:0.0:1746127013.120603:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.120629:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991958656 00000100:00100000:0.0:1746127013.120632:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991958656 00000100:00100000:0.0:1746127013.120656:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22351 00000100:00100000:0.0:1746127013.120661:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2027:x1830945991958656:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127013.120669:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.120678:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e983600/0x34dc807b6efba5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5434a expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.120718:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994373760:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127013.121005:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.121078:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.121332:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991958784 00000100:00100000:3.0:1746127013.121336:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991958784 00000100:00100000:3.0:1746127013.121427:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22352 00000100:00100000:3.0:1746127013.121433:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991958784:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127013.121440:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.121449:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6efba64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54351 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.121473:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994373888:192.168.203.42@tcp:106: 00000100:00100000:3.0:1746127013.122224:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.122337:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.122407:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994373760:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.122433:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e983600/0x34dc807b6efba5d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5434a expref: 19 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.122444:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e983600/0x34dc807b6efba5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5434a expref: 19 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.122459:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e983600, rc 0) 00000100:00100000:3.0:1746127013.122479:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991959040 00000100:00100000:3.0:1746127013.122483:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991959040 00002000:00100000:3.0:1746127013.122514:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009942e680 x1830945991959040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.122523:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942e680 with x1830945991959040 ext(4194304->4829183) 00002000:00010000:3.0:1746127013.122527:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942e680 00000100:00100000:3.0:1746127013.122546:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8988 00000100:00100000:3.0:1746127013.122553:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991959040:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127013.122609:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2027:x1830945991958656:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1946us (2005us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.122615:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22351 00000100:00100000:3.0:1746127013.123281:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994373888:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127013.123296:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6efba64 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54351 expref: 17 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.123305:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d2d2800/0x34dc807b6efba64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54351 expref: 17 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.123357:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d2d2800, rc 0) 00000100:00100000:3.0:1746127013.123377:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:2026:x1830945991958784:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1944us (2299us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127013.123382:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22352 00000100:00100000:3.0:1746127013.128324:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991959040:12345-192.168.203.42@tcp:3:cat.0 Request processed in 5757us (5974us total) trans 0 rc 634880/634880 00000100:00100000:3.0:1746127013.128340:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8988 00002000:00100000:3.0:1746127013.128352:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88009942e680 x1830945991959040/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.128362:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942e680 with x1830945991959040 ext(4194304->4829183) 00002000:00010000:3.0:1746127013.128367:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942e680 00000100:00100000:0.0:1746127013.133052:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.133480:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991959296 00000100:00100000:3.0:1746127013.133490:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991959296 00002000:00100000:3.0:1746127013.133542:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009942ea00 x1830945991959296/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.133552:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ea00 with x1830945991959296 ext(1048576->2097151) 00002000:00010000:3.0:1746127013.133557:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942ea00 00000100:00100000:3.0:1746127013.133588:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8989 00000100:00100000:3.0:1746127013.133596:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991959296:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127013.134592:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.134700:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991959552 00000100:00100000:2.0:1746127013.134705:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991959552 00002000:00100000:2.0:1746127013.134730:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009942f800 x1830945991959552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.134739:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f800 with x1830945991959552 ext(1048576->2097151) 00002000:00010000:2.0:1746127013.134743:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942f800 00000100:00100000:2.0:1746127013.134759:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8990 00000100:00100000:2.0:1746127013.134765:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991959552:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:3.0:1746127013.143656:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2027:x1830945991959296:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10048us (10601us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127013.143668:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8989 00002000:00100000:3.0:1746127013.143681:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009942ea00 x1830945991959296/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.143690:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ea00 with x1830945991959296 ext(1048576->2097151) 00002000:00010000:3.0:1746127013.143697:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942ea00 00000100:00100000:2.0:1746127013.145209:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991959552:12345-192.168.203.42@tcp:3:cat.0 Request processed in 10436us (10611us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127013.145221:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8990 00002000:00100000:2.0:1746127013.145229:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa0:0x0] (1048576->2097151) req@ffff88009942f800 x1830945991959552/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.145239:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942f800 with x1830945991959552 ext(1048576->2097151) 00002000:00010000:2.0:1746127013.145243:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942f800 00000100:00100000:2.0:1746127013.156528:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.156528:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.156587:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991959808 00000100:00100000:0.0:1746127013.156587:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991959936 00000100:00100000:2.0:1746127013.156596:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991959808 00000100:00100000:0.0:1746127013.156596:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991959936 00000100:00100000:2.0:1746127013.156653:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17434 00000100:00100000:0.0:1746127013.156653:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22353 00000100:00100000:2.0:1746127013.156660:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+45:4674:x1830945991959808:12345-192.168.203.42@tcp:101:multiop.0 00000100:00100000:0.0:1746127013.156660:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+16:4671:x1830945991959936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.156677:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.156677:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.156696:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efba6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54358 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.156696:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5435f expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.156743:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.156754:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127013.156756:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127013.156760:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 17 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.156770:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.156784:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127013.156793:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 28 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.156794:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:1.0:1746127013.156804:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 28 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.156806:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.156811:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.156816:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127013.156817:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994374016:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.156915:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6efba87 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.156924:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6efba87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.156929:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6efba87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:2.0:1746127013.156936:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127013.157015:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157025:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157031:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157037:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098672e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.157041:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157047:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157058:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127013.157061:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.157064:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157069:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098672e00/0x34dc807b6efba79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157083:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157087:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157092:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157096:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098673600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.157098:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157106:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157111:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662e100) 00010000:00010000:2.0:1746127013.157113:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.157115:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157119:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673600/0x34dc807b6efba80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:2.0:1746127013.157178:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673400/0x34dc807b6efba6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54358 expref: 48 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.157188:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6efba87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54358 expref: 47 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.157194:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.157196:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127013.157198:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673800, rc 0) 00000100:00100000:2.0:1746127013.157223:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4674:x1830945991959808:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 563us (706us total) trans 8589938411 rc 0/0 00000100:00100000:2.0:1746127013.157228:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17434 00000100:00100000:1.0:1746127013.157339:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.162853:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.162884:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.162919:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.162959:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991960448 00000100:00100000:0.0:1746127013.162967:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991960448 00000100:00100000:0.0:1746127013.163027:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1048 00000100:00100000:0.0:1746127013.163035:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2029:x1830945991960448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.163049:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.163075:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098673800/0x34dc807b6efba87 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54358 expref: 47 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.163093:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.163097:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.163152:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991960448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 118us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.163157:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1048 00000100:00100000:3.0:1746127013.163458:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991960320 00000100:00100000:3.0:1746127013.163462:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991960320 00000100:00100000:3.0:1746127013.163485:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6681 00000100:00100000:3.0:1746127013.163489:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4badc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4674:x1830945991960320:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127013.163644:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4badc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4674:x1830945991960320:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 154us (802us total) trans 8589938412 rc 0/0 00000100:00100000:3.0:1746127013.163649:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6681 00000100:00100000:2.0:1746127013.163916:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991960064 00000100:00100000:2.0:1746127013.163920:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991960064 00002000:00100000:2.0:1746127013.163952:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1761280->2097151) req@ffff88009942d500 x1830945991960064/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127013.163955:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994374016:192.168.203.42@tcp:104: 00002000:00100000:2.0:1746127013.163962:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d500 with x1830945991960064 ext(1761280->2097151) 00010000:00010000:2.0:1746127013.163971:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 29 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.163992:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 29 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746127013.163999:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942d500 00000100:00100000:2.0:1746127013.164021:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2007 00000100:00100000:2.0:1746127013.164027:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945991960064:12345-192.168.203.42@tcp:4:cat.0 00010000:00010000:1.0:1746127013.164297:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 17 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.164311:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664dc00, rc 0) 00000100:00100000:1.0:1746127013.164333:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4671:x1830945991959936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7673us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.164339:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22353 00000100:00100000:2.0:1746127013.173381:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991960064:12345-192.168.203.42@tcp:4:cat.0 Request processed in 9342us (10448us total) trans 21474843002 rc 0/0 00000100:00100000:2.0:1746127013.173395:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2007 00002000:00100000:2.0:1746127013.173407:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1761280->2097151) req@ffff88009942d500 x1830945991960064/t21474843002(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.173417:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d500 with x1830945991960064 ext(1761280->2097151) 00010000:00010000:2.0:1746127013.173428:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 31 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.173446:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 31 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746127013.173453:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942d500 00000100:00100000:0.0:1746127013.178484:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.179049:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991960576 00000100:00100000:2.0:1746127013.179059:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991960576 00010000:00010000:2.0:1746127013.179100:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 31 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.179164:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10524 00000100:00100000:2.0:1746127013.179173:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2029:x1830945991960576:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.179188:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.179208:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 31 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.179219:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 31 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.179241:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664de00/0x34dc807b6efb9f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542fd expref: 31 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.179276:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.179278:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.179286:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 16 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.179295:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 16 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.179329:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 16 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.179342:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994374144:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127013.179438:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.184631:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.184728:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991960704 00000100:00100000:1.0:1746127013.184737:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991960704 00000100:00100000:1.0:1746127013.184795:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22354 00000100:00100000:1.0:1746127013.184804:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:4674:x1830945991960704:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127013.184821:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.184840:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54366 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.184873:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.184881:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 47 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.184887:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.184889:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.184892:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3284992->3645439] (req 3284992->3645439) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.184922:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 47 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.184934:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 47 pid: 3148 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.184946:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994374272:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.185060:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 23 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.185068:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 23 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.185077:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994374400:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.185099:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.185825:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994374144:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127013.185844:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.185872:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945991960576:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 6700us (7397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.185881:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10524 00000100:00100000:1.0:1746127013.188064:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994374272:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.188075:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994374400:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.188100:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3284992->3645439] (req 3284992->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.188116:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f120a00, rc 0) 00000100:00100000:1.0:1746127013.188179:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4674:x1830945991960704:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 3375us (3558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.188186:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22354 00000100:00100000:0.0:1746127013.189885:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.190030:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991960960 00000100:00100000:2.0:1746127013.190039:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991960960 00002000:00100000:2.0:1746127013.190086:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009942dc00 x1830945991960960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.190095:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942dc00 with x1830945991960960 ext(1048576->2097151) 00002000:00010000:2.0:1746127013.190100:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942dc00 00000100:00100000:2.0:1746127013.191718:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8991 00000100:00100000:2.0:1746127013.191733:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991960960:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127013.196641:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.197456:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991961088 00000100:00100000:2.0:1746127013.197466:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991961088 00010000:00010000:2.0:1746127013.197610:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 47 pid: 3148 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746127013.198486:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10525 00000100:00100000:2.0:1746127013.198497:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991961088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.198511:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.198532:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 47 pid: 3148 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746127013.198545:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 47 pid: 3148 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746127013.198576:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a47e00/0x34dc807b6efba02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5430b expref: 47 pid: 3148 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746127013.198597:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.200258:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991961088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1754us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.200269:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10525 00000100:00100000:1.0:1746127013.201548:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.202221:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991961216 00000100:00100000:2.0:1746127013.202230:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991961216 00010000:00010000:2.0:1746127013.202260:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.202287:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10526 00000100:00100000:2.0:1746127013.202293:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991961216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.202306:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.202326:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.202336:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.202358:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf6200/0x34dc807b6efb984 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e542e1 expref: 24 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.202377:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.202380:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.202387:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.202395:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.202428:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 45 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.202440:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994374528:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127013.202737:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.202832:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2027:x1830945991960960:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11104us (12953us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127013.202840:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8991 00002000:00100000:2.0:1746127013.202848:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff88009942dc00 x1830945991960960/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.202857:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942dc00 with x1830945991960960 ext(1048576->2097151) 00002000:00010000:2.0:1746127013.202861:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942dc00 00000100:00100000:0.0:1746127013.204885:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.204960:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994374528:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127013.205002:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991961472 00000100:00100000:3.0:1746127013.205009:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991961472 00002000:00100000:3.0:1746127013.205054:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3284992->3289087) req@ffff88009942d180 x1830945991961472/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.205063:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d180 with x1830945991961472 ext(3284992->3289087) 00002000:00010000:3.0:1746127013.205068:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942d180 00000100:00100000:3.0:1746127013.205179:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8992 00000100:00100000:3.0:1746127013.205186:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991961472:12345-192.168.203.42@tcp:3:multiop.0 00010000:00010000:2.0:1746127013.205204:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.205243:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991961216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2949us (3699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.205250:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10526 00000100:00100000:3.0:1746127013.205300:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991961472:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 114us (422us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127013.205305:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8992 00002000:00100000:3.0:1746127013.205310:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3284992->3289087) req@ffff88009942d180 x1830945991961472/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.205317:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942d180 with x1830945991961472 ext(3284992->3289087) 00002000:00010000:3.0:1746127013.205320:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942d180 00000100:00100000:0.0:1746127013.208237:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.208348:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991961600 00000100:00100000:1.0:1746127013.208357:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991961600 00000100:00100000:1.0:1746127013.208454:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22355 00000100:00100000:1.0:1746127013.208465:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991961600:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.208482:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.208500:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967be400/0x34dc807b6efba9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5436d expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.208555:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994374656:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127013.208635:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.208745:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.209635:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991961728 00000100:00100000:0.0:1746127013.209639:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991961728 00000100:00100000:0.0:1746127013.209711:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22356 00000100:00100000:0.0:1746127013.209718:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991961728:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127013.209728:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.209739:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009664c200/0x34dc807b6efbaa3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54374 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.209762:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12333:1830945994374656:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127013.209769:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994374784:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.209785:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967be400/0x34dc807b6efba9c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5436d expref: 18 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.209801:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967be400/0x34dc807b6efba9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5436d expref: 18 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.209892:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967be400, rc 0) 00000100:00100000:0.0:1746127013.209977:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.210209:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9fe8879d-be98-4482-9466-43db8bbe4a76+17:2026:x1830945991961600:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1745us (1978us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.210216:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22355 00000100:00100000:2.0:1746127013.213037:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.213179:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991961984 00000100:00100000:0.0:1746127013.213187:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991961984 00002000:00100000:0.0:1746127013.213232:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3641344->3645439) req@ffff88007ede3800 x1830945991961984/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.213242:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3800 with x1830945991961984 ext(3641344->3645439) 00002000:00010000:0.0:1746127013.213247:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede3800 00000100:00100000:0.0:1746127013.213273:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8993 00000100:00100000:0.0:1746127013.213280:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991961984:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127013.215169:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2026:x1830945991961984:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 1880us (2131us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127013.215180:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8993 00002000:00100000:0.0:1746127013.215189:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0xa1:0x0] (3641344->3645439) req@ffff88007ede3800 x1830945991961984/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.215197:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ede3800 with x1830945991961984 ext(3641344->3645439) 00002000:00010000:0.0:1746127013.215202:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ede3800 00000100:00100000:1.0:1746127013.215382:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994374784:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.215416:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009664c200/0x34dc807b6efbaa3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54374 expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.215430:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664c200/0x34dc807b6efbaa3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54374 expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.215440:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009664c200, rc 0) 00000100:00100000:1.0:1746127013.215476:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991961728:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5757us (6731us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.215484:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22356 00000100:00100000:0.0:1746127013.218240:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.218336:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991962112 00000100:00100000:2.0:1746127013.218346:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991962112 00000100:00100000:2.0:1746127013.218388:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22357 00000100:00100000:2.0:1746127013.218396:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+17:4671:x1830945991962112:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.218414:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.218432:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5437b expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.218462:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 29 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.218468:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.218470:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.218473:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 18 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.218553:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 29 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.218566:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 29 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.218578:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994374912:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.219087:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.222970:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994374912:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.223016:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 18 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.223037:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098673000, rc 0) 00000100:00100000:2.0:1746127013.223098:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4671:x1830945991962112:12345-192.168.203.42@tcp:101:cat.0 Request processed in 4702us (4866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.223106:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22357 00000100:00100000:0.0:1746127013.223756:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.223818:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991962240 00000100:00100000:2.0:1746127013.223825:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991962240 00002000:00100000:2.0:1746127013.223924:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2433023) req@ffff88009942c000 x1830945991962240/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.223933:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c000 with x1830945991962240 ext(2097152->2433023) 00010000:00010000:2.0:1746127013.223940:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 30 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.223951:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 30 pid: 3148 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746127013.223956:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942c000 00000100:00100000:2.0:1746127013.224155:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2008 00000100:00100000:2.0:1746127013.224162:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991962240:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127013.230757:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991962240:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 6584us (6990us total) trans 21474843003 rc 0/0 00000100:00100000:2.0:1746127013.230771:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2008 00002000:00100000:2.0:1746127013.230784:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->2433023) req@ffff88009942c000 x1830945991962240/t21474843003(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.230799:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c000 with x1830945991962240 ext(2097152->2433023) 00010000:00010000:2.0:1746127013.230809:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 32 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.230825:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 32 pid: 3148 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746127013.230831:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009942c000 00000100:00100000:0.0:1746127013.236583:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.236973:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991962368 00000100:00100000:2.0:1746127013.236993:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991962368 00010000:00010000:2.0:1746127013.237035:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 32 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.237065:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10527 00000100:00100000:2.0:1746127013.237073:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991962368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.237087:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.237108:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 32 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.237119:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 32 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.237244:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a47c00/0x34dc807b6efba10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2433023) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54319 expref: 32 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.237277:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.237280:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.237287:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.237295:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.237333:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.237345:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994375040:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127013.237433:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.247542:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.247675:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.247690:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994375040:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127013.247715:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.247715:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991962624 00000100:00100000:0.0:1746127013.247721:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991962624 00002000:00100000:0.0:1746127013.247761:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009942ce00 x1830945991962624/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.247770:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ce00 with x1830945991962624 ext(2097152->3145727) 00002000:00010000:0.0:1746127013.247774:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942ce00 00000100:00100000:0.0:1746127013.247788:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991962752 00000100:00100000:0.0:1746127013.247790:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991962752 00002000:00100000:0.0:1746127013.247798:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (3284992->3645439) req@ffff88009942c380 x1830945991962752/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.247804:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c380 with x1830945991962752 ext(3284992->3645439) 00002000:00010000:0.0:1746127013.247807:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c380 00000100:00100000:0.0:1746127013.247816:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8994 00000100:00100000:0.0:1746127013.247821:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991962624:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127013.247850:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8995 00000100:00100000:2.0:1746127013.247858:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+46:2029:x1830945991962752:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:3.0:1746127013.247868:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991962368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10794us (11292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.247878:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10527 00000100:00100000:2.0:1746127013.258568:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991962752:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 10692us (10873us total) trans 17179875726 rc 0/0 00000100:00100000:2.0:1746127013.258581:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8995 00002000:00100000:2.0:1746127013.258595:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (3284992->3645439) req@ffff88009942c380 x1830945991962752/t17179875726(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.258604:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942c380 with x1830945991962752 ext(3284992->3645439) 00002000:00010000:2.0:1746127013.258609:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009942c380 00000100:00100000:1.0:1746127013.260650:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991962624:12345-192.168.203.42@tcp:3:cat.0 Request processed in 12820us (13109us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127013.260660:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8994 00002000:00100000:1.0:1746127013.260668:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->3145727) req@ffff88009942ce00 x1830945991962624/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.260681:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009942ce00 with x1830945991962624 ext(2097152->3145727) 00002000:00010000:1.0:1746127013.260687:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009942ce00 00000100:00100000:0.0:1746127013.266397:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.266466:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991962880 00000100:00100000:2.0:1746127013.266475:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991962880 00000100:00100000:2.0:1746127013.266529:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22358 00000100:00100000:2.0:1746127013.266537:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4671:x1830945991962880:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.266560:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.266580:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54382 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.266611:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.266619:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.266620:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.266623:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.266655:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.266666:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 47 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.266678:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994375168:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.267799:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.267828:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994375168:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.267852:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 24 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.267865:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebf200, rc 0) 00000100:00100000:2.0:1746127013.267897:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4671:x1830945991962880:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1359us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.267905:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22358 00000100:00100000:0.0:1746127013.269050:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.269237:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991963008 00000100:00100000:3.0:1746127013.269244:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991963008 00010000:00010000:3.0:1746127013.269278:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 48 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.269303:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10528 00000100:00100000:3.0:1746127013.269310:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991963008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.269323:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.269344:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 48 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.269355:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 48 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.269377:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f120a00/0x34dc807b6efba95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3645439) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54366 expref: 48 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.269407:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.269408:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.269414:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.269421:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.269450:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 23 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.269460:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994375296:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127013.269534:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.271006:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7245:1830945994375296:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127013.271025:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.271060:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991963008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1749us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.271069:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10528 00000100:00100000:0.0:1746127013.276949:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.277371:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991963264 00000100:00100000:3.0:1746127013.277379:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991963264 00000100:00100000:3.0:1746127013.277433:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17435 00000100:00100000:3.0:1746127013.277442:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+25:4677:x1830945991963264:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127013.277468:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746127013.277478:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1746127013.277491:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6efbab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54389 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.277511:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.277530:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991963520 00000100:00100000:1.0:1746127013.277533:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991963520 00002000:00100000:1.0:1746127013.277566:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880095c06300 x1830945991963520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746127013.277569:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00002000:00100000:1.0:1746127013.277575:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06300 with x1830945991963520 ext(2097152->4194303) 00002000:00010000:1.0:1746127013.277580:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c06300 00010000:00010000:3.0:1746127013.277582:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127013.277592:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991963776 00010000:00010000:3.0:1746127013.277593:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127013.277594:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991963776 00002000:00100000:1.0:1746127013.277605:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880095c07480 x1830945991963776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746127013.277610:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00002000:00100000:1.0:1746127013.277611:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07480 with x1830945991963776 ext(3145728->4194303) 00002000:00010000:1.0:1746127013.277614:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c07480 00010000:00010000:3.0:1746127013.277615:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277620:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000100:00100000:1.0:1746127013.277633:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8996 00000100:00100000:1.0:1746127013.277638:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991963520:12345-192.168.203.42@tcp:3:cat.0 00010000:00010000:3.0:1746127013.277719:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22800/0x34dc807b6efbacd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277728:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22800/0x34dc807b6efbacd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277734:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22800/0x34dc807b6efbacd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127013.277742:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127013.277813:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277819:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277826:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277832:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b22000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127013.277836:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277841:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277852:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127013.277855:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127013.277859:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277863:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22000/0x34dc807b6efbabf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277877:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277882:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277886:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277890:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880085b22c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127013.277892:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277897:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277903:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f100) 00010000:00010000:3.0:1746127013.277904:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127013.277906:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277910:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22c00/0x34dc807b6efbac6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.277944:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b23400/0x34dc807b6efbab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54389 expref: 28 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.277954:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22800/0x34dc807b6efbacd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54389 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.277960:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.277962:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127013.277965:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880085b22800, rc 0) 00000100:00100000:3.0:1746127013.278021:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4677:x1830945991963264:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 580us (1083us total) trans 8589938413 rc 0/0 00000100:00100000:3.0:1746127013.278027:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17435 00000100:00100000:3.0:1746127013.278051:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8997 00000100:00100000:3.0:1746127013.278056:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991963776:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127013.282047:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.282157:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991963904 00000100:00100000:3.0:1746127013.282167:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991963904 00000100:00100000:3.0:1746127013.282223:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1049 00000100:00100000:3.0:1746127013.282231:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:2028:x1830945991963904:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.282247:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.282274:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880085b22800/0x34dc807b6efbacd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54389 expref: 27 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.282292:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.282296:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.283619:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:2028:x1830945991963904:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1382us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.283630:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1049 00000100:00100000:3.0:1746127013.292899:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991963776:12345-192.168.203.42@tcp:3:cat.0 Request processed in 14827us (15371us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127013.292913:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8997 00002000:00100000:3.0:1746127013.292924:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (3145728->4194303) req@ffff880095c07480 x1830945991963776/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.292934:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c07480 with x1830945991963776 ext(3145728->4194303) 00002000:00010000:3.0:1746127013.292945:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c07480 00000100:00100000:1.0:1746127013.300047:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2027:x1830945991963520:12345-192.168.203.42@tcp:3:cat.0 Request processed in 22395us (22556us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127013.300060:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8996 00002000:00100000:1.0:1746127013.300071:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff880095c06300 x1830945991963520/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.300088:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c06300 with x1830945991963520 ext(2097152->4194303) 00002000:00010000:1.0:1746127013.300094:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c06300 00000100:00100000:0.0:1746127013.307555:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.308784:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991964160 00000100:00100000:1.0:1746127013.308795:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991964160 00002000:00100000:1.0:1746127013.308847:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a7c52300 x1830945991964160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.308857:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52300 with x1830945991964160 ext(4194304->4829183) 00002000:00010000:1.0:1746127013.308864:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c52300 00000100:00100000:1.0:1746127013.308905:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8998 00000100:00100000:1.0:1746127013.308913:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991964160:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127013.324351:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991964160:12345-192.168.203.42@tcp:3:cat.0 Request processed in 15426us (16794us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746127013.324365:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8998 00002000:00100000:1.0:1746127013.324377:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff8800a7c52300 x1830945991964160/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.324387:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c52300 with x1830945991964160 ext(4194304->4829183) 00002000:00010000:1.0:1746127013.324392:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c52300 00000100:00100000:0.0:1746127013.331790:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.331925:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991964416 00000100:00100000:2.0:1746127013.331934:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991964416 00000100:00100000:2.0:1746127013.332001:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17436 00000100:00100000:2.0:1746127013.332008:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4679:x1830945991964416:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127013.332033:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.332054:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efbadb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54390 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.332124:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332171:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332182:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332196:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332202:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332206:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332309:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4fce00/0x34dc807b6efbaf0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332319:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4fce00/0x34dc807b6efbaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332328:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4fce00/0x34dc807b6efbaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:2.0:1746127013.332336:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127013.332403:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332408:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332413:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332417:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332422:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebf600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.332425:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332430:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332438:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127013.332441:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.332444:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332447:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebf600/0x34dc807b6efbae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332473:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332480:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332484:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332488:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d2d2800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.332489:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332493:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332497:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b1bd1800) 00010000:00010000:2.0:1746127013.332499:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.332500:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332504:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d2d2800/0x34dc807b6efbae9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.332533:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebe400/0x34dc807b6efbadb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54390 expref: 50 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.332542:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4fce00/0x34dc807b6efbaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54390 expref: 49 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.332547:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.332548:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746127013.332550:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4fce00, rc 0) 00000100:00100000:2.0:1746127013.332597:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:4679:x1830945991964416:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 589us (817us total) trans 8589938414 rc 0/0 00000100:00100000:2.0:1746127013.332603:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17436 00000100:00100000:0.0:1746127013.336594:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.338062:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991964672 00000100:00100000:2.0:1746127013.338073:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991964672 00000100:00100000:2.0:1746127013.338171:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6682 00000100:00100000:2.0:1746127013.338180:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:4679:x1830945991964672:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127013.338418:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4679:x1830945991964672:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 239us (1832us total) trans 8589938415 rc 0/0 00000100:00100000:2.0:1746127013.338425:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6682 00000100:00100000:0.0:1746127013.338729:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.339010:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991964800 00000100:00100000:2.0:1746127013.339014:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991964800 00000100:00100000:2.0:1746127013.339243:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1050 00000100:00100000:2.0:1746127013.339248:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2029:x1830945991964800:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.339259:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.339283:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4fce00/0x34dc807b6efbaf0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54390 expref: 50 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.339298:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.339302:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.339716:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2029:x1830945991964800:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 467us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.339722:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1050 00000100:00100000:0.0:1746127013.356064:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.356171:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991964928 00000100:00100000:2.0:1746127013.356182:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991964928 00000100:00100000:2.0:1746127013.356229:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22359 00000100:00100000:2.0:1746127013.356235:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+18:4677:x1830945991964928:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127013.356257:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.356275:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54397 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.356306:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 19 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.356314:0:12340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 30 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.356321:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.356322:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.356325:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [278528->888831] (req 278528->888831) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.356357:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 30 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.356367:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 30 pid: 9611 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746127013.356379:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994375424:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.358332:0:12340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 19 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.358346:0:12340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 19 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.358364:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994375552:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.359387:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.361125:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.361222:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991965056 00000100:00100000:2.0:1746127013.361230:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991965056 00000100:00100000:2.0:1746127013.361427:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22360 00000100:00100000:2.0:1746127013.361434:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:4679:x1830945991965056:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127013.361453:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.361471:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5439e expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.361491:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:2.0:1746127013.361498:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.361508:0:12333:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 23 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.361513:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.361515:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.361518:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1335296->1548287] (req 1335296->1548287) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 48 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.361529:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991965312 00000100:00100000:0.0:1746127013.361532:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991965312 00010000:00010000:2.0:1746127013.361543:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 23 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.361552:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 23 pid: 12340 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746127013.361958:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994375680:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.362064:0:12333:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.362071:0:12333:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.362078:0:12333:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994375808:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.362096:0:12333:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.362302:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17437 00000100:00100000:0.0:1746127013.362310:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:4682:x1830945991965312:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127013.362326:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.362338:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3e00/0x34dc807b6efbb0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543a5 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.362405:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362489:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362501:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362513:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362518:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362522:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362623:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6efbb21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362632:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6efbb21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362636:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6efbb21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:0.0:1746127013.362646:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127013.362718:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362724:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362729:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362734:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362740:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011d9e3a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127013.362743:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362749:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362759:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127013.362761:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127013.362765:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362769:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3a00/0x34dc807b6efbb13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362796:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362801:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362810:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362814:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011d9e2400 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127013.362816:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362820:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362825:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58aa00) 00010000:00010000:0.0:1746127013.362827:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127013.362829:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362833:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e2400/0x34dc807b6efbb1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.362871:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3e00/0x34dc807b6efbb0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543a5 expref: 52 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.362881:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6efbb21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543a5 expref: 51 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.362887:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.362889:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746127013.362891:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011d9e3c00, rc 0) 00000100:00100000:0.0:1746127013.362936:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4682:x1830945991965312:12345-192.168.203.42@tcp:101:cat.0 Request processed in 627us (1444us total) trans 8589938416 rc 0/0 00000100:00100000:0.0:1746127013.362942:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17437 00000100:00100000:2.0:1746127013.369828:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994375424:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.369844:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12340:1830945994375552:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.369875:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [278528->888831] (req 278528->888831) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 19 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.369893:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3a000, rc 0) 00000100:00100000:2.0:1746127013.370294:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4677:x1830945991964928:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 14058us (14239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.370302:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22359 00000100:00100000:3.0:1746127013.371368:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994375680:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.371878:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.371905:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.371923:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.371946:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.372006:0:12333:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12333:1830945994375808:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.372035:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [1335296->1548287] (req 1335296->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 48 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.372049:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d3b4e00, rc 0) 00000100:00100000:3.0:1746127013.372081:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:4679:x1830945991965056:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 10647us (10964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.372087:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22360 00000100:00100000:0.0:1746127013.372456:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991965440 00000100:00100000:0.0:1746127013.372463:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991965440 00010000:00010000:0.0:1746127013.372503:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 19 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.372522:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991965696 00000100:00100000:0.0:1746127013.372524:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991965696 00010000:00010000:0.0:1746127013.372531:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.372541:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991965568 00000100:00100000:0.0:1746127013.372542:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991965568 00010000:00010000:0.0:1746127013.372549:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 24 pid: 12340 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746127013.372555:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991965824 00000100:00100000:0.0:1746127013.372557:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991965824 00010000:00010000:0.0:1746127013.372564:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 31 pid: 9611 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746127013.372572:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10529 00000100:00100000:0.0:1746127013.372577:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991965440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.372588:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.372608:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 19 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.372617:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 19 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.372643:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be42200/0x34dc807b6efb881 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5424e expref: 19 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.372664:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.372686:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991965440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 108us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.372691:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10529 00000100:00100000:0.0:1746127013.372702:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10530 00000100:00100000:0.0:1746127013.372706:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991965696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.372713:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.372725:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.372732:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.372744:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc32e00/0x34dc807b6efba17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54320 expref: 48 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.372754:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.372766:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991965696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 60us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.372771:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10530 00000100:00100000:0.0:1746127013.372801:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10531 00000100:00100000:0.0:1746127013.372805:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991965568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.372812:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.372817:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 24 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.372824:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 24 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.372835:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e981a00/0x34dc807b6efba56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5433c expref: 24 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.372843:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.372845:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.372851:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.372859:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.372885:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 46 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.372896:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994375936:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127013.372938:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d4840 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.372953:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10532 00000100:00100000:0.0:1746127013.372959:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2028:x1830945991965824:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.372965:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.372974:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 31 pid: 9611 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.372995:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 31 pid: 9611 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.373007:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bfec00/0x34dc807b6efb8b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54263 expref: 31 pid: 9611 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.373015:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.373016:0:7246:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.373020:0:7246:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.373027:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.373045:0:7246:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.373052:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7c50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994376064:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127013.373072:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.377687:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.377723:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.377791:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991966208 00000100:00100000:3.0:1746127013.377799:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991966208 00000100:00100000:0.0:1746127013.377819:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7246:1830945994376064:192.168.203.42@tcp:105: 00010000:00010000:0.0:1746127013.377839:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.377841:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6683 00000100:00100000:3.0:1746127013.377847:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4682:x1830945991966208:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1746127013.377876:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945991965824:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4918us (5929us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.377887:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10532 00000100:00100000:0.0:1746127013.377904:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991965952 00000100:00100000:0.0:1746127013.377906:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991965952 00000100:00100000:0.0:1746127013.377923:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1051 00000100:00100000:0.0:1746127013.377927:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2027:x1830945991965952:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.377934:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.377968:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011d9e3c00/0x34dc807b6efbb21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543a5 expref: 52 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.377994:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.377998:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.378011:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2027:x1830945991965952:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.378016:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1051 00000100:00100000:3.0:1746127013.378031:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4682:x1830945991966208:12345-192.168.203.42@tcp:35:cat.0 Request processed in 184us (307us total) trans 8589938417 rc 0/0 00000100:00100000:3.0:1746127013.378036:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6683 00000100:00100000:0.0:1746127013.378049:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.378098:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991966592 00000100:00100000:3.0:1746127013.378101:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991966592 00002000:00100000:3.0:1746127013.378125:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1335296->1339391) req@ffff8800a7c50380 x1830945991966592/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.378154:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50380 with x1830945991966592 ext(1335296->1339391) 00002000:00010000:3.0:1746127013.378158:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c50380 00000100:00100000:3.0:1746127013.378172:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8999 00000100:00100000:3.0:1746127013.378177:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991966592:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127013.378177:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.378194:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991966720 00000100:00100000:0.0:1746127013.378197:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991966720 00002000:00100000:0.0:1746127013.378212:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (278528->282623) req@ffff8800a7c53100 x1830945991966720/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.378218:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53100 with x1830945991966720 ext(278528->282623) 00002000:00010000:0.0:1746127013.378220:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53100 00000100:00100000:0.0:1746127013.378231:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9000 00000100:00100000:0.0:1746127013.378235:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991966720:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127013.378278:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991966592:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 101us (227us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127013.378279:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991966720:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 44us (101us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127013.378284:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8999 00000100:00100000:0.0:1746127013.378285:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9000 00002000:00100000:3.0:1746127013.378288:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1335296->1339391) req@ffff8800a7c50380 x1830945991966592/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.378289:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c:0x0] (278528->282623) req@ffff8800a7c53100 x1830945991966720/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.378294:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c50380 with x1830945991966592 ext(1335296->1339391) 00002000:00100000:0.0:1746127013.378294:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c53100 with x1830945991966720 ext(278528->282623) 00002000:00010000:0.0:1746127013.378296:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7c53100 00002000:00010000:3.0:1746127013.378297:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c50380 00000100:00100000:1.0:1746127013.378366:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a7c53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994375936:192.168.203.42@tcp:105: 00010000:00010000:1.0:1746127013.378384:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.378402:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991965568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5596us (6478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.378408:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10531 00000100:00100000:0.0:1746127013.384885:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.384961:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991966976 00000100:00100000:2.0:1746127013.384970:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991966976 00002000:00100000:2.0:1746127013.385027:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1544192->1548287) req@ffff8800a7c51180 x1830945991966976/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.385038:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51180 with x1830945991966976 ext(1544192->1548287) 00002000:00010000:2.0:1746127013.385044:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c51180 00000100:00100000:3.0:1746127013.386877:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.387172:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991967232 00000100:00100000:3.0:1746127013.387179:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991967232 00002000:00100000:3.0:1746127013.387214:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (884736->888831) req@ffff88009ab0df80 x1830945991967232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.387223:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0df80 with x1830945991967232 ext(884736->888831) 00002000:00010000:3.0:1746127013.387229:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0df80 00000100:00100000:0.0:1746127013.387238:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9001 00000100:00100000:3.0:1746127013.387269:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9002 00000100:00100000:3.0:1746127013.387274:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991967232:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:3.0:1746127013.387422:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2029:x1830945991967232:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 147us (550us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746127013.387432:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9002 00002000:00100000:3.0:1746127013.387438:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9c:0x0] (884736->888831) req@ffff88009ab0df80 x1830945991967232/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.387445:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ab0df80 with x1830945991967232 ext(884736->888831) 00002000:00010000:3.0:1746127013.387448:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ab0df80 00000100:00100000:0.0:1746127013.387755:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991966976:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:1.0:1746127013.388164:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2026:x1830945991966976:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 916us (3290us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746127013.388172:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9001 00002000:00100000:1.0:1746127013.388177:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1544192->1548287) req@ffff8800a7c51180 x1830945991966976/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.388184:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7c51180 with x1830945991966976 ext(1544192->1548287) 00002000:00010000:1.0:1746127013.388187:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a7c51180 00000100:00100000:0.0:1746127013.392255:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.392373:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991967488 00000100:00100000:3.0:1746127013.392382:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991967488 00000100:00100000:3.0:1746127013.392428:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6684 00000100:00100000:3.0:1746127013.392435:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+26:4677:x1830945991967488:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:3.0:1746127013.392690:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4677:x1830945991967488:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 254us (446us total) trans 8589938418 rc 0/0 00000100:00100000:3.0:1746127013.392697:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6684 00000100:00100000:0.0:1746127013.393372:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.393390:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.393405:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.393427:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.393461:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991967616 00000100:00100000:0.0:1746127013.393464:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991967616 00000100:00100000:0.0:1746127013.393490:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991967744 00000100:00100000:0.0:1746127013.393492:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991967744 00000100:00100000:0.0:1746127013.393711:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991967872 00000100:00100000:0.0:1746127013.393714:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991967872 00000100:00100000:2.0:1746127013.393740:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991968000 00000100:00100000:2.0:1746127013.393743:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991968000 00000100:00100000:2.0:1746127013.393766:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22361 00000100:00100000:2.0:1746127013.393771:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991967616:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.393783:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.393801:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbb2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543ac expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.393849:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376192:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127013.393908:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.393925:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22362 00000100:00100000:2.0:1746127013.393931:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991967744:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.393942:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.393949:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543b3 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.393961:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.393963:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.393971:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 34 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.393994:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 34 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.394003:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebf600, rc 0) 00000100:00100000:2.0:1746127013.394022:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2027:x1830945991967744:12345-192.168.203.42@tcp:101:cat.0 Request processed in 90us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.394028:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22362 00000100:00100000:2.0:1746127013.394039:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22363 00000100:00100000:2.0:1746127013.394043:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991967872:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.394048:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.394054:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543ba expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.394063:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.394064:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.394067:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 34 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.394076:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 34 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.394083:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3b600, rc 0) 00000100:00100000:2.0:1746127013.394098:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2026:x1830945991967872:12345-192.168.203.42@tcp:101:cat.0 Request processed in 54us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.394103:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22363 00000100:00100000:2.0:1746127013.394112:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22364 00000100:00100000:2.0:1746127013.394116:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+47:2027:x1830945991968000:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.394124:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.394161:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543c1 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.394173:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.394175:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.394179:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.395275:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 48 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.395283:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3be00, rc 0) 00000100:00100000:2.0:1746127013.395321:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2027:x1830945991968000:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1203us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.395327:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22364 00002000:00010000:2.0:1746127013.397667:0:1507:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime: 1746127011 -> 1746127012 00002000:00010000:2.0:1746127013.397674:0:1507:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127010 -> 1746127011 00002000:00010000:2.0:1746127013.397676:0:1507:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime: 1746127011 -> 1746127012 00000100:00100000:2.0:1746127013.397700:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376192:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127013.397733:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbb2f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ac expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.397747:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbb2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ac expref: 33 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.398779:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800967e5a00, rc 0) 00000100:00100000:2.0:1746127013.398850:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991967616:12345-192.168.203.42@tcp:101:cat.0 Request processed in 5076us (5476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127013.398858:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22361 00000100:00100000:0.0:1746127013.401486:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.401576:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991968128 00000100:00100000:2.0:1746127013.401586:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991968128 00000100:00100000:2.0:1746127013.402463:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22365 00000100:00100000:2.0:1746127013.402472:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4682:x1830945991968128:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.402490:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.402511:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543c8 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.402542:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.402550:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.402552:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.402556:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.402586:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 17 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.402597:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 17 pid: 12340 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.402609:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376320:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.403465:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.404842:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376320:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.404871:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.404888:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008bebee00, rc 0) 00000100:00100000:2.0:1746127013.404928:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4682:x1830945991968128:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2457us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.404937:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22365 00000100:00100000:0.0:1746127013.405273:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.405341:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991968256 00000100:00100000:1.0:1746127013.405348:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991968256 00002000:00100000:1.0:1746127013.405385:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (278528->888831) req@ffff8800a8ee9f80 x1830945991968256/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.405395:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9f80 with x1830945991968256 ext(278528->888831) 00010000:00010000:1.0:1746127013.405401:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 18 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.405412:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 18 pid: 12340 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746127013.405418:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8ee9f80 00000100:00100000:1.0:1746127013.405443:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2009 00000100:00100000:1.0:1746127013.405448:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+18:2026:x1830945991968256:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:1.0:1746127013.413532:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991968256:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8071us (8248us total) trans 21474843004 rc 0/0 00000100:00100000:1.0:1746127013.413545:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2009 00002000:00100000:1.0:1746127013.413558:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (278528->888831) req@ffff8800a8ee9f80 x1830945991968256/t21474843004(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.413566:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9f80 with x1830945991968256 ext(278528->888831) 00010000:00010000:1.0:1746127013.413577:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.413592:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746127013.413599:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8ee9f80 00000100:00100000:0.0:1746127013.416764:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.416896:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991968384 00000100:00100000:2.0:1746127013.416905:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991968384 00010000:00010000:2.0:1746127013.416942:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.416992:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10533 00000100:00100000:2.0:1746127013.416999:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991968384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.417013:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.417035:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.417046:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.417069:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbafe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 278528->888831) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54397 expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.417097:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.417100:0:7245:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.417108:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.417116:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.417192:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 32 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.417206:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994376448:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127013.417293:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.418618:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7245:1830945994376448:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127013.418637:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.418667:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991968384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1668us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.418675:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10533 00000100:00100000:0.0:1746127013.428547:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.428658:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991968640 00000100:00100000:1.0:1746127013.428667:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991968640 00002000:00100000:1.0:1746127013.428713:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a8eeb480 x1830945991968640/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.428725:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb480 with x1830945991968640 ext(0->1048575) 00002000:00010000:1.0:1746127013.428730:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8eeb480 00000100:00100000:1.0:1746127013.428759:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9003 00000100:00100000:1.0:1746127013.428766:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991968640:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127013.430973:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.431148:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991968896 00000100:00100000:2.0:1746127013.431156:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991968896 00002000:00100000:2.0:1746127013.431194:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a8eeb800 x1830945991968896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.431202:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb800 with x1830945991968896 ext(1048576->2097151) 00002000:00010000:2.0:1746127013.431207:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8eeb800 00000100:00100000:2.0:1746127013.431240:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9004 00000100:00100000:2.0:1746127013.431247:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991968896:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127013.434214:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.434768:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991969152 00000100:00100000:2.0:1746127013.434779:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991969152 00002000:00100000:2.0:1746127013.434822:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a8ee8a80 x1830945991969152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 504/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.434832:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee8a80 with x1830945991969152 ext(1048576->2097151) 00002000:00010000:2.0:1746127013.434838:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8ee8a80 00000100:00100000:2.0:1746127013.434917:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9005 00000100:00100000:2.0:1746127013.434925:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991969152:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127013.446054:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+35:2026:x1830945991968640:12345-192.168.203.42@tcp:3:cat.0 Request processed in 17276us (17504us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127013.446066:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9003 00002000:00100000:1.0:1746127013.446078:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff8800a8eeb480 x1830945991968640/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.446089:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb480 with x1830945991968640 ext(0->1048575) 00002000:00010000:1.0:1746127013.446095:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8eeb480 00000100:00100000:3.0:1746127013.450820:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991968896:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19562us (19842us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127013.450833:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9004 00002000:00100000:3.0:1746127013.450844:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9e:0x0] (1048576->2097151) req@ffff8800a8eeb800 x1830945991968896/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.450855:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eeb800 with x1830945991968896 ext(1048576->2097151) 00002000:00010000:3.0:1746127013.450861:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8eeb800 00000100:00100000:2.0:1746127013.455372:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991969152:12345-192.168.203.42@tcp:3:cat.0 Request processed in 20439us (21159us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746127013.455387:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9005 00002000:00100000:2.0:1746127013.455398:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff8800a8ee8a80 x1830945991969152/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 504/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.455406:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee8a80 with x1830945991969152 ext(1048576->2097151) 00002000:00010000:2.0:1746127013.455410:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8ee8a80 00000100:00100000:0.0:1746127013.469165:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.469209:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.469443:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991969536 00000100:00100000:3.0:1746127013.469451:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991969536 00002000:00100000:3.0:1746127013.469487:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a8ee9180 x1830945991969536/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.469496:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9180 with x1830945991969536 ext(2097152->4194303) 00002000:00010000:3.0:1746127013.469501:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee9180 00000100:00100000:3.0:1746127013.469845:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991969664 00000100:00100000:3.0:1746127013.469848:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991969664 00002000:00100000:3.0:1746127013.469860:0:9617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a8eea300 x1830945991969664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.469867:0:9617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eea300 with x1830945991969664 ext(2097152->4194303) 00002000:00010000:3.0:1746127013.469870:0:9617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8eea300 00000100:00100000:2.0:1746127013.469926:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9006 00000100:00100000:1.0:1746127013.469934:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9007 00000100:00100000:2.0:1746127013.469935:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991969536:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127013.469941:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991969664:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1746127013.489627:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2029:x1830945991969664:12345-192.168.203.42@tcp:3:cat.0 Request processed in 19677us (20407us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746127013.489639:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9007 00002000:00100000:1.0:1746127013.489650:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa1:0x0] (2097152->4194303) req@ffff8800a8eea300 x1830945991969664/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.489660:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8eea300 with x1830945991969664 ext(2097152->4194303) 00002000:00010000:1.0:1746127013.489666:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8eea300 00000100:00100000:2.0:1746127013.493326:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991969536:12345-192.168.203.42@tcp:3:cat.0 Request processed in 23380us (24192us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746127013.493338:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9006 00002000:00100000:2.0:1746127013.493350:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff8800a8ee9180 x1830945991969536/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.493359:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8ee9180 with x1830945991969536 ext(2097152->4194303) 00002000:00010000:2.0:1746127013.493365:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8ee9180 00000100:00100000:0.0:1746127013.504190:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.504349:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991969920 00000100:00100000:2.0:1746127013.504359:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991969920 00002000:00100000:2.0:1746127013.504411:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094e6fb80 x1830945991969920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.504428:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6fb80 with x1830945991969920 ext(4194304->4829183) 00002000:00010000:2.0:1746127013.504433:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6fb80 00000100:00100000:2.0:1746127013.504505:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9008 00000100:00100000:2.0:1746127013.504513:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991969920:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127013.509079:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991969920:12345-192.168.203.42@tcp:3:cat.0 Request processed in 4557us (4890us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127013.509089:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9008 00002000:00100000:2.0:1746127013.509100:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff880094e6fb80 x1830945991969920/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.509108:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6fb80 with x1830945991969920 ext(4194304->4829183) 00002000:00010000:2.0:1746127013.509114:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6fb80 00000100:00100000:0.0:1746127013.519543:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.519777:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991970176 00000100:00100000:3.0:1746127013.519785:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991970176 00000100:00100000:3.0:1746127013.519833:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17438 00000100:00100000:3.0:1746127013.519841:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:4689:x1830945991970176:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:3.0:1746127013.519868:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.519886:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbb52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543cf expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.519963:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.519976:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.519996:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520009:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520015:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520020:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520121:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efbb67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520159:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efbb67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520166:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efbb67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127013.520176:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127013.520246:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520252:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520258:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520263:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c7c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127013.520267:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520273:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520283:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127013.520285:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127013.520289:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520293:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7c00/0x34dc807b6efbb59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520323:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520327:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520331:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520335:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c6c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127013.520337:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520340:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520345:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929fb00) 00010000:00010000:3.0:1746127013.520347:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127013.520349:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520352:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbb60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.520387:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbb52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543cf expref: 54 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.520398:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efbb67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543cf expref: 53 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.520404:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.520406:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127013.520408:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c7e00, rc 0) 00000100:00100000:3.0:1746127013.520468:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:4689:x1830945991970176:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 627us (933us total) trans 8589938419 rc 0/0 00000100:00100000:3.0:1746127013.520474:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17438 00000100:00100000:2.0:1746127013.521042:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.521094:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991970432 00000100:00100000:0.0:1746127013.521099:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991970432 00000100:00100000:0.0:1746127013.521124:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17439 00000100:00100000:0.0:1746127013.521154:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+27:4688:x1830945991970432:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:0.0:1746127013.521168:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.521180:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35c00/0x34dc807b6efbb75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543d6 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.521217:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521224:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521231:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521239:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521244:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521248:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521295:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6efbb8a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521301:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6efbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521307:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6efbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:0.0:1746127013.521313:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:0.0:1746127013.521353:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521359:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521364:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521368:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521372:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35a00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127013.521374:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521379:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521385:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:0.0:1746127013.521387:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127013.521390:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521394:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35a00/0x34dc807b6efbb7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521406:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521414:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521417:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521420:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880077c35800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127013.521422:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521426:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521431:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88011f58aa00) 00010000:00010000:0.0:1746127013.521433:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746127013.521435:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521439:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35800/0x34dc807b6efbb83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.521462:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c35c00/0x34dc807b6efbb75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543d6 expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.521471:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6efbb8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543d6 expref: 29 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.521476:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.521478:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746127013.521480:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c34000, rc 0) 00000100:00100000:0.0:1746127013.521513:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4688:x1830945991970432:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 384us (472us total) trans 8589938420 rc 0/0 00000100:00100000:0.0:1746127013.521520:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17439 00000100:00100000:0.0:1746127013.526785:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.528969:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.529885:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991970944 00000100:00100000:2.0:1746127013.529897:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991970944 00000100:00100000:2.0:1746127013.530029:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991970560 00000100:00100000:2.0:1746127013.530032:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991970560 00000100:00100000:0.0:1746127013.530044:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.530065:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991970816 00000100:00100000:0.0:1746127013.530067:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991970816 00000100:00100000:0.0:1746127013.530089:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6685 00000100:00100000:1.0:1746127013.530090:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1052 00000100:00100000:0.0:1746127013.530096:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:4689:x1830945991970816:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:1.0:1746127013.530097:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2029:x1830945991970944:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.530111:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.530148:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7e00/0x34dc807b6efbb67 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543cf expref: 54 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.530168:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.530173:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.530215:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:2029:x1830945991970944:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 119us (3442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.530220:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1052 00000100:00100000:1.0:1746127013.530236:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1053 00000100:00100000:1.0:1746127013.530240:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2028:x1830945991970560:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.530246:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.530254:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c34000/0x34dc807b6efbb8a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543d6 expref: 29 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.530262:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.530264:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.530274:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+28:2028:x1830945991970560:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 33us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.530274:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:4689:x1830945991970816:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 179us (231us total) trans 8589938421 rc 0/0 00000100:00100000:1.0:1746127013.530279:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1053 00000100:00100000:0.0:1746127013.530280:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6685 00000100:00100000:0.0:1746127013.537029:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.537322:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991971072 00000100:00100000:2.0:1746127013.537333:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991971072 00000100:00100000:2.0:1746127013.538112:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22366 00000100:00100000:2.0:1746127013.538124:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:4688:x1830945991971072:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:2.0:1746127013.538177:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.538195:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543dd expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.538491:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 20 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.538694:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.538702:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.538703:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.538707:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2371584->2646015] (req 2371584->2646015) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.539122:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 32 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.539159:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 32 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746127013.539172:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376576:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.539520:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 20 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.539528:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.539756:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376704:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127013.539808:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.545280:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376704:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127013.545878:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994376576:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.545911:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2371584->2646015] (req 2371584->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.546443:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db3a000, rc 0) 00000100:00100000:3.0:1746127013.546502:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:4688:x1830945991971072:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 8381us (9482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.546510:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22366 00000100:00100000:0.0:1746127013.547595:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.549119:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991971200 00000100:00100000:3.0:1746127013.549140:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991971200 00010000:00010000:3.0:1746127013.549179:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 33 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746127013.549213:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10534 00000100:00100000:3.0:1746127013.549220:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991971200:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.549233:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.549251:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 33 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746127013.549261:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 33 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746127013.549283:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db3b600/0x34dc807b6efbb3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543ba expref: 33 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746127013.549309:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.549355:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991971200:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 136us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.549360:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10534 00000100:00100000:0.0:1746127013.553499:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.554936:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991971328 00000100:00100000:2.0:1746127013.554946:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991971328 00010000:00010000:2.0:1746127013.554995:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.555040:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10535 00000100:00100000:2.0:1746127013.555048:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991971328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.555062:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.555082:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.555094:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.555118:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098673000/0x34dc807b6efbaaa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5437b expref: 20 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.555182:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.555186:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.555193:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 19 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.555200:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 19 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.555240:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 19 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.555253:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994376832:192.168.203.42@tcp:105: 00000100:00100000:2.0:1746127013.555338:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bb3c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.558767:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994376832:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127013.558791:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.558845:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991971328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3796us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.558854:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10535 00000100:00100000:0.0:1746127013.561202:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.561279:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991971584 00000100:00100000:2.0:1746127013.561287:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991971584 00002000:00100000:2.0:1746127013.561333:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2371584->2375679) req@ffff880094e6d880 x1830945991971584/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.561343:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d880 with x1830945991971584 ext(2371584->2375679) 00002000:00010000:2.0:1746127013.561348:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6d880 00000100:00100000:2.0:1746127013.561472:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9009 00000100:00100000:2.0:1746127013.561481:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991971584:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127013.562039:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991971584:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 557us (841us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127013.562047:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9009 00002000:00100000:2.0:1746127013.562053:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2371584->2375679) req@ffff880094e6d880 x1830945991971584/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.562060:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e6d880 with x1830945991971584 ext(2371584->2375679) 00002000:00010000:2.0:1746127013.562063:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e6d880 00000100:00100000:0.0:1746127013.568258:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.568695:0:8221:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991971712 00000100:00100000:2.0:1746127013.568705:0:8221:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991971712 00000100:00100000:2.0:1746127013.568760:0:8221:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00100000:2.0:1746127013.568769:0:8221:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee06c75c-5a89-45a6-932b-08fb02e0019d+15:2029:x1830945991971712:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1746127013.568831:0:8221:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee06c75c-5a89-45a6-932b-08fb02e0019d+15:2029:x1830945991971712:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 62us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.568837:0:8221:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00100000:0.0:1746127013.569047:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.569117:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.569152:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.569166:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.569179:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.569192:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.569207:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991972480 00000100:00100000:0.0:1746127013.569210:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991972480 00000100:00100000:0.0:1746127013.569239:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991972352 00000100:00100000:0.0:1746127013.569241:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991972352 00000100:00100000:0.0:1746127013.569255:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 705 00000100:00100000:0.0:1746127013.569260:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991972480:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1746127013.569289:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2029:x1830945991972480:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.569295:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 705 00000100:00100000:0.0:1746127013.569304:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 706 00000100:00100000:0.0:1746127013.569308:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991972352:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1746127013.569325:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2029:x1830945991972352:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 17us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.569330:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 706 00000100:00080000:0.0:1746127013.569342:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746127013.569373:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.569429:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991971968 00000100:00100000:0.0:1746127013.569432:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991971968 00000100:00100000:0.0:1746127013.569455:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991972224 00000100:00100000:0.0:1746127013.569457:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991972224 00000100:00100000:0.0:1746127013.569466:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991971840 00000100:00100000:0.0:1746127013.569468:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991971840 00000100:00100000:0.0:1746127013.569478:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991972096 00000100:00100000:0.0:1746127013.569480:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991972096 00000100:00100000:0.0:1746127013.569494:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1175 00000100:00100000:0.0:1746127013.569499:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2029:x1830945991971968:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1746127013.569524:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2029:x1830945991971968:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.569529:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1175 00000100:00100000:0.0:1746127013.569538:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1176 00000100:00100000:0.0:1746127013.569542:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2029:x1830945991972224:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1746127013.569559:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2029:x1830945991972224:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 17us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.569564:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1176 00000100:00100000:0.0:1746127013.569571:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1177 00000100:00100000:0.0:1746127013.569575:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2029:x1830945991971840:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1746127013.569589:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+359:2029:x1830945991971840:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 14us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.569593:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1177 00000100:00100000:0.0:1746127013.569600:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1178 00000100:00100000:0.0:1746127013.569603:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991972096:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1746127013.569624:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2029:x1830945991972096:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 20us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.569628:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1178 00000100:00080000:0.0:1746127013.569641:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746127013.569643:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746127013.569697:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991972736 00000100:00100000:0.0:1746127013.569700:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991972736 00002000:00100000:0.0:1746127013.569722:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2641920->2646015) req@ffff88009d1b6680 x1830945991972736/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.569732:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6680 with x1830945991972736 ext(2641920->2646015) 00002000:00010000:0.0:1746127013.569738:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b6680 00000100:00100000:0.0:1746127013.569749:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9010 00000100:00100000:0.0:1746127013.569754:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991972736:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:0.0:1746127013.569849:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991972736:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 94us (476us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746127013.569855:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9010 00002000:00100000:0.0:1746127013.569859:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2641920->2646015) req@ffff88009d1b6680 x1830945991972736/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746127013.569866:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6680 with x1830945991972736 ext(2641920->2646015) 00002000:00010000:0.0:1746127013.569868:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b6680 00000100:00100000:0.0:1746127013.576894:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.577549:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.577585:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991973248 00000100:00100000:2.0:1746127013.577594:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991973248 00000100:00100000:3.0:1746127013.578702:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991972992 00000100:00100000:3.0:1746127013.578709:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991972992 00000100:00100000:3.0:1746127013.578749:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17440 00000100:00100000:3.0:1746127013.578756:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:4694:x1830945991972992:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127013.578778:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.578796:0:13448:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6200/0x34dc807b6efbb9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543e4 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.578865:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.578878:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.578888:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.578899:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.578905:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.578910:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579014:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbbb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579022:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579028:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00200000:3.0:1746127013.579039:0:13448:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127013.579098:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579104:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579109:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579114:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c7000 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127013.579118:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579123:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579145:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127013.579147:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127013.579150:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579155:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7000/0x34dc807b6efbba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579171:0:13448:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579176:0:13448:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579180:0:13448:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579186:0:13448:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c7800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127013.579188:0:13448:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579192:0:13448:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579196:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009929f900) 00010000:00010000:3.0:1746127013.579198:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127013.579199:0:13448:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579203:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c7800/0x34dc807b6efbbad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.579233:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6200/0x34dc807b6efbb9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543e4 expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.579242:0:13448:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543e4 expref: 31 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.579247:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.579248:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746127013.579250:0:13448:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6a00, rc 0) 00000100:00100000:3.0:1746127013.579288:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4694:x1830945991972992:12345-192.168.203.42@tcp:101:cat.0 Request processed in 533us (2408us total) trans 8589938422 rc 0/0 00000100:00100000:3.0:1746127013.579294:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17440 00000100:00100000:2.0:1746127013.580048:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6686 00000100:00100000:2.0:1746127013.580057:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4688:x1830945991973248:12345-192.168.203.42@tcp:35:multiop.0 00000100:00100000:2.0:1746127013.580175:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4688:x1830945991973248:12345-192.168.203.42@tcp:35:multiop.0 Request processed in 119us (2626us total) trans 8589938423 rc 0/0 00000100:00100000:2.0:1746127013.580181:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6686 00000100:00100000:3.0:1746127013.584639:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.584718:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.584830:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991973504 00000100:00100000:2.0:1746127013.584842:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991973504 00000100:00100000:0.0:1746127013.585176:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991973632 00000100:00100000:0.0:1746127013.585181:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991973632 00000100:00100000:0.0:1746127013.585223:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1054 00000100:00100000:0.0:1746127013.585232:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2028:x1830945991973632:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.585250:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.585495:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbbb4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543e4 expref: 32 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.585517:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.585522:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.585567:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+31:2028:x1830945991973632:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 336us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.585573:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1054 00000100:00100000:2.0:1746127013.585764:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6687 00000100:00100000:2.0:1746127013.585772:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+30:4694:x1830945991973504:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1746127013.586160:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+31:4694:x1830945991973504:12345-192.168.203.42@tcp:35:cat.0 Request processed in 388us (1534us total) trans 8589938424 rc 0/0 00000100:00100000:2.0:1746127013.586166:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6687 00000100:00100000:0.0:1746127013.589285:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.589330:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.589387:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991973888 00000100:00100000:1.0:1746127013.589396:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991973888 00000100:00100000:1.0:1746127013.589433:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991973760 00000100:00100000:1.0:1746127013.589435:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991973760 00000100:00100000:1.0:1746127013.589450:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22367 00000100:00100000:1.0:1746127013.589457:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991973888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.589473:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.589491:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009665d800/0x34dc807b6efbbc2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543f2 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.589545:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994376960:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127013.589626:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.589682:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22368 00000100:00100000:3.0:1746127013.589691:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2027:x1830945991973760:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1746127013.589700:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.589710:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543eb expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.589723:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.589725:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.589735:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.589750:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 20 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.589761:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6400, rc 0) 00000100:00100000:3.0:1746127013.589801:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2027:x1830945991973760:12345-192.168.203.42@tcp:101:cat.0 Request processed in 112us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.589807:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22368 00002000:00010000:1.0:1746127013.592276:0:3148:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime: 1746127011 -> 1746127012 00002000:00010000:1.0:1746127013.592286:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime: 1746127011 -> 1746127012 00002000:00010000:1.0:1746127013.592288:0:3148:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime: 1746127011 -> 1746127012 00000100:00100000:1.0:1746127013.592314:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994376960:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.592357:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009665d800/0x34dc807b6efbbc2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f2 expref: 24 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.592372:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009665d800/0x34dc807b6efbbc2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f2 expref: 24 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.592497:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665d800, rc 0) 00000100:00100000:1.0:1746127013.592658:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991973888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3200us (3381us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.592666:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22367 00000100:00100000:0.0:1746127013.600563:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.600635:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991974144 00000100:00100000:2.0:1746127013.600645:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991974144 00002000:00100000:2.0:1746127013.600694:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009d1b5f80 x1830945991974144/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.600708:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5f80 with x1830945991974144 ext(0->1048575) 00002000:00010000:2.0:1746127013.600714:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b5f80 00000100:00100000:2.0:1746127013.600764:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9011 00000100:00100000:2.0:1746127013.600774:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991974144:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127013.612148:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2028:x1830945991974144:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11211us (11430us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127013.612162:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9011 00002000:00100000:2.0:1746127013.612173:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (0->1048575) req@ffff88009d1b5f80 x1830945991974144/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.612182:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5f80 with x1830945991974144 ext(0->1048575) 00002000:00010000:2.0:1746127013.612188:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b5f80 00000100:00100000:0.0:1746127013.628687:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.629034:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991974272 00000100:00100000:1.0:1746127013.629043:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991974272 00000100:00100000:1.0:1746127013.629343:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22369 00000100:00100000:1.0:1746127013.629352:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+23:4694:x1830945991974272:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.629370:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.629394:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e543f9 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.629426:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.629433:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127013.629435:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746127013.629438:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 24 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.629467:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 47 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.629479:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 47 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.629491:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994377088:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.629593:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.636171:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.636291:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994377088:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.636321:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 24 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.636337:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665da00, rc 0) 00000100:00100000:1.0:1746127013.636379:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+24:4694:x1830945991974272:12345-192.168.203.42@tcp:101:cat.0 Request processed in 7029us (7707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.636388:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22369 00000100:00100000:2.0:1746127013.636708:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991974400 00000100:00100000:2.0:1746127013.636716:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991974400 00002000:00100000:2.0:1746127013.636758:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1335296->1548287) req@ffff88009d1b6300 x1830945991974400/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.636766:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6300 with x1830945991974400 ext(1335296->1548287) 00010000:00010000:2.0:1746127013.636773:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 48 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.636785:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 48 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746127013.636791:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b6300 00000100:00100000:2.0:1746127013.636807:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2010 00000100:00100000:2.0:1746127013.636813:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+48:2026:x1830945991974400:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:2.0:1746127013.648958:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991974400:12345-192.168.203.42@tcp:4:cat.0 Request processed in 12130us (12781us total) trans 17179875727 rc 0/0 00000100:00100000:2.0:1746127013.648973:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2010 00002000:00100000:2.0:1746127013.648998:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9f:0x0] (1335296->1548287) req@ffff88009d1b6300 x1830945991974400/t17179875727(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.649007:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b6300 with x1830945991974400 ext(1335296->1548287) 00010000:00010000:2.0:1746127013.649018:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 50 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.649033:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 50 pid: 12333 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746127013.649039:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d1b6300 00000100:00100000:0.0:1746127013.654512:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.654571:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991974528 00000100:00100000:3.0:1746127013.654580:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991974528 00010000:00010000:3.0:1746127013.654618:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 50 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.654653:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10536 00000100:00100000:3.0:1746127013.654661:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2029:x1830945991974528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.654675:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.654695:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 50 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.654707:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 50 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.654732:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d3b4e00/0x34dc807b6efbb05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->1548287) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5439e expref: 50 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.654766:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.654769:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.654776:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.654783:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.654817:0:7247:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.654828:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994377216:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127013.654924:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.657285:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7247:1830945994377216:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127013.657308:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.657351:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2029:x1830945991974528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2690us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.657362:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10536 00000100:00100000:0.0:1746127013.658349:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.658426:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991974656 00000100:00100000:2.0:1746127013.658505:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991974656 00002000:00100000:2.0:1746127013.658551:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2371584->2646015) req@ffff88009d1b5880 x1830945991974656/t0(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.658561:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5880 with x1830945991974656 ext(2371584->2646015) 00002000:00010000:2.0:1746127013.658567:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b5880 00000100:00100000:2.0:1746127013.658890:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9012 00000100:00100000:2.0:1746127013.658899:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2029:x1830945991974656:12345-192.168.203.42@tcp:4:cat.0 00000100:00100000:0.0:1746127013.662638:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.662749:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991974912 00000100:00100000:1.0:1746127013.662759:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991974912 00002000:00100000:1.0:1746127013.662805:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009d1b7b80 x1830945991974912/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.662815:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b7b80 with x1830945991974912 ext(1048576->2097151) 00002000:00010000:1.0:1746127013.662820:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b7b80 00000100:00100000:1.0:1746127013.662932:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9013 00000100:00100000:1.0:1746127013.662940:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991974912:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1746127013.664217:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2029:x1830945991974656:12345-192.168.203.42@tcp:4:cat.0 Request processed in 5309us (5861us total) trans 21474843005 rc 0/0 00000100:00100000:2.0:1746127013.664227:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9012 00002000:00100000:2.0:1746127013.664236:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9f:0x0] (2371584->2646015) req@ffff88009d1b5880 x1830945991974656/t21474843005(0) o4->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.664244:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b5880 with x1830945991974656 ext(2371584->2646015) 00002000:00010000:2.0:1746127013.664247:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b5880 00000100:00100000:1.0:1746127013.670188:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991974912:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7236us (7553us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127013.670205:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9013 00002000:00100000:1.0:1746127013.670216:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->2097151) req@ffff88009d1b7b80 x1830945991974912/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.670226:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b7b80 with x1830945991974912 ext(1048576->2097151) 00002000:00010000:1.0:1746127013.670231:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d1b7b80 00000100:00100000:0.0:1746127013.683239:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.683287:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991975168 00000100:00100000:1.0:1746127013.683296:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991975168 00002000:00100000:1.0:1746127013.683341:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009d1b4000 x1830945991975168/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 504/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.683351:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4000 with x1830945991975168 ext(2097152->4194303) 00002000:00010000:1.0:1746127013.683356:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b4000 00000100:00100000:1.0:1746127013.683379:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9014 00000100:00100000:1.0:1746127013.683385:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991975168:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127013.689088:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.689485:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991975296 00000100:00100000:1.0:1746127013.689495:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991975296 00000100:00100000:1.0:1746127013.689556:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22370 00000100:00100000:1.0:1746127013.689565:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4689:x1830945991975296:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127013.689584:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.689602:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54400 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.689633:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.689647:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 23 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.689653:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.689655:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.689658:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [307200->1048575] (req 307200->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.689691:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 23 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.689703:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 23 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.689714:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994377344:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.689825:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.689834:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.689842:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994377472:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.689860:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.694043:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994377344:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.694059:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994377472:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.694092:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [307200->1048575] (req 307200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.694110:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009665c000, rc 0) 00000100:00100000:1.0:1746127013.694188:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:4689:x1830945991975296:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 4623us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.694197:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22370 00000100:00100000:2.0:1746127013.695277:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2028:x1830945991975168:12345-192.168.203.42@tcp:3:cat.0 Request processed in 11888us (12045us total) trans 0 rc 1822720/1822720 00000100:00100000:2.0:1746127013.695288:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9014 00002000:00100000:2.0:1746127013.695298:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (2097152->4194303) req@ffff88009d1b4000 x1830945991975168/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 504/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 1822720/1822720 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746127013.695304:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00002000:00100000:2.0:1746127013.695308:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d1b4000 with x1830945991975168 ext(2097152->4194303) 00002000:00010000:2.0:1746127013.695313:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d1b4000 00000100:00100000:2.0:1746127013.695342:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991975552 00000100:00100000:2.0:1746127013.695348:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991975552 00010000:00010000:2.0:1746127013.695375:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 22 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.695387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.696736:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991975424 00000100:00100000:2.0:1746127013.696747:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991975424 00010000:00010000:2.0:1746127013.696774:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.696916:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10537 00000100:00100000:0.0:1746127013.696996:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991975552:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.697011:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.697032:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 22 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.697043:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 22 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.697066:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6400/0x34dc807b6efbbc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543eb expref: 22 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.697085:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.697118:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991975552:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 195us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.697123:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10537 00000100:00100000:0.0:1746127013.697151:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10538 00000100:00100000:0.0:1746127013.697155:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945991975424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.697161:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.697167:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.697179:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.697189:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebee00/0x34dc807b6efbb4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c8 expref: 33 pid: 1507 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.697196:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.697198:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.697204:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 32 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.697212:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 32 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.697239:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 32 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.697249:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994377600:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127013.697291:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429600 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.699016:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10641:1830945994377600:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127013.699063:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.699106:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945991975424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1948us (3716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.699114:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10538 00000100:00100000:0.0:1746127013.699467:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.699655:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991975808 00000100:00100000:2.0:1746127013.699661:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991975808 00002000:00100000:2.0:1746127013.699697:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (307200->311295) req@ffff88007ec45c00 x1830945991975808/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.699706:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec45c00 with x1830945991975808 ext(307200->311295) 00002000:00010000:2.0:1746127013.699711:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec45c00 00000100:00100000:2.0:1746127013.699736:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9015 00000100:00100000:2.0:1746127013.699742:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991975808:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127013.699977:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991975808:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 235us (510us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127013.699991:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9015 00002000:00100000:2.0:1746127013.699996:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9c:0x0] (307200->311295) req@ffff88007ec45c00 x1830945991975808/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.700003:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec45c00 with x1830945991975808 ext(307200->311295) 00002000:00010000:2.0:1746127013.700006:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec45c00 00000100:00100000:0.0:1746127013.704654:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.704921:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991975936 00000100:00100000:1.0:1746127013.704930:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991975936 00000100:00100000:1.0:1746127013.704993:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22371 00000100:00100000:1.0:1746127013.705001:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991975936:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.705023:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.705042:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbbde lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54407 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.705098:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994377728:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127013.705222:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00002000:00010000:1.0:1746127013.707758:0:3148:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime: 1746127011 -> 1746127012 00000100:00100000:1.0:1746127013.707786:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994377728:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.707818:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbbde lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54407 expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.707831:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbbde lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54407 expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.707862:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7200, rc 0) 00000100:00100000:1.0:1746127013.707914:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991975936:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2913us (3270us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.707923:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22371 00000100:00100000:0.0:1746127013.711436:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.711617:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991976064 00000100:00100000:1.0:1746127013.711628:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991976064 00000100:00100000:1.0:1746127013.711680:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22372 00000100:00100000:1.0:1746127013.711688:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:4689:x1830945991976064:12345-192.168.203.42@tcp:101:multiop.0 00010000:00010000:1.0:1746127013.711706:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.711724:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5440e expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.711755:0:3148:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.711762:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.711763:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.711767:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->1269759] (req 1048576->1269759) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.711798:0:3148:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 23 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.711809:0:3148:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 23 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.711827:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994377856:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.711922:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.713798:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.713929:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3148:1830945994377856:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.713954:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->1269759] (req 1048576->1269759) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.713969:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7a00, rc 0) 00000100:00100000:1.0:1746127013.714064:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:4689:x1830945991976064:12345-192.168.203.42@tcp:101:multiop.0 Request processed in 2374us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.714072:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22372 00000100:00100000:2.0:1746127013.714081:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991976320 00000100:00100000:2.0:1746127013.714087:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991976320 00002000:00100000:2.0:1746127013.714123:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ec46680 x1830945991976320/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.714156:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec46680 with x1830945991976320 ext(4194304->4829183) 00002000:00010000:2.0:1746127013.714161:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec46680 00000100:00100000:2.0:1746127013.714181:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9016 00000100:00100000:2.0:1746127013.714188:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991976320:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:0.0:1746127013.715095:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.715219:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991976448 00000100:00100000:3.0:1746127013.715225:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991976448 00010000:00010000:3.0:1746127013.715246:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 24 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.715277:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10539 00000100:00100000:3.0:1746127013.715282:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2026:x1830945991976448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.715292:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.715308:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 24 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.715317:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 24 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.715337:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009665da00/0x34dc807b6efbbd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543f9 expref: 24 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.715358:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.715359:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.715366:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 49 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.715374:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 49 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.715401:0:10641:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 49 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.715412:0:10641:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994377984:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127013.715484:0:10641:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.717790:0:10641:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10641:1830945994377984:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127013.717812:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.717860:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991976448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2576us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.717871:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10539 00000100:00100000:0.0:1746127013.720848:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.721572:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991976320:12345-192.168.203.42@tcp:3:cat.0 Request processed in 7382us (7776us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746127013.721585:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9016 00002000:00100000:2.0:1746127013.721596:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9f:0x0] (4194304->4829183) req@ffff88007ec46680 x1830945991976320/t0(0) o3->9fe8879d-be98-4482-9466-43db8bbe4a76@192.168.203.42@tcp:19/0 lens 488/440 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.721605:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec46680 with x1830945991976320 ext(4194304->4829183) 00002000:00010000:2.0:1746127013.721610:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007ec46680 00000100:00100000:2.0:1746127013.721630:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991976704 00000100:00100000:2.0:1746127013.721637:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991976704 00002000:00100000:2.0:1746127013.721813:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1265664->1269759) req@ffff88007ec47800 x1830945991976704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.721821:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec47800 with x1830945991976704 ext(1265664->1269759) 00002000:00010000:2.0:1746127013.721824:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec47800 00000100:00100000:2.0:1746127013.721852:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9017 00000100:00100000:2.0:1746127013.721858:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991976704:12345-192.168.203.42@tcp:3:multiop.0 00000100:00100000:2.0:1746127013.721962:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991976704:12345-192.168.203.42@tcp:3:multiop.0 Request processed in 104us (1120us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746127013.721967:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9017 00002000:00100000:2.0:1746127013.721973:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x9f:0x0] (1265664->1269759) req@ffff88007ec47800 x1830945991976704/t0(0) o3->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746127024 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746127013.721994:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007ec47800 with x1830945991976704 ext(1265664->1269759) 00002000:00010000:2.0:1746127013.721997:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007ec47800 00000100:00100000:0.0:1746127013.726320:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.726876:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991976832 00000100:00100000:1.0:1746127013.726886:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991976832 00000100:00100000:1.0:1746127013.726941:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22373 00000100:00100000:1.0:1746127013.726949:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991976832:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.726968:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.726996:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6a00/0x34dc807b6efbbec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54415 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.727040:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.727051:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994378112:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127013.727076:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991976960 00000100:00100000:2.0:1746127013.727080:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991976960 00000100:00100000:2.0:1746127013.727114:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22374 00000100:00100000:2.0:1746127013.727120:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991976960:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1746127013.727144:0:1507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.727161:0:1507:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d0e3800/0x34dc807b6efbbf3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5441c expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.727189:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.727198:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994378240:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127013.727225:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.729291:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1507:1830945994378240:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127013.729322:0:1507:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d0e3800/0x34dc807b6efbbf3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5441c expref: 24 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.729333:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d0e3800/0x34dc807b6efbbf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5441c expref: 24 pid: 1507 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.729347:0:1507:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d0e3800, rc 0) 00000100:00100000:2.0:1746127013.729383:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991976960:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2263us (2342us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127013.729393:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22374 00000100:00100000:1.0:1746127013.729627:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994378112:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.729645:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6a00/0x34dc807b6efbbec lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54415 expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.729657:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6a00/0x34dc807b6efbbec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54415 expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.729667:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6a00, rc 0) 00000100:00100000:1.0:1746127013.729700:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991976832:12345-192.168.203.42@tcp:101:cat.0 Request processed in 2751us (3570us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.729706:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22373 00000100:00100000:0.0:1746127013.732011:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.732061:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.732247:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991977088 00000100:00100000:1.0:1746127013.732255:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991977088 00000100:00100000:1.0:1746127013.732292:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991977216 00000100:00100000:1.0:1746127013.732295:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991977216 00000100:00100000:1.0:1746127013.732321:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22375 00000100:00100000:1.0:1746127013.732329:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991977088:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1746127013.732346:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.732362:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbbfa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54423 expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.732411:0:3148:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994378368:192.168.203.42@tcp:106: 00000100:00100000:1.0:1746127013.732488:0:3148:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.732536:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22376 00000100:00100000:0.0:1746127013.732543:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991977216:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:0.0:1746127013.732551:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.732563:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8df800/0x34dc807b6efbc01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5442a expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.732596:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994378496:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127013.732616:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429900 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.735238:0:3148:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3148:1830945994378368:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.735268:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbbfa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54423 expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.735280:0:3148:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbbfa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54423 expref: 22 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.735294:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6c00, rc 0) 00000100:00100000:1.0:1746127013.735332:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2027:x1830945991977088:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3003us (3329us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.735338:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22375 00000100:00100000:2.0:1746127013.735950:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994378496:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127013.735972:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8df800/0x34dc807b6efbc01 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5442a expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.735991:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df800/0x34dc807b6efbc01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5442a expref: 24 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.736013:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8df800, rc 0) 00000100:00100000:2.0:1746127013.736037:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2027:x1830945991977216:12345-192.168.203.42@tcp:101:cat.0 Request processed in 3495us (3976us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127013.736047:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22376 00000100:00100000:0.0:1746127013.746481:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.746692:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991977344 00000100:00100000:2.0:1746127013.746702:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991977344 00000100:00100000:2.0:1746127013.747839:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17441 00000100:00100000:2.0:1746127013.747850:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4698:x1830945991977344:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127013.747871:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.747893:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e3800/0x34dc807b6efbc08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54431 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.747957:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.747971:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.747991:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.748006:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.748013:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.748018:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.748086:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.748096:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 52 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.748102:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.748149:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 52 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.748160:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 52 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.748172:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994378624:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.748269:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.750045:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.750067:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994378624:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.750090:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:3.0:1746127013.750155:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991977600 00000100:00100000:3.0:1746127013.750161:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991977600 00000100:00100000:3.0:1746127013.750202:0:7261:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6688 00000100:00100000:3.0:1746127013.750209:0:7261:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:30904:x1830945991977600:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746127013.750788:0:7261:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:30904:x1830945991977600:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 578us (751us total) trans 8589938425 rc 0/0 00000100:00100000:3.0:1746127013.750795:0:7261:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6688 00000100:00100000:0.0:1746127013.752649:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.753315:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991977728 00000100:00100000:3.0:1746127013.753323:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991977728 00010000:00010000:3.0:1746127013.753357:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.753384:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10540 00000100:00100000:3.0:1746127013.753390:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2027:x1830945991977728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.753403:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.753409:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.753420:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.753446:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450dc00/0x34dc807b6efb826 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54216 expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.753460:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.753465:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.753475:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.753482:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.753976:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.754038:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:2027:x1830945991977728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 645us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.754045:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10540 00010000:00010000:2.0:1746127013.754166:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754178:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:2.0:1746127013.754231:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127013.754235:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127013.754252:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754262:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754273:0:7259:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754278:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754283:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754288:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754294:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d0e2600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.754298:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754304:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754311:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127013.754313:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.754317:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754323:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e2600/0x34dc807b6efbc0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754352:0:7259:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754356:0:7259:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754360:0:7259:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754364:0:7259:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008bebee00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127013.754366:0:7259:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754371:0:7259:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754377:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e7bca00) 00010000:00010000:2.0:1746127013.754379:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127013.754382:0:7259:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754385:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008bebee00/0x34dc807b6efbc16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.754415:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d0e3800/0x34dc807b6efbc08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.754427:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.754438:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.754440:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127013.754442:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644800, rc 0) 00000100:00100000:2.0:1746127013.754474:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4698:x1830945991977344:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6627us (8004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.754480:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17441 00000100:00100000:0.0:1746127013.756662:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.756778:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.756808:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.757255:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.757438:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.757453:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991977856 00000100:00100000:1.0:1746127013.757454:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991977984 00000100:00100000:2.0:1746127013.757461:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991977856 00000100:00100000:1.0:1746127013.757461:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991977984 00000100:00100000:3.0:1746127013.757502:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991978240 00000100:00100000:3.0:1746127013.757506:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991978240 00000100:00100000:0.0:1746127013.757697:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.757718:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991978112 00000100:00100000:1.0:1746127013.757718:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991978368 00000100:00100000:2.0:1746127013.757721:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991978112 00000100:00100000:1.0:1746127013.757722:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991978368 00000100:00100000:2.0:1746127013.757749:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22377 00000100:00100000:2.0:1746127013.757756:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2027:x1830945991977984:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127013.757775:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.757794:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c644600/0x34dc807b6efbc24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5443f expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.757848:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994378752:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127013.757916:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.757935:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22378 00000100:00100000:0.0:1746127013.758314:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991978496 00000100:00100000:0.0:1746127013.758318:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991978496 00000100:00100000:1.0:1746127013.758364:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22379 00000100:00100000:3.0:1746127013.758372:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22380 00000100:00100000:1.0:1746127013.758374:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991978240:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:3.0:1746127013.758379:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991978368:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127013.758382:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.758385:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.758392:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5444d expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.758393:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbc32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54454 expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.758405:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.758407:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.758416:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127013.758417:0:3542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994378880:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.758431:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 16 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.758439:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6e00, rc 0) 00000100:00100000:3.0:1746127013.758444:0:3542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.758459:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22381 00000100:00100000:1.0:1746127013.758464:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991978240:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 94us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.758465:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991978112:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:1.0:1746127013.758470:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22379 00010000:00010000:3.0:1746127013.758471:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.758478:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54446 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.758487:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.758488:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.758493:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.758502:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.758509:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6200, rc 0) 00000100:00100000:0.0:1746127013.758539:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22382 00000100:00100000:0.0:1746127013.758544:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991978496:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127013.758550:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.758555:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5445b expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.758568:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.758569:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.758573:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.758581:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 16 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.758586:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8de600, rc 0) 00000100:00100000:2.0:1746127013.758616:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991977856:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127013.758623:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.758630:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d147400/0x34dc807b6efbc47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54438 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.758650:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994379008:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127013.758733:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991978496:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 189us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.758738:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22382 00000100:00100000:2.0:1746127013.758992:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f780 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.759055:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991978112:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 255us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.759061:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22381 00002000:00010000:3.0:1746127013.760673:0:3542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime: 1746127011 -> 1746127012 00000100:00100000:0.0:1746127013.760737:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994379008:192.168.203.42@tcp:106: 00002000:00010000:3.0:1746127013.760754:0:3542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime: 1746127011 -> 1746127012 00002000:00010000:3.0:1746127013.760756:0:3542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime: 1746127011 -> 1746127012 00000100:00100000:3.0:1746127013.760764:0:3542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:3542:1830945994378880:192.168.203.42@tcp:106: 00010000:00010000:0.0:1746127013.760767:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d147400/0x34dc807b6efbc47 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54438 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.760777:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d147400/0x34dc807b6efbc47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54438 expref: 16 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.760778:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbc32 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54454 expref: 16 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.760791:0:3542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6c00/0x34dc807b6efbc32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54454 expref: 15 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.760791:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d147400, rc 0) 00010000:00010000:3.0:1746127013.760800:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6c00, rc 0) 00000100:00100000:2.0:1746127013.760868:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994378752:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127013.760883:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c644600/0x34dc807b6efbc24 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5443f expref: 14 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.760891:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c644600/0x34dc807b6efbc24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5443f expref: 14 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.760899:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c644600, rc 0) 00000100:00100000:3.0:1746127013.761016:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991978368:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2632us (3573us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127013.761023:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22380 00000100:00100000:2.0:1746127013.761054:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991977984:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3299us (4275us total) trans 0 rc 301/301 00000100:00100000:2.0:1746127013.761059:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22377 00000100:00100000:0.0:1746127013.761262:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991977856:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3320us (4605us total) trans 0 rc 301/301 00000100:00100000:0.0:1746127013.761267:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22378 00000100:00100000:0.0:1746127013.766364:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.766417:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991978752 00000100:00100000:2.0:1746127013.766426:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991978752 00000100:00100000:2.0:1746127013.766485:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17442 00000100:00100000:2.0:1746127013.766493:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4698:x1830945991978752:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127013.766512:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.766533:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146400/0x34dc807b6efbc4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54462 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.766636:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.766650:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.766657:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.766689:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.766699:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 10 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.766710:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994379136:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.766909:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.769541:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994379136:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127013.769573:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127013.769818:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.769908:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991978880 00000100:00100000:3.0:1746127013.769918:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991978880 00010000:00010000:3.0:1746127013.769948:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.772652:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10541 00000100:00100000:3.0:1746127013.772671:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991978880:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.772690:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.772701:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.772716:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.772741:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c644800/0x34dc807b6efbc1d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54431 expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.772757:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.772762:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.772772:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.772780:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.772820:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.772881:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2026:x1830945991978880:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 217us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.772888:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10541 00010000:00010000:1.0:1746127013.772988:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.772997:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127013.773017:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127013.773165:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d146400/0x34dc807b6efbc4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.773190:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.773197:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.773199:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746127013.773202:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5107000, rc 0) 00000100:00100000:1.0:1746127013.773225:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4698:x1830945991978752:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 6733us (6871us total) trans 8589938426 rc 0/0 00000100:00100000:1.0:1746127013.773231:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17442 00000100:00100000:0.0:1746127013.777506:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.777655:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991979008 00000100:00100000:1.0:1746127013.777665:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991979008 00000100:00100000:1.0:1746127013.777734:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17443 00000100:00100000:1.0:1746127013.777742:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4698:x1830945991979008:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127013.777768:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.777787:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6600/0x34dc807b6efbc63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54469 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.777877:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.777894:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.777901:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.777933:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.777943:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.777954:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994379264:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.778699:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1746127013.780334:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994379264:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.780358:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127013.781462:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.781515:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991979136 00000100:00100000:2.0:1746127013.781524:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991979136 00010000:00010000:2.0:1746127013.781562:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 12 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.781597:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10542 00000100:00100000:2.0:1746127013.781603:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991979136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.781615:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.781621:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 12 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.781633:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 12 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.781654:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5107000/0x34dc807b6efbc55 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54462 expref: 12 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.781678:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.781684:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.781693:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.781701:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.781723:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127013.781729:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127013.781764:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991979136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 160us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.781771:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10542 00010000:00010000:1.0:1746127013.781835:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127013.781883:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127013.781887:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127013.781903:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.781931:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6600/0x34dc807b6efbc63 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54469 expref: 11 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.781958:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54469 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.781964:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.781966:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127013.781969:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6000, rc 0) 00000100:00100000:1.0:1746127013.782015:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4698:x1830945991979008:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4273us (4519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.782022:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17443 00000100:00100000:0.0:1746127013.783525:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.783584:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991979264 00000100:00100000:2.0:1746127013.783591:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991979264 00000100:00100000:2.0:1746127013.783632:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22383 00000100:00100000:2.0:1746127013.783638:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991979264:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127013.783654:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.783670:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbc71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54470 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.783718:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994379392:192.168.203.42@tcp:106: 00000100:00100000:2.0:1746127013.783793:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.787313:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.787354:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.787704:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991979392 00000100:00100000:3.0:1746127013.787708:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994379392:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127013.787710:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991979392 00010000:00010000:3.0:1746127013.787744:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbc71 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54470 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127013.787750:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991979520 00000100:00100000:0.0:1746127013.787752:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991979520 00010000:00010000:3.0:1746127013.787757:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbc71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54470 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746127013.787766:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22384 00000100:00100000:0.0:1746127013.787773:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991979392:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127013.787789:0:12340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.787803:0:12340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efbc78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54477 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.787847:0:12340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994379520:192.168.203.42@tcp:106: 00010000:00010000:3.0:1746127013.787849:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800991e9c00, rc 0) 00000100:00100000:3.0:1746127013.787910:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991979264:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 4270us (4390us total) trans 0 rc 301/301 00000100:00100000:3.0:1746127013.787916:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22383 00000100:00100000:3.0:1746127013.787934:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22385 00000100:00100000:3.0:1746127013.787940:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991979520:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127013.787948:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.787957:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbc7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5447e expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.787993:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994379648:192.168.203.42@tcp:106: 00000100:00100000:0.0:1746127013.788102:0:12340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.788157:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746127013.789027:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994379648:192.168.203.42@tcp:106: 00010000:00010000:2.0:1746127013.789048:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbc7f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5447e expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.789057:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f7c6a00/0x34dc807b6efbc7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5447e expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.789067:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f7c6a00, rc 0) 00000100:00100000:1.0:1746127013.789073:0:12340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12340:1830945994379520:192.168.203.42@tcp:106: 00010000:00010000:1.0:1746127013.789089:0:12340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efbc78 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54477 expref: 14 pid: 12340 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127013.789093:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991979520:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1153us (1737us total) trans 0 rc 301/301 00010000:00010000:1.0:1746127013.789098:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dfa00/0x34dc807b6efbc78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54477 expref: 14 pid: 12340 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127013.789099:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22385 00010000:00010000:1.0:1746127013.789105:0:12340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dfa00, rc 0) 00000100:00100000:1.0:1746127013.789123:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2027:x1830945991979392:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1350us (1819us total) trans 0 rc 301/301 00000100:00100000:1.0:1746127013.789145:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22384 00000100:00100000:0.0:1746127013.792991:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.793423:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991979776 00000100:00100000:1.0:1746127013.793433:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991979776 00000100:00100000:1.0:1746127013.793486:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17444 00000100:00100000:1.0:1746127013.793494:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4698:x1830945991979776:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127013.793513:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.793532:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbc86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54485 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.793951:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbc8d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.793966:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbc8d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.794017:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbc8d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127013.794030:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:1.0:1746127013.794127:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbc86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54485 expref: 13 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.794181:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbc8d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54485 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.794188:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.794190:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746127013.794194:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6c00, rc 0) 00000100:00100000:1.0:1746127013.794242:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4698:x1830945991979776:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 748us (1271us total) trans 8589938427 rc 0/0 00000100:00100000:1.0:1746127013.794249:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17444 00000100:00100000:0.0:1746127013.797117:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.797186:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.797216:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.797237:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.797246:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991979904 00000100:00100000:2.0:1746127013.797246:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980032 00000100:00100000:0.0:1746127013.797249:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.797254:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991979904 00000100:00100000:2.0:1746127013.797254:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980032 00000100:00100000:0.0:1746127013.797277:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.797291:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980160 00000100:00100000:2.0:1746127013.797294:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980160 00000100:00100000:3.0:1746127013.797302:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980288 00000100:00100000:2.0:1746127013.797304:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980416 00000100:00100000:3.0:1746127013.797305:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980288 00000100:00100000:2.0:1746127013.797306:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980416 00000100:00100000:0.0:1746127013.797313:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980544 00000100:00100000:0.0:1746127013.797316:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980544 00000100:00100000:3.0:1746127013.797323:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22386 00000100:00100000:3.0:1746127013.797331:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991980032:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:2.0:1746127013.797332:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22387 00000100:00100000:2.0:1746127013.797337:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991979904:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:0.0:1746127013.797337:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22388 00000100:00100000:0.0:1746127013.797341:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991980160:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:3.0:1746127013.797368:0:1964:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.797368:0:16295:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.797368:0:9613:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.797383:0:16295:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 31 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.797384:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 49 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.797384:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 49 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.797390:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.797390:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746127013.797391:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.797392:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.797392:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746127013.797394:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.797394:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.797398:0:9613:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.797402:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.797403:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.797405:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.797421:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 49 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.797421:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 22 pid: 12340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.797422:0:16295:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 31 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.797431:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 22 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746127013.797432:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 49 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.797433:0:16295:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 31 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.797442:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994379776:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127013.797442:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994379904:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.797444:0:16295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994380032:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.797527:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22389 00000100:00100000:1.0:1746127013.797535:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991980288:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:1.0:1746127013.797553:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.797566:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.797572:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.797579:0:9612:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.797584:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.797585:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.797587:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.797602:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 31 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.797610:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 31 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.797618:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994380160:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127013.797965:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127013.797975:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746127013.797991:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994380288:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.798009:0:16295:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.798017:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2780 going to sleep for 11 seconds 00010000:00010000:0.0:1746127013.798026:0:9613:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 49 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.798028:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22390 00000100:00100000:2.0:1746127013.798034:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991980416:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:0.0:1746127013.798034:0:9613:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 49 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.798039:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22391 00000100:00100000:0.0:1746127013.798041:0:9613:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994380416:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127013.798046:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991980544:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127013.798052:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.798056:0:9613:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429840 going to sleep for 11 seconds 00010000:00010000:2.0:1746127013.798063:0:1507:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.798068:0:11152:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.798069:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.798071:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746127013.798073:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.798078:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 22 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.798084:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127013.798088:0:1507:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 20 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.798091:0:11152:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 49 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.798096:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.798096:0:1507:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 20 pid: 1507 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.798098:0:11152:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.798100:0:11152:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.798105:0:1507:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994380544:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.798117:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 49 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.798124:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 49 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746127013.798145:0:1507:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c31fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746127013.798150:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994380672:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.798189:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 15 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.798201:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 15 pid: 9613 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746127013.798209:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994380800:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.798254:0:11152:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 22 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.798261:0:11152:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 22 pid: 12340 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.798269:0:11152:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994380928:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127013.798287:0:11152:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007eda2000 going to sleep for 11 seconds 00010000:00010000:1.0:1746127013.799211:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 15 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.799222:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 15 pid: 9611 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.799236:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994381056:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.799265:0:9612:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 20 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.799273:0:9612:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.799280:0:9612:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994381184:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.799294:0:9612:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.802831:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.802963:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994380672:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127013.803000:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980800 00000100:00100000:3.0:1746127013.803006:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980800 00002000:00100000:3.0:1746127013.803050:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1269759) req@ffff8800a5b98e00 x1830945991980800/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.803060:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98e00 with x1830945991980800 ext(1048576->1269759) 00010000:00010000:3.0:1746127013.803073:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.803086:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746127013.803097:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b98e00 00000100:00100000:3.0:1746127013.803118:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2011 00000100:00100000:3.0:1746127013.803125:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2029:x1830945991980800:12345-192.168.203.42@tcp:4:multiop.0 00000100:00100000:2.0:1746127013.803334:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994379904:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.803346:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994380288:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.803353:0:9613:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b98700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9613:1830945994380416:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.803377:0:9613:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.803399:0:1507:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1507:1830945994380544:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.803413:0:1507:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.803789:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994379776:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.803801:0:1964:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.803865:0:16295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16295:1830945994380032:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127013.803876:0:16295:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.803913:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.804186:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994380160:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127013.804195:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994381056:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127013.804202:0:9612:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9612:1830945994381184:192.168.203.42@tcp:104: 00010000:00010000:0.0:1746127013.804218:0:9612:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.804354:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981312 00000100:00100000:3.0:1746127013.804358:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981312 00010000:00010000:3.0:1746127013.804380:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 16 pid: 9613 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746127013.804397:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10543 00000100:00100000:3.0:1746127013.804402:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991981312:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.804411:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.804424:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 16 pid: 9613 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746127013.804433:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 16 pid: 9613 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746127013.804457:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.804476:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991981312:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 73us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.804481:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10543 00010000:00010000:2.0:1746127013.805499:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8de600/0x34dc807b6efbc40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5445b expref: 15 pid: 9613 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746127013.805516:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994380800:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.805525:0:11152:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11152:1830945994380928:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.805543:0:11152:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.805835:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.805908:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.805924:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.805941:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.805947:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981824 00000100:00100000:3.0:1746127013.805952:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981824 00000100:00100000:1.0:1746127013.805954:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.805968:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980928 00000100:00100000:1.0:1746127013.805970:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980928 00010000:00010000:3.0:1746127013.805972:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 23 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.805996:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746127013.806004:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981184 00000100:00100000:3.0:1746127013.806006:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981184 00000100:00100000:1.0:1746127013.806006:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981568 00000100:00100000:1.0:1746127013.806007:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981568 00010000:00010000:3.0:1746127013.806014:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 24 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806015:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 52 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746127013.806021:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981952 00000100:00100000:3.0:1746127013.806023:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981952 00000100:00100000:1.0:1746127013.806025:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10544 00010000:00010000:3.0:1746127013.806031:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 32 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.806031:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+24:2029:x1830945991981824:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.806038:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127013.806039:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10545 00000100:00100000:3.0:1746127013.806043:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991980928:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.806048:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.806048:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 24 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.806054:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806056:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 24 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.806060:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746127013.806072:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6200/0x34dc807b6efbc39 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54446 expref: 15 pid: 1964 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806073:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bebf200/0x34dc807b6efbab1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54382 expref: 24 pid: 12340 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.806092:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.806117:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2029:x1830945991981824:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.806118:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10546 00000100:00100000:1.0:1746127013.806122:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10544 00000100:00100000:2.0:1746127013.806123:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991981184:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746127013.806158:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10547 00000100:00100000:1.0:1746127013.806163:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+52:2026:x1830945991981568:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.806169:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.806176:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 52 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806184:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 52 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806195:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db3be00/0x34dc807b6efbb44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543c1 expref: 52 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746127013.806205:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10548 00010000:00010000:1.0:1746127013.806207:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.806209:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746127013.806211:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2026:x1830945991981952:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.806213:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.806217:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.806220:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.806229:0:7246:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 32 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806237:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127013.806237:0:7246:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 32 pid: 3542 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746127013.806248:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008bebf600/0x34dc807b6efbb36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543b3 expref: 32 pid: 3542 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.806251:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2026:x1830945991981568:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.806256:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10547 00010000:00010000:0.0:1746127013.806259:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.806272:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991981952:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 61us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.806277:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10548 00000100:00100000:1.0:1746127013.806285:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.806312:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.806329:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.806380:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981056 00000100:00100000:1.0:1746127013.806382:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.806383:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981056 00000100:00100000:1.0:1746127013.806393:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981440 00000100:00100000:1.0:1746127013.806395:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981440 00010000:00010000:0.0:1746127013.806395:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 51 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.806404:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991981696 00010000:00010000:1.0:1746127013.806406:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 21 pid: 1507 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.806406:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991981696 00010000:00010000:0.0:1746127013.806413:0:26073:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 16 pid: 9611 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746127013.806415:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10549 00000100:00100000:1.0:1746127013.806419:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2026:x1830945991981056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.806425:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746127013.806426:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10550 00010000:00010000:1.0:1746127013.806430:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 51 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.806430:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991981440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127013.806434:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127013.806441:0:26073:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 21 pid: 1507 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.806442:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 51 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.806447:0:26073:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 21 pid: 1507 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.806452:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009664d000/0x34dc807b6efba25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5432e expref: 51 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746127013.806458:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db3a000/0x34dc807b6efbb98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2371584->2646015) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e543dd expref: 21 pid: 1507 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.806460:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127013.806465:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.806466:0:26073:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.806469:0:26073:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.806474:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2026:x1830945991981056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 55us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127013.806475:0:26073:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.806480:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10549 00010000:00010000:0.0:1746127013.806490:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127013.806501:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991981440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.806505:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10551 00000100:00100000:0.0:1746127013.806508:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10550 00000100:00100000:1.0:1746127013.806509:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991981696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127013.806514:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.806521:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 16 pid: 9611 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806528:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 16 pid: 9611 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806539:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6e00/0x34dc807b6efbc2b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5444d expref: 16 pid: 9611 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746127013.806546:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127013.806561:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991981696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.806568:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10551 00000100:00100000:1.0:1746127013.806588:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991980672 00000100:00100000:1.0:1746127013.806591:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991980672 00010000:00010000:3.0:1746127013.806603:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746127013.806613:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (307200->1048575) req@ffff880130a75500 x1830945991980672/t0(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/0 e 0 to 0 dl 1746127024 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746127013.806618:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991980928:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 574us (710us total) trans 0 rc 0/0 00002000:00100000:1.0:1746127013.806621:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75500 with x1830945991980672 ext(307200->1048575) 00000100:00100000:3.0:1746127013.806623:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10545 00010000:00010000:1.0:1746127013.806627:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 31 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.806634:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 31 pid: 3148 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746127013.806640:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a75500 00000100:00100000:1.0:1746127013.806652:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2012 00010000:00010000:3.0:1746127013.806654:0:1507:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.806656:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2026:x1830945991980672:12345-192.168.203.42@tcp:4:multiop.0 00010000:00010000:3.0:1746127013.806660:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806674:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806680:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806686:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806691:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e8200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127013.806694:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806701:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806708:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806712:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e8200/0x34dc807b6efbcb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.806752:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2028:x1830945991980416:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 8718us (9501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.806758:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22390 00010000:00010000:3.0:1746127013.806774:0:11152:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806780:0:11152:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806790:0:11152:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806796:0:11152:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806801:0:11152:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806806:0:11152:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c6400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127013.806808:0:11152:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806814:0:11152:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806821:0:11152:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.806827:0:11152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c6400/0x34dc807b6efbcbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.806884:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.806893:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 22 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746127013.806900:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 22 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746127013.806911:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e980e00/0x34dc807b6efba4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54343 expref: 22 pid: 12340 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746127013.806922:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.806924:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.806926:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.806932:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.806948:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.806967:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991981184:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 844us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.806973:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10546 00010000:00010000:2.0:1746127013.807023:0:9613:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807030:0:9613:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807045:0:9613:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807052:0:9613:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807058:0:9613:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807063:0:9613:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8df400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127013.807065:0:9613:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807072:0:9613:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807080:0:9613:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807085:0:9613:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8df400/0x34dc807b6efbca2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.807117:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991980160:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 9775us (9899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.807123:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22388 00000100:00100000:0.0:1746127013.807388:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.807733:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991982080 00000100:00100000:2.0:1746127013.807737:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991982080 00010000:00010000:2.0:1746127013.807749:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746127013.807765:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10552 00000100:00100000:2.0:1746127013.807769:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+20:2026:x1830945991982080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127013.807775:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.807782:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.807790:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.807801:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009664dc00/0x34dc807b6efba72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5435f expref: 20 pid: 12333 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.807809:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.807811:0:7247:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.807813:0:7247:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807820:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.807847:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.807865:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+19:2026:x1830945991982080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 95us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.807871:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10552 00000100:00100000:3.0:1746127013.807911:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991980544:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 9865us (10632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.807917:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22391 00010000:00010000:1.0:1746127013.807988:0:9612:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.807995:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.808005:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.808010:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.808016:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.808021:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbf7200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127013.808024:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.808029:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.808038:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.808043:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7200/0x34dc807b6efbcb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.808073:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2028:x1830945991980288:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 10540us (10835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.808079:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22389 00000100:00100000:3.0:1746127013.811634:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2029:x1830945991980800:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8499us (8803us total) trans 17179875728 rc 0/0 00000100:00100000:3.0:1746127013.811648:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2011 00002000:00100000:3.0:1746127013.811659:0:9616:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9f:0x0] (1048576->1269759) req@ffff8800a5b98e00 x1830945991980800/t17179875728(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746127013.811668:0:9616:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b98e00 with x1830945991980800 ext(1048576->1269759) 00010000:00010000:3.0:1746127013.811678:0:9616:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.811690:0:9616:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746127013.811697:0:9616:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5b98e00 00000100:00100000:0.0:1746127013.813758:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.813818:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991982208 00000100:00100000:3.0:1746127013.813825:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991982208 00010000:00010000:3.0:1746127013.813851:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.814022:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10553 00000100:00100000:3.0:1746127013.814031:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2028:x1830945991982208:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.814043:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.814060:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.814070:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.814092:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf7a00/0x34dc807b6efbbe5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5440e expref: 50 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.814105:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.814107:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.814111:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.814119:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.814173:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127013.814270:0:1964:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814278:0:1964:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814294:0:1964:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814301:0:1964:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814308:0:1964:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814314:0:1964:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f7c7800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127013.814318:0:1964:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814325:0:1964:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814334:0:1964:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.814339:0:1964:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f7c7800/0x34dc807b6efbca9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.814404:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+49:2028:x1830945991982208:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 373us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.814410:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10553 00000100:00100000:0.0:1746127013.814752:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2028:x1830945991980032:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 17420us (17563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.814759:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22386 00000100:00100000:1.0:1746127013.814826:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2026:x1830945991980672:12345-192.168.203.42@tcp:4:multiop.0 Request processed in 8169us (8539us total) trans 21474843006 rc 0/0 00000100:00100000:1.0:1746127013.814835:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2012 00002000:00100000:1.0:1746127013.814842:0:9618:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c:0x0] (307200->1048575) req@ffff880130a75500 x1830945991980672/t21474843006(0) o4->5e76605d-9d1c-461f-a9b4-504f54f8c30c@192.168.203.42@tcp:19/0 lens 488/448 e 0 to 0 dl 1746127024 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746127013.814850:0:9618:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130a75500 with x1830945991980672 ext(307200->1048575) 00010000:00010000:1.0:1746127013.814858:0:9618:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.814870:0:9618:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746127013.814876:0:9618:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130a75500 00000100:00100000:0.0:1746127013.818317:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.818404:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991982336 00000100:00100000:3.0:1746127013.818412:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991982336 00010000:00010000:3.0:1746127013.818442:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.818473:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10554 00000100:00100000:3.0:1746127013.818478:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2029:x1830945991982336:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.818488:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.818503:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.818512:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.818530:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbbd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 307200->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54400 expref: 33 pid: 3148 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.818541:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.818543:0:10641:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.818546:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.818552:0:10641:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.818573:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746127013.818590:0:16295:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.818598:0:16295:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.818612:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945991982336:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 134us (305us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127013.818612:0:16295:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.818615:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10554 00010000:00010000:0.0:1746127013.818617:0:16295:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.818621:0:16295:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.818626:0:16295:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e9200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127013.818629:0:16295:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.818633:0:16295:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.818644:0:16295:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.818647:0:16295:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800991e9200/0x34dc807b6efbc9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.818682:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2028:x1830945991979904:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 21346us (21574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.818688:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22387 00000100:00100000:0.0:1746127013.821086:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.821698:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991982592 00000100:00100000:1.0:1746127013.821706:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991982592 00000100:00100000:1.0:1746127013.821755:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17445 00000100:00100000:1.0:1746127013.821760:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:4698:x1830945991982592:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:1.0:1746127013.821816:0:7259:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127013.821838:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6000/0x34dc807b6efbc6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54469 expref: 12 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.821862:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.821865:0:7259:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127013.821888:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.821896:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.821901:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 52 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.821905:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 52 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.821913:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 52 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.821917:0:7259:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.821920:0:7259:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.821942:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 30 pid: 11634 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.821950:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 30 pid: 11634 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.821959:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a77800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381312:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.822100:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 52 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.822105:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 52 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.822110:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381440:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.822143:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 52 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.822148:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 52 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.822153:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381568:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.822434:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 52 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.822443:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 52 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.822450:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381696:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.822477:0:7259:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 30 pid: 13448 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.822484:0:7259:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 30 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.822490:0:7259:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381824:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.822506:0:7259:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.823896:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.823970:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.824050:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991982848 00000100:00100000:3.0:1746127013.824056:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991982848 00000100:00100000:1.0:1746127013.824065:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a77800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381312:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.824070:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991983104 00000100:00100000:1.0:1746127013.824074:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381440:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127013.824075:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991983104 00000100:00100000:1.0:1746127013.824080:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381696:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127013.824084:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 32 pid: 11634 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.824086:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381824:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.824090:0:7247:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 32 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.824110:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10555 00000100:00100000:2.0:1746127013.824115:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10556 00000100:00100000:3.0:1746127013.824116:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2027:x1830945991982848:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127013.824121:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+32:2027:x1830945991983104:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.824126:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.824149:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 32 pid: 11634 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.824151:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.824156:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 32 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.824160:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 32 pid: 11634 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.824167:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 32 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.824185:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fc400/0x34dc807b6efb5e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54080 expref: 32 pid: 11634 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.824803:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be42e00/0x34dc807b6efb857 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5422b expref: 31 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.824858:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.824863:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.824872:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.824915:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fe8879d-be98-4482-9466-43db8bbe4a76+30:2027:x1830945991983104:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 794us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.824921:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10556 00010000:00010000:3.0:1746127013.825037:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.825042:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.825048:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.825068:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+29:2027:x1830945991982848:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 951us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.825078:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10555 00000100:00100000:0.0:1746127013.825108:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.825123:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991982720 00000100:00100000:3.0:1746127013.825142:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991982720 00010000:00010000:3.0:1746127013.825154:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 53 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746127013.825171:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.825176:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991982976 00000100:00100000:3.0:1746127013.825179:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991982976 00010000:00010000:3.0:1746127013.825187:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.825200:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10557 00000100:00100000:3.0:1746127013.825204:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2027:x1830945991982720:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127013.825205:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10558 00000100:00100000:2.0:1746127013.825211:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+54:2027:x1830945991982976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.825212:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.825216:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 54 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.825218:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127013.825224:0:7247:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.825247:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 54 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.825261:0:7259:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7259:1830945994381568:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127013.825270:0:7247:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746127013.825286:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880077c2a600/0x34dc807b6efb8a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5425c expref: 54 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746127013.825288:0:7259:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.825294:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127013.825297:0:7247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:2.0:1746127013.825302:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127013.825326:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+53:2027:x1830945991982976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 115us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.825331:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10558 00010000:00010000:3.0:1746127013.825442:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012213e000/0x34dc807b6efb5e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54079 expref: 52 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.825451:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.825454:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.825459:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.825489:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2027:x1830945991982720:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 284us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.825495:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10557 00000100:00100000:0.0:1746127013.826004:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.826160:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991983232 00000100:00100000:3.0:1746127013.826164:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991983232 00010000:00010000:3.0:1746127013.826178:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 51 pid: 13448 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.826203:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10559 00000100:00100000:3.0:1746127013.826208:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+51:2027:x1830945991983232:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.826215:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.826219:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 51 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.826227:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 51 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.826243:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800967fca00/0x34dc807b6efb5da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54072 expref: 51 pid: 13448 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.826252:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.826255:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.826262:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.826268:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7259 initiator: MDT0 00010000:00010000:3.0:1746127013.826298:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.826459:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+50:2027:x1830945991983232:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 249us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.826465:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10559 00010000:00010000:1.0:1746127013.826471:0:7259:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.826477:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000040:00080000:1.0:1746127013.826909:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1480, 88 off137848 00000004:00080000:1.0:1746127013.826917:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908868786685ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.826994:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1489, 88 off138728 00000004:00080000:1.0:1746127013.827000:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908868870657ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.827049:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1490, 88 off138816 00000004:00080000:1.0:1746127013.827052:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908868923058ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.827061:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1481, 88 off137936 00000004:00080000:1.0:1746127013.827064:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908868934342ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827071:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1482, 88 off138024 00000004:00080000:1.0:1746127013.827073:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908868943975ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827080:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1491, 88 off138904 00000004:00080000:1.0:1746127013.827083:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908868953708ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.827090:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1492, 88 off138992 00000004:00080000:1.0:1746127013.827093:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908868963625ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.827100:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1493, 88 off139080 00000004:00080000:1.0:1746127013.827103:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908868973478ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.827110:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1483, 88 off138112 00000004:00080000:1.0:1746127013.827112:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908868983057ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827119:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1494, 88 off139168 00000004:00080000:1.0:1746127013.827121:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908868991750ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.827152:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1484, 88 off138200 00000004:00080000:1.0:1746127013.827156:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908869026412ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827270:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1496, 88 off139352 00000004:00080000:1.0:1746127013.827274:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908869144672ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.827286:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1485, 88 off138288 00000004:00080000:1.0:1746127013.827288:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908869159138ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827296:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1486, 88 off138376 00000004:00080000:1.0:1746127013.827298:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908869169083ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827305:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1487, 88 off138464 00000004:00080000:1.0:1746127013.827308:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908869178646ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827315:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1488, 88 off138552 00000004:00080000:1.0:1746127013.827317:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908869188233ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.827325:0:7259:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1497, 88 off139440 00000004:00080000:1.0:1746127013.827328:0:7259:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908869198825ns, next at 895431202182ns, rc = 0 00000001:00080000:1.0:1746127013.828790:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938428 is committed 00000004:00080000:1.0:1746127013.828801:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1470 committed 00000004:00080000:1.0:1746127013.828813:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1462 committed 00000004:00080000:1.0:1746127013.828822:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1461 committed 00000004:00080000:1.0:1746127013.828824:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1460 committed 00000004:00080000:1.0:1746127013.828826:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1459 committed 00000004:00080000:1.0:1746127013.828827:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1469 committed 00000004:00080000:1.0:1746127013.828828:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1458 committed 00000004:00080000:1.0:1746127013.828830:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1468 committed 00000004:00080000:1.0:1746127013.828831:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1457 committed 00000004:00080000:1.0:1746127013.828832:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1467 committed 00000004:00080000:1.0:1746127013.828836:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1466 committed 00000004:00080000:1.0:1746127013.828838:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1465 committed 00000004:00080000:1.0:1746127013.828839:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1456 committed 00000004:00080000:1.0:1746127013.828840:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1455 committed 00000004:00080000:1.0:1746127013.828841:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1464 committed 00000004:00080000:1.0:1746127013.828843:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1463 committed 00000004:00080000:1.0:1746127013.828845:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1454 committed 00000001:00080000:1.0:1746127013.828850:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938425 is committed 00000001:00080000:1.0:1746127013.828854:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938424 is committed 00000100:00100000:3.0:1746127013.828953:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746127013.828971:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994381952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.829041:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127013.829096:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994382208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.829169:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994382464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.829222:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994382336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127013.829265:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.829296:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.829313:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994382976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.829329:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.829352:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994383488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.829366:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.829390:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994381952 00000100:00100000:0.0:1746127013.829396:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994381952 00000100:00100000:2.0:1746127013.829505:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382208 00000100:00100000:2.0:1746127013.829509:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382208 00000100:00100000:2.0:1746127013.829539:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382464 00000100:00100000:2.0:1746127013.829541:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382464 00000100:00100000:2.0:1746127013.829550:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382976 00000100:00100000:2.0:1746127013.829551:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382976 00000100:00100000:2.0:1746127013.829559:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994383488 00000100:00100000:2.0:1746127013.829561:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994383488 00000100:00100000:3.0:1746127013.829571:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127013.829573:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22392 00000100:00100000:2.0:1746127013.829579:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3785:x1830945994382208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.829590:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994382080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.829608:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.829620:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994382592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127013.829622:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994382720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.829633:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.829640:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994383232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.829655:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.829666:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801220f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994383616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127013.829673:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.829679:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127013.829689:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994383104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.829701:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382336 00000100:00100000:3.0:1746127013.829703:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382336 00000100:00100000:1.0:1746127013.829710:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127013.829711:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3785:x1830945994382208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (444us total) trans 21474843007 rc 0/0 00000100:00100000:3.0:1746127013.829715:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382080 00000100:00100000:2.0:1746127013.829716:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22392 00000100:00100000:3.0:1746127013.829717:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382080 00000100:00100000:1.0:1746127013.829721:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994383744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.829722:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382592 00000100:00100000:3.0:1746127013.829724:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382592 00000100:00100000:3.0:1746127013.829729:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994383232 00000100:00100000:2.0:1746127013.829729:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382720 00000100:00100000:3.0:1746127013.829730:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994383232 00000100:00100000:2.0:1746127013.829731:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382720 00000100:00100000:3.0:1746127013.829736:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994383616 00000100:00100000:1.0:1746127013.829736:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127013.829737:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994383104 00000100:00100000:3.0:1746127013.829738:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994383616 00000100:00100000:2.0:1746127013.829738:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994383104 00000100:00100000:3.0:1746127013.829744:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994383744 00000100:00100000:3.0:1746127013.829746:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994383744 00000100:00100000:2.0:1746127013.829747:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22393 00000100:00100000:2.0:1746127013.829751:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3783:x1830945994382464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.829754:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22394 00000100:00100000:3.0:1746127013.829757:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3783:x1830945994382976:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127013.829760:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede1f80/2, rc 0, transno 21474843007 00000100:00100000:1.0:1746127013.829770:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994382208:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127013.829806:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127013.829809:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00000100:00100000:1.0:1746127013.829810:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22395 00002000:00010000:2.0:1746127013.829811:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:2.0:1746127013.829813:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00000100:00100000:3.0:1746127013.829815:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994382976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (485us total) trans 21474843008 rc 0/0 00002000:00010000:2.0:1746127013.829815:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127013.829821:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22394 00000100:00100000:1.0:1746127013.829822:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994383488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127013.829830:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3783:x1830945994382464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (533us total) trans 17179875729 rc 0/0 00000100:00100000:3.0:1746127013.829831:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22396 00000100:00100000:2.0:1746127013.829834:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22393 00000100:00100000:3.0:1746127013.829835:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3782:x1830945994382336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127013.829842:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22397 00000100:00100000:2.0:1746127013.829845:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3784:x1830945994382080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.829882:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3782:x1830945994382336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (311us total) trans 17179875730 rc 0/0 00000100:00100000:2.0:1746127013.829884:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3784:x1830945994382080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 38us (275us total) trans 17179875731 rc 0/0 00000100:00100000:3.0:1746127013.829888:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22396 00000100:00100000:2.0:1746127013.829890:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22397 00000100:00100000:3.0:1746127013.829896:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22398 00000100:00100000:3.0:1746127013.829900:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3784:x1830945994382592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127013.829952:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3783:x1830945994383488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (583us total) trans 21474843009 rc 0/0 00000100:00100000:3.0:1746127013.830569:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3784:x1830945994382592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 667us (933us total) trans 17179875732 rc 0/0 00000100:00100000:2.0:1746127013.830626:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22399 00000100:00100000:1.0:1746127013.830661:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22395 00000100:00100000:2.0:1746127013.830682:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3784:x1830945994383232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127013.830732:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746127013.830734:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127013.830736:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127013.830738:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:2.0:1746127013.830740:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:2.0:1746127013.830759:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3784:x1830945994383232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1103us total) trans 21474843010 rc 0/0 00000100:00100000:2.0:1746127013.830764:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22399 00000100:00100000:2.0:1746127013.830776:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22400 00000100:00100000:2.0:1746127013.830780:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3785:x1830945994382720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746127013.830821:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:2.0:1746127013.830823:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127013.830825:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127013.830827:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:2.0:1746127013.830828:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:2.0:1746127013.830850:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3785:x1830945994382720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1178us total) trans 17179875733 rc 0/0 00000100:00100000:2.0:1746127013.830855:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22400 00000100:00100000:2.0:1746127013.830865:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22401 00000100:00100000:2.0:1746127013.830869:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3784:x1830945994383616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127013.830920:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3784:x1830945994383616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (1239us total) trans 17179875734 rc 0/0 00000100:00100000:2.0:1746127013.830925:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22401 00000100:00100000:2.0:1746127013.830935:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22402 00000100:00100000:2.0:1746127013.830939:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3785:x1830945994383104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127013.831004:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3785:x1830945994383104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1293us total) trans 17179875735 rc 0/0 00000100:00100000:2.0:1746127013.831009:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22402 00000100:00100000:2.0:1746127013.831018:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22403 00000100:00100000:2.0:1746127013.831022:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3785:x1830945994383744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127013.831067:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746127013.831069:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127013.831071:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127013.831073:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127013.831075:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:2.0:1746127013.831093:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3785:x1830945994383744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1357us total) trans 21474843011 rc 0/0 00000100:00100000:2.0:1746127013.831098:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22403 00000100:00100000:3.0:1746127013.831303:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22398 00000100:00100000:3.0:1746127013.831314:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22404 00000100:00100000:3.0:1746127013.831319:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3782:x1830945994381952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.831375:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3782:x1830945994381952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (2334us total) trans 17179875736 rc 0/0 00000100:00100000:3.0:1746127013.831380:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22404 00000004:00080000:3.0:1746127013.831418:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3fc700/2, rc 0, transno 17179875731 00000100:00100000:3.0:1746127013.831422:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994382080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127013.831429:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22f480/2, rc 0, transno 17179875732 00000100:00100000:3.0:1746127013.831431:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994382592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127013.831438:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede3480/2, rc 0, transno 21474843010 00000100:00100000:3.0:1746127013.831441:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994383232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127013.831446:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801220f0a80/2, rc 0, transno 17179875734 00000100:00100000:3.0:1746127013.831449:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801220f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994383616:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127013.831468:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22ca80/2, rc 0, transno 17179875730 00000100:00100000:3.0:1746127013.831470:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994382336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127013.831479:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994382848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.831498:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.831509:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994383360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.831519:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127013.831964:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994382848 00000100:00100000:1.0:1746127013.831969:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994382848 00000100:00100000:3.0:1746127013.831973:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ede1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994383872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.832001:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746127013.832085:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d3ff100/2, rc 0, transno 17179875736 00000100:00100000:3.0:1746127013.832088:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994381952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127013.832261:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994383872 00000100:00100000:0.0:1746127013.832262:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994383360 00000100:00100000:1.0:1746127013.832264:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994383872 00000100:00100000:0.0:1746127013.832265:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994383360 00000100:00100000:0.0:1746127013.832279:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22405 00000100:00100000:1.0:1746127013.832282:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22406 00000100:00100000:0.0:1746127013.832283:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3782:x1830945994382848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.832286:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3782:x1830945994383872:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746127013.832326:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746127013.832330:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1746127013.832333:0:9612:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:1.0:1746127013.832336:0:9612:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127013.832337:0:9612:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127013.832339:0:9612:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00000100:00100000:0.0:1746127013.832340:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22407 00002000:00010000:1.0:1746127013.832341:0:9612:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:0.0:1746127013.832344:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994383360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.832362:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994383872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (360us total) trans 21474843012 rc 0/0 00000100:00100000:1.0:1746127013.832367:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22406 00000004:00080000:1.0:1746127013.832390:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22ce00/2, rc 0, transno 17179875733 00000100:00100000:1.0:1746127013.832393:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994382720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.832397:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994383360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (877us total) trans 21474843014 rc 0/0 00000004:00080000:1.0:1746127013.832400:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22f800/2, rc 0, transno 17179875735 00000100:00100000:0.0:1746127013.832402:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22407 00000100:00100000:1.0:1746127013.832403:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994383104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127013.832409:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede0380/2, rc 0, transno 21474843011 00000100:00100000:1.0:1746127013.832411:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994383744:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127013.832422:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d22e680/2, rc 0, transno 17179875729 00000100:00100000:0.0:1746127013.832425:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994382464:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127013.832431:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede0a80/2, rc 0, transno 21474843008 00000100:00100000:0.0:1746127013.832433:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994382976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127013.832439:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede2d80/2, rc 0, transno 21474843009 00000100:00100000:0.0:1746127013.832441:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994383488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.832447:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994384000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.832462:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746127013.832475:0:7259:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5b99880 reply state ffff88008c5ac400 transno 8589938428 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127013.832478:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994384000 00000100:00100000:0.0:1746127013.832480:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994384000 00000100:00100000:0.0:1746127013.832491:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22408 00010000:00010000:1.0:1746127013.832493:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00000100:00100000:0.0:1746127013.832495:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3783:x1830945994384000:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746127013.832502:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.832504:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746127013.832509:0:7259:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746127013.832544:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3783:x1830945994384000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (81us total) trans 21474843015 rc 0/0 00000100:00100000:0.0:1746127013.832550:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22408 00000004:00080000:0.0:1746127013.832567:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130a74a80/2, rc 0, transno 21474843015 00000100:00100000:0.0:1746127013.832570:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994384000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.832596:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3782:x1830945994382848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 313us (1098us total) trans 21474843013 rc 0/0 00000100:00100000:0.0:1746127013.832600:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22405 00000004:00080000:3.0:1746127013.832729:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede0700/2, rc 0, transno 21474843013 00000100:00100000:3.0:1746127013.832732:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994382848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127013.832738:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede2a00/2, rc 0, transno 21474843014 00000100:00100000:3.0:1746127013.832740:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994383360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127013.832745:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ede1500/2, rc 0, transno 21474843012 00000100:00100000:3.0:1746127013.832747:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ede1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994383872:0@lo:2:osp-syn-0-0.0 00010000:00080000:1.0:1746127013.832770:0:7259:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746127013.832781:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4698:x1830945991982592:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 11019us (11707us total) trans 8589938428 rc 0/0 00000100:00100000:1.0:1746127013.832787:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17445 00010000:00010000:0.0:1746127013.832967:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.832975:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.832989:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.832996:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9ba1e00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127013.833000:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.833006:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.833016:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.833019:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127013.833021:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00010000:00010000:0.0:1746127013.833027:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9ba1e00/0x34dc807b6efbcc5 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7259 initiator: MDT0 00000100:00100000:2.0:1746127013.834436:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.834582:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991983360 00000100:00100000:1.0:1746127013.834588:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991983360 00000100:00100000:1.0:1746127013.834812:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17446 00000100:00100000:1.0:1746127013.834820:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4698:x1830945991983360:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127013.834841:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.834858:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5448c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.834906:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.834918:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 8 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.834932:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.834935:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746127013.834938:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47a00, rc 0) 00000100:00100000:1.0:1746127013.835261:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4698:x1830945991983360:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 441us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.835267:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17446 00000100:00100000:0.0:1746127013.837548:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.837736:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991983488 00000100:00100000:1.0:1746127013.837744:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991983488 00000100:00100000:1.0:1746127013.837799:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17447 00000100:00100000:1.0:1746127013.837807:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4698:x1830945991983488:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127013.837823:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.837841:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46200/0x34dc807b6efbcd3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54493 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.837927:0:7259:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47c00/0x34dc807b6efbcda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.837943:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47c00/0x34dc807b6efbcda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.837953:0:7259:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47c00/0x34dc807b6efbcda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00000004:00200000:1.0:1746127013.837995:0:7259:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:1.0:1746127013.837999:0:7259:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746127013.838015:0:7259:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47c00/0x34dc807b6efbcda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7259 initiator: MDT0 00010000:00010000:1.0:1746127013.838038:0:7259:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be46200/0x34dc807b6efbcd3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54493 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.838068:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47c00/0x34dc807b6efbcda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54493 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.838075:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.838078:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746127013.838081:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47c00, rc 0) 00000100:00100000:1.0:1746127013.838122:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4698:x1830945991983488:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 316us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.838154:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17447 00000100:00100000:0.0:1746127013.840607:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.840674:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991983616 00000100:00100000:1.0:1746127013.840683:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991983616 00000100:00100000:1.0:1746127013.841288:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22409 00000100:00100000:1.0:1746127013.841297:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991983616:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127013.841313:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.841332:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efbce1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5449a expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127013.841355:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c8a4, atime: 0x6813c8a3, ctime: 0x6813c8a4, blocks: 0x7f8 00010000:00010000:1.0:1746127013.841374:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.841376:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.841385:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efbce1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5449a expref: 13 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.841399:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efbce1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5449a expref: 13 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.841409:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be46e00, rc 0) 00000100:00100000:1.0:1746127013.841455:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991983616:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 160us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.841462:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22409 00000100:00100000:0.0:1746127013.841652:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.841685:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991983744 00000100:00100000:1.0:1746127013.841689:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991983744 00000100:00100000:1.0:1746127013.841716:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22410 00000100:00100000:1.0:1746127013.841721:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2026:x1830945991983744:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1746127013.841729:0:9612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746127013.841740:0:9612:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6efbce8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544a1 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127013.841754:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x800 00010000:00010000:1.0:1746127013.841762:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.841764:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.841767:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6efbce8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544a1 expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.841782:0:9612:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6efbce8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544a1 expref: 12 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127013.841789:0:9612:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be47400, rc 0) 00000100:00100000:1.0:1746127013.841805:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+12:2026:x1830945991983744:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 83us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.841810:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22410 00000100:00100000:2.0:1746127013.842092:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.842123:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.842162:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984000 00000100:00100000:3.0:1746127013.842166:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984000 00000100:00100000:3.0:1746127013.842184:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984256 00000100:00100000:3.0:1746127013.842186:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984256 00000100:00100000:3.0:1746127013.842199:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22411 00000100:00100000:2.0:1746127013.842203:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.842204:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991984000:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127013.842211:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127013.842217:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991983872 00000100:00100000:2.0:1746127013.842220:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991983872 00010000:00010000:3.0:1746127013.842221:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efbcef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544af expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127013.842234:0:16295:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c8a3, atime: 0x6813c8a3, ctime: 0x6813c8a3, blocks: 0x800 00010000:00010000:3.0:1746127013.842244:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.842245:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127013.842246:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22412 00010000:00010000:3.0:1746127013.842250:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efbcef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544af expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746127013.842251:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+13:2026:x1830945991984256:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127013.842258:0:3542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.842260:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efbcef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544af expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.842266:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdad600, rc 0) 00010000:00010000:2.0:1746127013.842268:0:3542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6efbcf6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544bd expref: -99 pid: 3542 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127013.842279:0:3542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c8a3, atime: 0x6813c8a3, ctime: 0x6813c8a3, blocks: 0x1008 00010000:00010000:2.0:1746127013.842288:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.842290:0:3542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.842294:0:3542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6efbcf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544bd expref: 14 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127013.842295:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ede3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991984000:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.842301:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22411 00000100:00100000:3.0:1746127013.842313:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22413 00010000:00010000:2.0:1746127013.842316:0:3542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6efbcf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544bd expref: 14 pid: 3542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127013.842317:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991983872:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127013.842323:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127013.842324:0:3542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caeb400, rc 0) 00010000:00010000:3.0:1746127013.842329:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efbcfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544a8 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127013.842339:0:16295:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c8a3, atime: 0x6813c8a3, ctime: 0x6813c8a3, blocks: 0x808 00000100:00100000:2.0:1746127013.842342:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991984256:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 90us (218us total) trans 0 rc 0/0 00010000:00010000:3.0:1746127013.842345:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.842347:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746127013.842347:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22412 00010000:00010000:3.0:1746127013.842350:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efbcfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544a8 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.842358:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efbcfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544a8 expref: 14 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.842368:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac800, rc 0) 00000100:00100000:3.0:1746127013.842383:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991983872:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.842387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.842388:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22413 00000100:00100000:3.0:1746127013.842397:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984128 00000100:00100000:3.0:1746127013.842399:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984128 00000100:00100000:3.0:1746127013.842418:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22414 00000100:00100000:3.0:1746127013.842422:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2026:x1830945991984128:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127013.842428:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127013.842435:0:16295:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdac400/0x34dc807b6efbd04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544b6 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127013.842444:0:16295:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c8a4, atime: 0x6813c8a3, ctime: 0x6813c8a4, blocks: 0x14e0 00010000:00010000:3.0:1746127013.842450:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.842451:0:16295:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.842454:0:16295:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdac400/0x34dc807b6efbd04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544b6 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.842460:0:16295:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bdac400/0x34dc807b6efbd04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544b6 expref: 15 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127013.842464:0:16295:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac400, rc 0) 00000100:00100000:3.0:1746127013.842478:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991984128:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 57us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.842482:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22414 00000100:00100000:0.0:1746127013.846636:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.846675:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.846723:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.846782:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984384 00000100:00100000:2.0:1746127013.846791:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984384 00000100:00100000:2.0:1746127013.846841:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984640 00000100:00100000:2.0:1746127013.846844:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984640 00000100:00100000:2.0:1746127013.846856:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984896 00000100:00100000:2.0:1746127013.846857:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984896 00000100:00100000:2.0:1746127013.846869:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22415 00000100:00100000:2.0:1746127013.846877:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991984384:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127013.846881:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22416 00000100:00100000:3.0:1746127013.846889:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991984640:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127013.846995:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22417 00000100:00100000:2.0:1746127013.846997:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991984384:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.847004:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22415 00000100:00100000:1.0:1746127013.847004:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991984896:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127013.847043:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991984896:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.847048:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22417 00000100:00100000:3.0:1746127013.847100:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991984640:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 212us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.847106:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22416 00000100:00100000:0.0:1746127013.847602:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.847649:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.847674:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.847802:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984512 00000100:00100000:3.0:1746127013.847806:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984512 00000100:00100000:3.0:1746127013.847827:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991984768 00000100:00100000:3.0:1746127013.847829:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991984768 00000100:00100000:3.0:1746127013.847837:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985024 00000100:00100000:3.0:1746127013.847839:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985024 00000100:00100000:2.0:1746127013.847846:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22418 00000100:00100000:2.0:1746127013.847854:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991984512:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127013.847856:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22419 00000100:00100000:3.0:1746127013.847860:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991984768:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127013.847900:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22420 00000100:00100000:1.0:1746127013.847907:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991985024:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127013.847916:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991984512:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 62us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.847921:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22418 00000100:00100000:3.0:1746127013.848110:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991984768:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 248us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.848110:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991985024:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 203us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.848116:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22419 00000100:00100000:1.0:1746127013.848118:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22420 00000100:00100000:0.0:1746127013.853233:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.853263:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.853282:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.853308:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.853321:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.853323:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985152 00000100:00100000:3.0:1746127013.853335:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985152 00000100:00100000:1.0:1746127013.853335:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985408 00000100:00100000:1.0:1746127013.853343:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985408 00000100:00100000:0.0:1746127013.853351:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.853376:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985664 00000100:00100000:3.0:1746127013.853378:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985664 00000100:00100000:2.0:1746127013.853381:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985536 00000100:00100000:1.0:1746127013.853381:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985280 00000100:00100000:1.0:1746127013.853383:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985280 00000100:00100000:2.0:1746127013.853385:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985536 00000100:00100000:0.0:1746127013.853393:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985792 00000100:00100000:0.0:1746127013.853396:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985792 00000100:00100000:3.0:1746127013.853400:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22421 00000100:00100000:1.0:1746127013.853407:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22422 00000100:00100000:3.0:1746127013.853408:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991985152:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127013.853413:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22423 00000100:00100000:1.0:1746127013.853414:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991985408:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127013.853418:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991985664:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127013.853420:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22424 00000100:00100000:0.0:1746127013.853425:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991985280:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127013.853507:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991985664:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.853507:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991985408:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.853508:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991985280:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.853513:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22422 00000100:00100000:2.0:1746127013.853516:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22423 00000100:00100000:0.0:1746127013.853518:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22424 00000100:00100000:1.0:1746127013.853526:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22425 00000100:00100000:2.0:1746127013.853528:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22426 00000100:00100000:1.0:1746127013.853530:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991985536:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:2.0:1746127013.853533:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991985792:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127013.853542:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991985152:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 135us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127013.853561:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991985792:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.853561:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2027:x1830945991985536:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127013.853566:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22425 00000100:00100000:2.0:1746127013.853569:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22426 00000100:00100000:3.0:1746127013.853578:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22421 00000100:00100000:0.0:1746127013.856537:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.856620:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991985920 00000100:00100000:3.0:1746127013.856631:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991985920 00000100:00100000:3.0:1746127013.856697:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22427 00000100:00100000:3.0:1746127013.856705:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+14:2027:x1830945991985920:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:3.0:1746127013.856977:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127013.856993:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127013.856995:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127013.856997:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127013.856998:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:3.0:1746127013.857055:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2027:x1830945991985920:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 349us (525us total) trans 17179875737 rc 0/0 00000100:00100000:3.0:1746127013.857061:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22427 00000100:00100000:0.0:1746127013.860314:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.860928:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991986048 00000100:00100000:3.0:1746127013.860938:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991986048 00000100:00100000:3.0:1746127013.860992:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22428 00000100:00100000:3.0:1746127013.861000:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2026:x1830945991986048:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:3.0:1746127013.861232:0:11152:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127013.861235:0:11152:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127013.861238:0:11152:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127013.861239:0:11152:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127013.861241:0:11152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:3.0:1746127013.861305:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2026:x1830945991986048:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 304us (998us total) trans 21474843016 rc 0/0 00000100:00100000:3.0:1746127013.861311:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22428 00000100:00100000:0.0:1746127013.865864:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.866192:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991986304 00000100:00100000:1.0:1746127013.866202:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991986304 00000100:00100000:1.0:1746127013.866273:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9018 00000100:00100000:1.0:1746127013.866282:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2028:x1830945991986304:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127013.866320:0:9618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.866334:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.866336:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.866340:0:9618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.866353:0:9618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.868336:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.868405:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991986560 00000100:00100000:3.0:1746127013.868414:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991986560 00000100:00100000:3.0:1746127013.868468:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9019 00000100:00100000:3.0:1746127013.868476:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2028:x1830945991986560:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127013.868513:0:9616:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.868526:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.868528:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.868533:0:9616:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.868546:0:9616:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.871259:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.871295:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.871322:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.871358:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.871380:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991986944 00000100:00100000:0.0:1746127013.871387:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991987200 00000100:00100000:1.0:1746127013.871389:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991986944 00000100:00100000:0.0:1746127013.871390:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991987200 00000100:00100000:0.0:1746127013.871441:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991987072 00000100:00100000:1.0:1746127013.871442:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991987584 00000100:00100000:0.0:1746127013.871443:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991987072 00000100:00100000:1.0:1746127013.871444:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991987584 00000100:00100000:0.0:1746127013.871460:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9020 00000100:00100000:1.0:1746127013.871466:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9021 00000100:00100000:0.0:1746127013.871467:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2028:x1830945991986944:12345-192.168.203.42@tcp:3:lfs.0 00000100:00100000:1.0:1746127013.871472:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2028:x1830945991987200:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127013.871500:0:29587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.871500:0:29586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.871513:0:29587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.871513:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.871515:0:29587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.871515:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127013.871520:0:29587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.871520:0:29586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.871532:0:29587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.871532:0:29586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.871547:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9022 00000100:00100000:2.0:1746127013.871557:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2028:x1830945991987072:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127013.871573:0:13835:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.871582:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.871583:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.871586:0:13835:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.871594:0:13835:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.871852:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9023 00000100:00100000:3.0:1746127013.871860:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2029:x1830945991987584:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127013.871876:0:20411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.871884:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.871886:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127013.871889:0:20411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.871897:0:20411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.872611:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.873357:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127013.873861:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991987968 00000100:00100000:2.0:1746127013.873868:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991987968 00000100:00100000:2.0:1746127013.873920:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991988096 00000100:00100000:2.0:1746127013.873922:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991988096 00000100:00100000:2.0:1746127013.873938:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9024 00000100:00100000:2.0:1746127013.873944:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2029:x1830945991987968:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127013.873971:0:9617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.873992:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.873994:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127013.873999:0:9617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.874011:0:9617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127013.874506:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9025 00000100:00100000:0.0:1746127013.874517:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+22:2029:x1830945991988096:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:0.0:1746127013.874549:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.874559:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.874560:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127013.874564:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.874575:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.879449:0:9618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.879467:0:9618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.879475:0:9618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.879482:0:9618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009665c000 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127013.879486:0:9618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.879494:0:9618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.879515:0:9618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.879521:0:9618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009665c000/0x34dc807b6efbd0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.880537:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+22:2028:x1830945991986304:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 14249us (14677us total) trans 0 rc 1040384/1040384 00000100:00100000:1.0:1746127013.880549:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9018 00010000:00010000:3.0:1746127013.884344:0:9616:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.884361:0:9616:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.884373:0:9616:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.884380:0:9616:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e9a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127013.884385:0:9616:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.884392:0:9616:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.884413:0:9616:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.884419:0:9616:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9a00/0x34dc807b6efbd12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.885659:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+21:2028:x1830945991986560:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 17176us (17323us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127013.885670:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9019 00010000:00010000:2.0:1746127013.888044:0:13835:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.888060:0:13835:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.888068:0:13835:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.888075:0:13835:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127013.888079:0:13835:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.888086:0:13835:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.888104:0:13835:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.888115:0:13835:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b82400/0x34dc807b6efbd27 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.888243:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+20:2028:x1830945991987072:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 16683us (16915us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127013.888253:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9022 00010000:00010000:1.0:1746127013.893166:0:29587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.893182:0:29587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.893189:0:29587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.893196:0:29587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800967e5a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127013.893199:0:29587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.893206:0:29587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.893224:0:29587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.893235:0:29587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800967e5a00/0x34dc807b6efbd20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127013.893327:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2028:x1830945991987200:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 21849us (22025us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127013.893337:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9021 00010000:00010000:3.0:1746127013.897851:0:20411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.897865:0:20411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.897872:0:20411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.897882:0:20411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e9600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127013.897885:0:20411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.897892:0:20411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.897907:0:20411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.897913:0:20411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991e9600/0x34dc807b6efbd2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.897997:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2029:x1830945991987584:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 26135us (26634us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127013.898006:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9023 00010000:00010000:2.0:1746127013.902918:0:29586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.902932:0:29586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.902939:0:29586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.902945:0:29586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012341ac00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127013.902948:0:29586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.902955:0:29586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.902970:0:29586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.902976:0:29586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012341ac00/0x34dc807b6efbd19 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.903053:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2028:x1830945991986944:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 31582us (31798us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127013.903062:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9020 00010000:00010000:2.0:1746127013.907801:0:9617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.907814:0:9617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.907821:0:9617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.907827:0:9617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b82a00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127013.907830:0:9617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.907837:0:9617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.907851:0:9617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.907861:0:9617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b82a00/0x34dc807b6efbd35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.907924:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+15:2029:x1830945991987968:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 33976us (35316us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127013.907935:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9024 00010000:00010000:2.0:1746127013.912886:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.913018:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.913026:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.913031:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a8c9200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127013.913034:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.913040:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.913055:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127013.913061:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8c9200/0x34dc807b6efbd3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127013.913111:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+16:2029:x1830945991988096:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 38594us (39752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127013.913121:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9025 00010000:00010000:3.0:1746127013.913541:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127013.918228:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.918306:0:13448:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991988352 00000100:00100000:3.0:1746127013.918313:0:13448:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991988352 00000100:00100000:3.0:1746127013.918348:0:13448:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17448 00000100:00100000:3.0:1746127013.918355:0:13448:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:4698:x1830945991988352:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:3.0:1746127013.918391:0:13448:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.918412:0:13448:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47c00/0x34dc807b6efbcda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54493 expref: 9 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127013.918430:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.918435:0:13448:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127013.918468:0:13448:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.918479:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.918488:0:13448:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00000004:00010000:3.0:1746127013.918561:0:13448:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cd67480 reply state ffff8800a529a000 transno 8589938429 ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.918570:0:13448:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.918575:0:13448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.918578:0:13448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746127013.918580:0:13448:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746127013.918635:0:13448:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4698:x1830945991988352:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 280us (412us total) trans 8589938429 rc 0/0 00000100:00100000:3.0:1746127013.918641:0:13448:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17448 00000100:00100000:0.0:1746127013.920763:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.920790:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.920807:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.920817:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.920827:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.920847:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.920878:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991988608 00000100:00100000:0.0:1746127013.920883:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991988608 00000100:00100000:0.0:1746127013.920906:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991988480 00000100:00100000:0.0:1746127013.920907:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991988480 00000100:00100000:0.0:1746127013.920915:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991988864 00000100:00100000:0.0:1746127013.920916:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991988864 00000100:00100000:0.0:1746127013.920927:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991989120 00000100:00100000:0.0:1746127013.920928:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991989120 00000100:00100000:0.0:1746127013.920936:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991988736 00000100:00100000:0.0:1746127013.920937:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991988736 00000100:00100000:0.0:1746127013.920943:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991988992 00000100:00100000:0.0:1746127013.920944:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991988992 00000100:00100000:0.0:1746127013.920951:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22429 00000100:00100000:0.0:1746127013.920956:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991988608:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127013.921059:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127013.921062:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.921064:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.921066:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.921067:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127013.921098:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991988608:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 141us (339us total) trans 17179875738 rc 0/0 00000100:00100000:0.0:1746127013.921105:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22429 00000100:00100000:0.0:1746127013.921116:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22430 00000100:00100000:0.0:1746127013.921121:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991988480:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127013.921187:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127013.921189:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.921191:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921193:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.921194:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746127013.921210:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2027:x1830945991988480:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 89us (419us total) trans 21474843017 rc 0/0 00000100:00100000:0.0:1746127013.921214:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22430 00000100:00100000:0.0:1746127013.921223:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22431 00000100:00100000:0.0:1746127013.921226:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991988864:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127013.921256:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127013.921258:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921260:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921262:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921263:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127013.921276:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2026:x1830945991988864:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 49us (468us total) trans 21474843018 rc 0/0 00000100:00100000:0.0:1746127013.921281:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22431 00000100:00100000:0.0:1746127013.921288:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22432 00000100:00100000:0.0:1746127013.921292:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2026:x1830945991989120:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127013.921325:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127013.921327:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921329:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921330:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921332:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746127013.921345:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2026:x1830945991989120:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 52us (527us total) trans 17179875739 rc 0/0 00000100:00100000:0.0:1746127013.921350:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22432 00000100:00100000:0.0:1746127013.921357:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22433 00000100:00100000:0.0:1746127013.921361:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+17:2027:x1830945991988736:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127013.921392:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127013.921393:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921395:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921397:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921398:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746127013.921409:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991988736:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 48us (582us total) trans 17179875740 rc 0/0 00000100:00100000:0.0:1746127013.921413:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22433 00000100:00100000:0.0:1746127013.921420:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22434 00000100:00100000:0.0:1746127013.921423:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+18:2027:x1830945991988992:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:0.0:1746127013.921449:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127013.921451:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.921452:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127011 -> 1746127012 00002000:00010000:0.0:1746127013.921454:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.921456:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:0.0:1746127013.921470:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+19:2027:x1830945991988992:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 46us (622us total) trans 21474843019 rc 0/0 00000100:00100000:0.0:1746127013.921475:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22434 00000100:00100000:0.0:1746127013.926241:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.926291:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991989376 00000100:00100000:3.0:1746127013.926299:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991989376 00000100:00100000:1.0:1746127013.927464:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6689 00000100:00100000:1.0:1746127013.927476:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:4698:x1830945991989376:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:1.0:1746127013.927521:0:7262:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbc8d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54485 expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.927556:0:7262:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.927567:0:7262:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.927573:0:7262:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.927595:0:7262:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 10 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127013.927603:0:7262:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 10 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.927614:0:7262:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009942f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7262:1830945994384128:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127013.928341:0:7262:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1746127013.931902:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127013.932015:0:10641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991989504 00000100:00100000:3.0:1746127013.932022:0:10641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991989504 00010000:00010000:3.0:1746127013.932052:0:10641:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746127013.932084:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10560 00000100:00100000:3.0:1746127013.932090:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991989504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127013.932100:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127013.932105:0:10641:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.932116:0:10641:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746127013.932154:0:10641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.932158:0:10641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7262 initiator: MDT0 00010000:00010000:3.0:1746127013.932166:0:10641:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7262 initiator: MDT0 00010000:00010000:3.0:1746127013.932172:0:10641:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7262 initiator: MDT0 00010000:00010000:3.0:1746127013.932187:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127013.932216:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2027:x1830945991989504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127013.932222:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10560 00010000:00010000:1.0:1746127013.932226:0:7262:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be47a00/0x34dc807b6efbccc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5448c expref: 11 pid: 7259 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746127013.932241:0:7262:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009942f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7262:1830945994384128:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127013.932261:0:7262:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.932267:0:7262:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.932271:0:7262:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00000040:00080000:1.0:1746127013.932454:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1489, 88 off138640 00000004:00080000:1.0:1746127013.932459:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974328976ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932488:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1498, 88 off139528 00000004:00080000:1.0:1746127013.932491:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974361282ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.932500:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1499, 88 off139616 00000004:00080000:1.0:1746127013.932503:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974373549ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.932510:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1490, 88 off138728 00000004:00080000:1.0:1746127013.932512:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974382973ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932519:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1491, 88 off138816 00000004:00080000:1.0:1746127013.932521:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974391561ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932527:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1500, 88 off139704 00000004:00080000:1.0:1746127013.932529:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974399592ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.932536:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1501, 88 off139792 00000004:00080000:1.0:1746127013.932539:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974409684ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.932548:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1502, 88 off139880 00000004:00080000:1.0:1746127013.932551:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974422097ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.932558:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1492, 88 off138904 00000004:00080000:1.0:1746127013.932560:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974430739ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932568:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1503, 88 off139968 00000004:00080000:1.0:1746127013.932570:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974441126ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.932578:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1493, 88 off138992 00000004:00080000:1.0:1746127013.932580:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974450967ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932587:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1504, 88 off140056 00000004:00080000:1.0:1746127013.932589:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974459531ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127013.932603:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1494, 88 off139080 00000004:00080000:1.0:1746127013.932606:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974476596ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932612:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1495, 88 off139168 00000004:00080000:1.0:1746127013.932615:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974485887ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932706:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1497, 88 off139352 00000004:00080000:1.0:1746127013.932710:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974580501ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932808:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1498, 88 off139440 00000004:00080000:1.0:1746127013.932812:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 908974682304ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127013.932823:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1505, 88 off140144 00000004:00080000:1.0:1746127013.932826:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 908974696812ns, next at 895431202182ns, rc = 0 00000001:00080000:2.0:1746127013.934706:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938430 is committed 00000004:00080000:2.0:1746127013.934714:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1478 committed 00010000:00010000:3.0:1746127013.934798:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.934808:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.934815:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.934820:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800991e9c00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127013.934823:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.934832:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.934844:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127013.934846:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127013.934849:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00010000:00010000:3.0:1746127013.934854:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991e9c00/0x34dc807b6efbd43 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13448 initiator: MDT0 00000004:00080000:2.0:1746127013.934892:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1471 committed 00000004:00080000:2.0:1746127013.934897:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1470 committed 00000004:00080000:2.0:1746127013.934899:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1469 committed 00000004:00080000:2.0:1746127013.934900:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1468 committed 00000004:00080000:2.0:1746127013.934903:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1477 committed 00000004:00080000:2.0:1746127013.934904:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1467 committed 00000004:00080000:2.0:1746127013.934906:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1476 committed 00000004:00080000:2.0:1746127013.934907:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1466 committed 00000004:00080000:2.0:1746127013.934908:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1475 committed 00000004:00080000:2.0:1746127013.934910:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1474 committed 00000004:00080000:2.0:1746127013.934911:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1473 committed 00000004:00080000:2.0:1746127013.934912:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1465 committed 00000004:00080000:2.0:1746127013.934914:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1464 committed 00000004:00080000:2.0:1746127013.934915:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1472 committed 00000004:00080000:2.0:1746127013.934916:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1471 committed 00000004:00080000:2.0:1746127013.934918:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1463 committed 00000100:00100000:1.0:1746127013.934996:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935041:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127013.935064:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746127013.935068:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935081:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746127013.935114:0:7262:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094b7ad80 reply state ffff88012d33b000 transno 8589938430 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.935146:0:7262:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.935152:0:7262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.935154:0:7262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746127013.935157:0:7262:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746127013.935161:0:7262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.935163:0:7262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746127013.935167:0:7262:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbc8d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54485 expref: 7 pid: 7259 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127013.935181:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994384512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.935202:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.935219:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:1.0:1746127013.935220:0:7262:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746127013.935223:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994384640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127013.935228:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4698:x1830945991989376:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 7756us (8993us total) trans 8589938430 rc 0/0 00000100:00100000:1.0:1746127013.935235:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6689 00000100:00100000:3.0:1746127013.935238:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746127013.935251:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7262 initiator: MDT0 00000100:00100000:3.0:1746127013.935256:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994384384 00010000:00010000:1.0:1746127013.935256:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.935260:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7262 initiator: MDT0 00000100:00100000:3.0:1746127013.935261:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994384384 00010000:00010000:1.0:1746127013.935265:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f561600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:1.0:1746127013.935267:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.935271:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.935276:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127013.935278:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746127013.935280:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127013.935284:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f561600/0x34dc807b6efbd4a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7262 initiator: MDT0 00000100:00100000:3.0:1746127013.935285:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994384256 00000100:00100000:3.0:1746127013.935287:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994384256 00000100:00100000:3.0:1746127013.935296:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994384512 00000100:00100000:3.0:1746127013.935297:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994384512 00000100:00100000:1.0:1746127013.935298:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994384640 00000100:00100000:1.0:1746127013.935301:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994384640 00000100:00100000:3.0:1746127013.935307:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22435 00000100:00100000:3.0:1746127013.935312:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d7a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3785:x1830945994384384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935317:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22436 00000100:00100000:1.0:1746127013.935321:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3785:x1830945994384256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935379:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22437 00000100:00100000:1.0:1746127013.935383:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3782:x1830945994384512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127013.935391:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127013.935394:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127013.935396:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127013.935398:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127013.935400:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746127013.935418:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00000100:00100000:3.0:1746127013.935421:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d7a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3785:x1830945994384384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (379us total) trans 21474843021 rc 0/0 00002000:00010000:1.0:1746127013.935421:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935422:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935424:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935425:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:3.0:1746127013.935426:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22435 00000100:00100000:1.0:1746127013.935446:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3782:x1830945994384512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (243us total) trans 21474843022 rc 0/0 00000100:00100000:1.0:1746127013.935451:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22437 00000100:00100000:1.0:1746127013.935459:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22438 00000100:00100000:1.0:1746127013.935463:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3782:x1830945994384640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746127013.935509:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746127013.935511:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935512:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935514:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935516:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:3.0:1746127013.935522:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099194e00/2, rc 0, transno 21474843022 00000100:00100000:3.0:1746127013.935527:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994384512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935531:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3782:x1830945994384640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (293us total) trans 17179875741 rc 0/0 00000004:00080000:3.0:1746127013.935535:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b7aa00/2, rc 0, transno 17179875741 00000100:00100000:1.0:1746127013.935535:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22438 00000100:00100000:3.0:1746127013.935538:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994384640:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127013.935553:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099195880/2, rc 0, transno 21474843021 00000100:00100000:1.0:1746127013.935556:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384384:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127013.935574:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746127013.935586:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935588:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935589:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127013.935591:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:1.0:1746127013.935612:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3785:x1830945994384256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (530us total) trans 21474843020 rc 0/0 00000100:00100000:1.0:1746127013.935616:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22436 00000004:00080000:1.0:1746127013.935631:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099194000/2, rc 0, transno 21474843020 00000100:00100000:1.0:1746127013.935634:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935898:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935916:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127013.935930:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746127013.935933:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.935945:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127013.935958:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994384896 00000100:00100000:1.0:1746127013.935960:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994384896 00000100:00100000:1.0:1746127013.935971:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994384768 00000100:00100000:1.0:1746127013.935972:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994384768 00000100:00100000:1.0:1746127013.935991:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22439 00000100:00100000:1.0:1746127013.935996:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3785:x1830945994384896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.936049:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3785:x1830945994384896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (131us total) trans 21474843023 rc 0/0 00000100:00100000:1.0:1746127013.936054:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22439 00000100:00100000:1.0:1746127013.936062:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22440 00000100:00100000:1.0:1746127013.936065:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3785:x1830945994384768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746127013.936093:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746127013.936095:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127013.936097:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746127013.936099:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:1.0:1746127013.936100:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa0:0x0] updating lvb blocks from disk: 4072 -> 4072 00000100:00100000:1.0:1746127013.936114:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009942ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3785:x1830945994384768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (168us total) trans 21474843024 rc 0/0 00000100:00100000:1.0:1746127013.936118:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22440 00000004:00080000:1.0:1746127013.936145:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099195180/2, rc 0, transno 21474843024 00000100:00100000:1.0:1746127013.936148:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127013.936154:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099197100/2, rc 0, transno 21474843023 00000100:00100000:1.0:1746127013.936156:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994384896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.936729:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.936750:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936762:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.936771:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936780:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746127013.936783:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.936794:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936801:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.936810:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936822:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.936833:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936840:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.936850:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936856:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746127013.936859:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.936869:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936876:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.936886:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127013.936903:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385152 00000100:00100000:0.0:1746127013.936906:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385152 00000100:00100000:0.0:1746127013.936920:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385664 00000100:00100000:0.0:1746127013.936921:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385664 00000100:00100000:0.0:1746127013.936928:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385024 00000100:00100000:0.0:1746127013.936929:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385024 00000100:00100000:0.0:1746127013.936934:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385536 00000100:00100000:0.0:1746127013.936935:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385536 00000100:00100000:0.0:1746127013.936939:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385280 00000100:00100000:0.0:1746127013.936941:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385280 00000100:00100000:0.0:1746127013.936945:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385792 00000100:00100000:0.0:1746127013.936946:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385792 00000100:00100000:0.0:1746127013.936950:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385408 00000100:00100000:0.0:1746127013.936951:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385408 00000100:00100000:0.0:1746127013.936956:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994385920 00000100:00100000:0.0:1746127013.936957:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994385920 00000100:00100000:0.0:1746127013.936963:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22441 00000100:00100000:0.0:1746127013.936966:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3783:x1830945994385152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127013.937023:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127013.937026:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.937028:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.937029:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.937031:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746127013.937048:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3783:x1830945994385152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (297us total) trans 17179875742 rc 0/0 00000100:00100000:0.0:1746127013.937053:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22441 00000100:00100000:0.0:1746127013.937062:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22442 00000100:00100000:0.0:1746127013.937066:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3783:x1830945994385664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127013.937100:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb size from disk: 3186688 -> 3186688 00002000:00010000:0.0:1746127013.937102:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb mtime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127013.937104:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746127013.937106:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb ctime from disk: 1746126958 -> 1746126958 00002000:00010000:0.0:1746127013.937107:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa3:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:0.0:1746127013.937123:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3783:x1830945994385664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (351us total) trans 17179875743 rc 0/0 00000100:00100000:0.0:1746127013.937138:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22442 00000100:00100000:0.0:1746127013.937148:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22443 00000100:00100000:0.0:1746127013.937151:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3783:x1830945994385024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.937192:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3783:x1830945994385024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (397us total) trans 21474843025 rc 0/0 00000100:00100000:0.0:1746127013.937196:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22443 00000100:00100000:0.0:1746127013.937204:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22444 00000100:00100000:0.0:1746127013.937208:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3783:x1830945994385536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.937245:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3783:x1830945994385536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 36us (433us total) trans 17179875744 rc 0/0 00000100:00100000:0.0:1746127013.937249:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22444 00000100:00100000:0.0:1746127013.937256:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22445 00000100:00100000:0.0:1746127013.937259:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994385280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127013.937283:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127013.937286:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.937287:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.937289:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127013.937291:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746127013.937304:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994385280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (470us total) trans 17179875745 rc 0/0 00000100:00100000:0.0:1746127013.937308:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22445 00000100:00100000:0.0:1746127013.937316:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22446 00000100:00100000:0.0:1746127013.937319:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994385792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.937353:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994385792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 34us (502us total) trans 17179875746 rc 0/0 00000100:00100000:0.0:1746127013.937357:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22446 00000100:00100000:0.0:1746127013.937364:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22447 00000100:00100000:0.0:1746127013.937367:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994385408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127013.937391:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127013.937393:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127013.937394:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:0.0:1746127013.937396:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:0.0:1746127013.937398:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:0.0:1746127013.937409:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994385408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (539us total) trans 17179875747 rc 0/0 00000100:00100000:0.0:1746127013.937413:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22447 00000100:00100000:0.0:1746127013.937419:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22448 00000100:00100000:0.0:1746127013.937423:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3784:x1830945994385920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.937455:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994385920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 32us (567us total) trans 17179875748 rc 0/0 00000100:00100000:0.0:1746127013.937459:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22448 00000004:00080000:0.0:1746127013.937478:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099196680/2, rc 0, transno 21474843025 00000100:00100000:0.0:1746127013.937481:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127013.937487:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094819c00/2, rc 0, transno 17179875744 00000100:00100000:0.0:1746127013.937490:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127013.937495:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094b79f80/2, rc 0, transno 17179875742 00000100:00100000:0.0:1746127013.937497:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127013.937502:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dc62300/2, rc 0, transno 17179875743 00000100:00100000:0.0:1746127013.937504:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994385664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127013.937513:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094818380/2, rc 0, transno 17179875747 00000100:00100000:0.0:1746127013.937515:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127013.937520:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dc63800/2, rc 0, transno 17179875748 00000100:00100000:0.0:1746127013.937522:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127013.937526:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094818700/2, rc 0, transno 17179875745 00000100:00100000:0.0:1746127013.937528:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746127013.937533:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dc63b80/2, rc 0, transno 17179875746 00000100:00100000:0.0:1746127013.937535:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994385792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746127013.937647:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127013.937661:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991989632 00000100:00100000:0.0:1746127013.937663:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991989632 00000100:00100000:0.0:1746127013.937681:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17449 00000100:00100000:0.0:1746127013.937685:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+6:4698:x1830945991989632:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127013.937696:0:7259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127013.937708:0:7259:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efbd51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544c4 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.937739:0:7259:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efbd51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544c4 expref: 7 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.937750:0:7259:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efbd51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544c4 expref: 7 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127013.937765:0:7259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127013.937768:0:7259:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127013.937770:0:7259:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099158a00, rc 0) 00000100:00100000:0.0:1746127013.937790:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4698:x1830945991989632:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 105us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127013.937794:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17449 00000100:00100000:3.0:1746127013.938234:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994386048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.938254:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.938268:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746127013.938271:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994386176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127013.938281:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127013.938292:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386048 00000100:00100000:3.0:1746127013.938295:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386048 00000100:00100000:3.0:1746127013.938308:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386176 00000100:00100000:3.0:1746127013.938309:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386176 00000100:00100000:3.0:1746127013.938318:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22449 00000100:00100000:3.0:1746127013.938322:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3782:x1830945994386048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127013.938362:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127013.938364:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127013.938366:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127013.938368:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127013.938370:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:3.0:1746127013.938386:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3782:x1830945994386048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (131us total) trans 21474843026 rc 0/0 00000100:00100000:3.0:1746127013.938391:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22449 00000100:00100000:3.0:1746127013.938399:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22450 00000100:00100000:3.0:1746127013.938403:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3782:x1830945994386176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127013.938431:0:1507:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 6332416 -> 6332416 00002000:00010000:3.0:1746127013.938433:0:1507:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127013.938435:0:1507:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746127013.938437:0:1507:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746126964 -> 1746126964 00002000:00010000:3.0:1746127013.938439:0:1507:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4152 -> 4152 00000100:00100000:3.0:1746127013.938451:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3782:x1830945994386176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (170us total) trans 21474843027 rc 0/0 00000100:00100000:3.0:1746127013.938455:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22450 00000004:00080000:3.0:1746127013.938471:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099194a80/2, rc 0, transno 21474843027 00000100:00100000:3.0:1746127013.938474:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994386176:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127013.938479:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099194700/2, rc 0, transno 21474843026 00000100:00100000:3.0:1746127013.938481:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994386048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.938585:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746127013.938593:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994386304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127013.938613:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127013.938686:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386304 00000100:00100000:2.0:1746127013.938689:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386304 00000100:00100000:2.0:1746127013.938705:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22451 00000100:00100000:2.0:1746127013.938709:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3785:x1830945994386304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127013.938777:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3785:x1830945994386304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (162us total) trans 21474843028 rc 0/0 00000100:00100000:2.0:1746127013.938782:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22451 00000004:00080000:1.0:1746127013.938831:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099197800/2, rc 0, transno 21474843028 00000100:00100000:1.0:1746127013.938834:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994386304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127013.940507:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127013.941479:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991989888 00000100:00100000:1.0:1746127013.941487:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991989888 00000100:00100000:1.0:1746127013.941531:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6690 00000100:00100000:1.0:1746127013.941538:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:4698:x1830945991989888:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1746127013.941684:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:4698:x1830945991989888:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 146us (1179us total) trans 8589938431 rc 0/0 00000100:00100000:1.0:1746127013.941690:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6690 00000100:00100000:3.0:1746127014.286319:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746127014.286341:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994386432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746127014.286398:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127014.286591:0:9236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386432 00000100:00100000:2.0:1746127014.286597:0:9236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386432 00000100:00100000:2.0:1746127014.286634:0:9236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1746127014.286639:0:9236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3784:x1830945994386432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746127014.286665:0:9236:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445584896 avail 1316122624 00000100:00100000:2.0:1746127014.286703:0:9236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3784:x1830945994386432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.286709:0:9236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1746127014.287445:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994386432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746127014.301375:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994386944:0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.301430:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.301477:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3785:1830945994387456:0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.301497:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.301508:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3785:1830945994387968:0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301547:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:444fe009-ee02-43e3-bd8f-cf01026dcff4:3782:1830945994386560:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.301559:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3784:1830945994386816:0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301573:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127014.301585:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994386688:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.301586:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127014.301588:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994387072:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.301602:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3784:1830945994387328:0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301603:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127014.301612:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3782:1830945994387584:0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.301614:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127014.301619:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127014.301628:0:8223:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386560 00000100:00100000:0.0:1746127014.301631:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3783:1830945994387200:0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301633:0:8223:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386560 00000100:00100000:2.0:1746127014.301633:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994387840:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.301649:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127014.301650:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127014.301658:0:8223:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1746127014.301662:0:8223:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3782:x1830945994386560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.301663:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994387712:0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.301676:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127014.301679:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387456 00000100:00100000:2.0:1746127014.301682:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387456 00000100:00100000:3.0:1746127014.301687:0:8223:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:444fe009-ee02-43e3-bd8f-cf01026dcff4+23:3782:x1830945994386560:12345-0@lo:400:kworker.0 Request processed in 25us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.301690:0:8223:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1746127014.301698:0:7260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386816 00000100:00100000:0.0:1746127014.301701:0:7260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386816 00000100:00100000:3.0:1746127014.301707:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386944 00000100:00100000:3.0:1746127014.301708:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386944 00000100:00100000:2.0:1746127014.301708:0:7259:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387328 00000100:00100000:2.0:1746127014.301710:0:7259:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387328 00000100:00100000:0.0:1746127014.301718:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1746127014.301721:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387072 00000100:00100000:3.0:1746127014.301722:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387072 00000100:00100000:0.0:1746127014.301723:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3785:x1830945994387456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301729:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387840 00000100:00100000:3.0:1746127014.301731:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387840 00000100:00100000:3.0:1746127014.301737:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387712 00000100:00100000:3.0:1746127014.301738:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387712 00000100:00100000:3.0:1746127014.301745:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1746127014.301748:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994386944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.301749:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127014.301749:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3785:x1830945994387456:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.301762:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801220f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3785:x1830945994386944:12345-0@lo:400:kworker.0 Request processed in 14us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.301766:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1746127014.301772:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1746127014.301776:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994387072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.301784:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3785:1830945994386944:0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.301792:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3785:1830945994387456:0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301795:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994387072:12345-0@lo:400:kworker.0 Request processed in 18us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.301800:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1746127014.301807:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1746127014.301811:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994387840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301833:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994387840:12345-0@lo:400:kworker.0 Request processed in 21us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.301838:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1746127014.301845:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1746127014.301849:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3783:x1830945994387712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.301870:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3783:x1830945994387712:12345-0@lo:400:kworker.0 Request processed in 21us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.301871:0:11634:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387200 00000100:00100000:1.0:1746127014.301873:0:11634:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387200 00000100:00100000:3.0:1746127014.301875:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00080000:3.0:1746127014.301903:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746127014.301907:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1746127014.301908:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746127014.301910:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746127014.301925:0:10958:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387968 00000100:00100000:3.0:1746127014.301928:0:10958:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387968 00000100:00100000:0.0:1746127014.301956:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1746127014.301962:0:7259:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1746127014.301968:0:7260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1746127014.301969:0:7259:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3784:x1830945994386816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.301973:0:7260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3784:x1830945994387328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.302011:0:7260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3784:x1830945994387328:12345-0@lo:400:kworker.0 Request processed in 38us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.302013:0:7259:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3784:x1830945994386816:12345-0@lo:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.302018:0:7259:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1746127014.302021:0:7260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1746127014.302040:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994387712:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.302046:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3784:1830945994386816:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.302053:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3784:1830945994387328:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.302060:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994387840:0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.302063:0:7265:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994386688 00000100:00100000:0.0:1746127014.302065:0:7265:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994386688 00000100:00100000:2.0:1746127014.302080:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127014.302082:0:7265:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1746127014.302085:0:7265:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3783:x1830945994386688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.302099:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:444fe009-ee02-43e3-bd8f-cf01026dcff4:3782:1830945994386560:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.302106:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994387072:0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.302109:0:7265:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3783:x1830945994386688:12345-0@lo:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.302113:0:7265:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1746127014.302145:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994386688:0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.302148:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994387584 00000100:00100000:2.0:1746127014.302151:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994387584 00000100:00100000:2.0:1746127014.302173:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1746127014.302178:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3782:x1830945994387584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746127014.302204:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3782:x1830945994387584:12345-0@lo:400:kworker.0 Request processed in 26us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.302209:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:2.0:1746127014.302219:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746127014.302232:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3782:1830945994387584:0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.302449:0:11634:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1746127014.302455:0:11634:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3783:x1830945994387200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746127014.302458:0:10958:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1746127014.302464:0:10958:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3785:x1830945994387968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.302484:0:11634:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3783:x1830945994387200:12345-0@lo:400:kworker.0 Request processed in 30us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.302489:0:11634:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1746127014.302492:0:10958:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3785:x1830945994387968:12345-0@lo:400:kworker.0 Request processed in 29us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.302497:0:10958:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1746127014.302514:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3785:1830945994387968:0@lo:400:kworker.0 00000100:00100000:0.0:1746127014.302580:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3783:1830945994387200:0@lo:400:kworker.0 00000100:00100000:1.0:1746127014.365515:0:3783:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746127014.365530:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994388096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746127014.365581:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127014.365742:0:9236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994388096 00000100:00100000:0.0:1746127014.365749:0:9236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994388096 00000100:00100000:0.0:1746127014.365786:0:9236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1746127014.365794:0:9236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3783:x1830945994388096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746127014.365823:0:9236:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445486592 avail 1316024320 00000100:00100000:0.0:1746127014.365874:0:9236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c42b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3783:x1830945994388096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.365880:0:9236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1746127014.365961:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3783:1830945994388096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746127014.400014:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746127014.400034:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746127014.400088:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127014.400243:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994388224 00000100:00100000:3.0:1746127014.400250:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994388224 00000100:00100000:3.0:1746127014.400281:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1746127014.400288:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3782:x1830945994388224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746127014.400306:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1134456128 pending 6221824 free 3907129344 avail 3675607040 00000100:00100000:3.0:1746127014.400335:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3782:x1830945994388224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.400341:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1746127014.400402:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746127014.413363:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994388352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746127014.413419:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127014.413495:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994388352 00000100:00100000:2.0:1746127014.413501:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994388352 00000100:00100000:2.0:1746127014.413534:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1746127014.413540:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994388352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746127014.413558:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1108725056 pending 5435392 free 3910705152 avail 3679182848 00000100:00100000:2.0:1746127014.413590:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3784:x1830945994388352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.413595:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1746127014.413635:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994388352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746127014.544465:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.544502:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.544526:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.544540:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.544562:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.544589:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991990016 00000100:00100000:2.0:1746127014.544593:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991990272 00000100:00100000:0.0:1746127014.544599:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991990016 00000100:00100000:2.0:1746127014.544603:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991990272 00000100:00100000:0.0:1746127014.544642:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991990528 00000100:00100000:0.0:1746127014.544645:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991990528 00000100:00100000:2.0:1746127014.544732:0:11152:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991990144 00000100:00100000:2.0:1746127014.544735:0:11152:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991990144 00000100:00100000:0.0:1746127014.544739:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991990400 00000100:00100000:0.0:1746127014.544742:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991990400 00000100:00100000:3.0:1746127014.544750:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22452 00000100:00100000:3.0:1746127014.544760:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991990016:12345-192.168.203.42@tcp:16:kworker.0 00000100:00100000:0.0:1746127014.544772:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22453 00000100:00100000:0.0:1746127014.544780:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991990272:12345-192.168.203.42@tcp:16:kworker.0 00000100:00100000:2.0:1746127014.545329:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22454 00000100:00100000:2.0:1746127014.545337:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991990528:12345-192.168.203.42@tcp:16:kworker.0 00000100:00100000:2.0:1746127014.545592:0:11152:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22455 00000100:00100000:2.0:1746127014.545598:0:11152:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+22:2026:x1830945991990144:12345-192.168.203.42@tcp:16:kworker.0 00000100:00100000:2.0:1746127014.545631:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22456 00000100:00100000:2.0:1746127014.545635:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+21:2026:x1830945991990400:12345-192.168.203.42@tcp:16:kworker.0 00000100:00100000:2.0:1746127014.545795:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.545808:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991990656 00000100:00100000:2.0:1746127014.545811:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991990656 00000100:00100000:3.0:1746127014.545826:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22457 00000100:00100000:3.0:1746127014.545834:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+23:2026:x1830945991990656:12345-192.168.203.42@tcp:16:kworker.0 00000001:00080000:1.0:1746127014.546882:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875748 is committed 00000001:00080000:1.0:1746127014.546896:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875740 is committed 00000001:00080000:1.0:1746127014.546911:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875728 is committed 00000001:00080000:1.0:1746127014.546921:0:32110:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875725 is committed 00000100:00100000:2.0:1746127014.547406:0:11152:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991990144:12345-192.168.203.42@tcp:16:kworker.0 Request processed in 1806us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.547413:0:11152:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22455 00000100:00100000:3.0:1746127014.547533:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2026:x1830945991990656:12345-192.168.203.42@tcp:16:kworker.0 Request processed in 1700us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.547544:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22457 00000100:00100000:3.0:1746127014.547589:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2026:x1830945991990272:12345-192.168.203.42@tcp:16:kworker.0 Request processed in 2811us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.547594:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22453 00000001:00080000:0.0:1746127014.547660:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843028 is committed 00000001:00080000:0.0:1746127014.547673:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843019 is committed 00000001:00080000:0.0:1746127014.547686:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843006 is committed 00000001:00080000:0.0:1746127014.547691:0:30490:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843005 is committed 00000100:00100000:2.0:1746127014.547812:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:9fe8879d-be98-4482-9466-43db8bbe4a76+7:2026:x1830945991990400:12345-192.168.203.42@tcp:16:kworker.0 Request processed in 2176us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.547818:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22456 00000100:00100000:2.0:1746127014.547857:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+6:2026:x1830945991990016:12345-192.168.203.42@tcp:16:kworker.0 Request processed in 3099us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.547862:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22452 00000100:00100000:3.0:1746127014.547927:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2026:x1830945991990528:12345-192.168.203.42@tcp:16:kworker.0 Request processed in 2591us (3399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.547932:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22454 00000100:00100000:0.0:1746127014.552745:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127014.552856:0:7261:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991990912 00000100:00100000:3.0:1746127014.552866:0:7261:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991990912 00000100:00100000:1.0:1746127014.553320:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6691 00000100:00100000:1.0:1746127014.553332:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+8:4720:x1830945991990912:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:1.0:1746127014.554833:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+9:4720:x1830945991990912:12345-192.168.203.42@tcp:35:umount.0 Request processed in 275us (1101us total) trans 8589938432 rc 0/0 00000100:00100000:1.0:1746127014.554843:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6691 00000100:00100000:0.0:1746127014.556366:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.556399:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991991168 00000100:00100000:0.0:1746127014.556406:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.556409:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991991168 00000100:00100000:0.0:1746127014.556423:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.556469:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.556509:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991991424 00000100:00100000:0.0:1746127014.556516:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991991424 00000100:00100000:0.0:1746127014.556550:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22458 00000100:00100000:0.0:1746127014.556556:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2025:x1830945991991424:12345-192.168.203.42@tcp:9:umount.0 00000020:00000080:0.0:1746127014.556586:0:1964:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee474 00000100:00080000:0.0:1746127014.556594:0:1964:0:(import.c:66:import_set_state_nolock()) ffff880123460800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1746127014.556636:0:1964:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179875748 00000100:00100000:0.0:1746127014.556759:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+2:2025:x1830945991991424:12345-192.168.203.42@tcp:9:umount.0 Request processed in 203us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.556766:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22458 00010000:00010000:0.0:1746127014.556781:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746127014.556937:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991991040 00000100:00100000:2.0:1746127014.556941:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991991040 00000100:00100000:2.0:1746127014.556955:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991991296 00000100:00100000:2.0:1746127014.556957:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991991296 00000100:00100000:2.0:1746127014.556985:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1055 00000100:00100000:2.0:1746127014.556992:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee06c75c-5a89-45a6-932b-08fb02e0019d+17:2027:x1830945991991168:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127014.557004:0:7247:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127014.557019:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012158c200/0x34dc807b6eee451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c6a8 expref: 17 pid: 8223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.557031:0:7247:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127014.557058:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1056 00000100:00100000:0.0:1746127014.557066:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee06c75c-5a89-45a6-932b-08fb02e0019d+16:2027:x1830945991991040:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746127014.557074:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee06c75c-5a89-45a6-932b-08fb02e0019d+16:2027:x1830945991991168:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 82us (712us total) trans 0 rc 0/0 00010000:00010000:0.0:1746127014.557074:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127014.557078:0:10641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1057 00000100:00100000:2.0:1746127014.557083:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1055 00000100:00100000:3.0:1746127014.557087:0:10641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ee06c75c-5a89-45a6-932b-08fb02e0019d+16:2027:x1830945991991296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746127014.557089:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012158d600/0x34dc807b6eee44a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c677 expref: 16 pid: 8223 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.557095:0:10641:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127014.557104:0:10641:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012158d800/0x34dc807b6eee458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c6af expref: 14 pid: 8223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.557106:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127014.557112:0:10641:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127014.557124:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee06c75c-5a89-45a6-932b-08fb02e0019d+13:2027:x1830945991991040:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 59us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.557149:0:10641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ee06c75c-5a89-45a6-932b-08fb02e0019d+13:2027:x1830945991991296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 64us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.557150:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1056 00000100:00100000:3.0:1746127014.557154:0:10641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1057 00000100:00100000:2.0:1746127014.569537:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.569598:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991991552 00000100:00100000:0.0:1746127014.569605:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991991552 00000100:00100000:0.0:1746127014.569638:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22459 00000100:00100000:0.0:1746127014.569644:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2025:x1830945991991552:12345-192.168.203.42@tcp:9:umount.0 00000020:00000080:0.0:1746127014.569666:0:9612:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee46d 00000100:00080000:0.0:1746127014.569671:0:9612:0:(import.c:66:import_set_state_nolock()) ffff8800948bc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1746127014.569856:0:9612:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474843028 00000100:00100000:0.0:1746127014.569959:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fe8879d-be98-4482-9466-43db8bbe4a76+2:2025:x1830945991991552:12345-192.168.203.42@tcp:9:umount.0 Request processed in 315us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.569965:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22459 00010000:00010000:3.0:1746127014.570010:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127014.576575:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.576674:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991991936 00000100:00100000:2.0:1746127014.576682:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991991936 00000100:00100000:2.0:1746127014.576727:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17450 00000100:00100000:2.0:1746127014.576734:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+9:2025:x1830945991991936:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:2.0:1746127014.576760:0:13466:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee466 00000020:00010000:2.0:1746127014.576766:0:13466:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88007be26800: total 0 00000100:00080000:2.0:1746127014.576769:0:13466:0:(import.c:66:import_set_state_nolock()) ffff88007be23800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746127014.576891:0:13466:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589938432 00000100:00100000:2.0:1746127014.577002:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9fe8879d-be98-4482-9466-43db8bbe4a76+8:2025:x1830945991991936:12345-192.168.203.42@tcp:39:umount.0 Request processed in 268us (432us total) trans 8589938433 rc 0/0 00000100:00100000:2.0:1746127014.578086:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17450 00000020:00010000:3.0:1746127014.578508:0:7249:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88007be26800: total 0 00010000:00010000:3.0:1746127014.578546:0:7249:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88007be26800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746127014.578572:0:7249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:3.0:1746127014.578575:0:7249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746127014.578581:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996e5e00/0x34dc807b6eee4eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c75e expref: 7 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.578600:0:7249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127014.578602:0:7249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746127014.578605:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8df000/0x34dc807b6ef20bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4e8dd expref: 6 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.578614:0:7249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127014.578616:0:7249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746127014.578619:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009867ee00/0x34dc807b6ef584f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e50952 expref: 5 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.578626:0:7249:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88007be26800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746127014.578636:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746127014.578638:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746127014.578639:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127014.584261:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.584362:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991992064 00000100:00100000:2.0:1746127014.584371:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991992064 00000100:00100000:2.0:1746127014.584414:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17451 00000100:00100000:2.0:1746127014.584421:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+5:2025:x1830945991992064:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:2.0:1746127014.584445:0:7258:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee45f 00000100:00080000:2.0:1746127014.584452:0:7258:0:(import.c:66:import_set_state_nolock()) ffff880136202000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746127014.584475:0:7258:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977419 00000100:00100000:2.0:1746127014.584582:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fe8879d-be98-4482-9466-43db8bbe4a76+3:2025:x1830945991992064:12345-192.168.203.42@tcp:39:umount.0 Request processed in 161us (328us total) trans 4294977420 rc 0/0 00000100:00100000:2.0:1746127014.584588:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17451 00010000:00010000:1.0:1746127014.584712:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127014.882079:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.882271:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991992832 00000100:00100000:2.0:1746127014.882280:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991992832 00000100:00100000:0.0:1746127014.882288:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.882309:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.882322:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991992960 00000100:00100000:0.0:1746127014.882325:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991992960 00000100:00100000:2.0:1746127014.882326:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22460 00000100:00100000:2.0:1746127014.882332:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+10:2025:x1830945991992832:12345-192.168.203.42@tcp:9:umount.0 00000100:00100000:0.0:1746127014.882348:0:26073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991993216 00000100:00100000:0.0:1746127014.882351:0:26073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991993216 00000100:00100000:0.0:1746127014.882364:0:26073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1058 00000100:00100000:0.0:1746127014.882368:0:26073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ee06c75c-5a89-45a6-932b-08fb02e0019d+13:2027:x1830945991992960:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746127014.882373:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1059 00010000:00010000:0.0:1746127014.882376:0:26073:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746127014.882381:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee06c75c-5a89-45a6-932b-08fb02e0019d+13:2027:x1830945991993216:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127014.882389:0:7246:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746127014.882392:0:26073:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880095f45c00/0x34dc807b6eee482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c711 expref: 13 pid: 8221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.882397:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012158c600/0x34dc807b6eee489 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c718 expref: 13 pid: 8223 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.882407:0:26073:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127014.882409:0:7246:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127014.882416:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127014.882430:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991993088 00000100:00100000:1.0:1746127014.882437:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991993088 00000100:00100000:3.0:1746127014.882442:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee06c75c-5a89-45a6-932b-08fb02e0019d+12:2027:x1830945991993216:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.882451:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1059 00000100:00100000:1.0:1746127014.882458:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1060 00000100:00100000:1.0:1746127014.882463:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee06c75c-5a89-45a6-932b-08fb02e0019d+11:2027:x1830945991993088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127014.882469:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127014.882477:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012158dc00/0x34dc807b6eee47b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c6e0 expref: 11 pid: 8221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.882487:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127014.882508:0:26073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ee06c75c-5a89-45a6-932b-08fb02e0019d+10:2027:x1830945991992960:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 137us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.882514:0:26073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1058 00000020:00000080:2.0:1746127014.882551:0:9612:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee4a5 00000020:00010000:2.0:1746127014.882556:0:9612:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b18cd800: total 0 00000100:00080000:2.0:1746127014.882559:0:9612:0:(import.c:66:import_set_state_nolock()) ffff8800b18c9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746127014.882600:0:9612:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179875748 00000100:00100000:1.0:1746127014.882604:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c428380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee06c75c-5a89-45a6-932b-08fb02e0019d+9:2027:x1830945991993088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 141us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.882609:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1060 00000020:00010000:1.0:1746127014.882638:0:8418:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b18cd800: total 0 00010000:00010000:1.0:1746127014.882640:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746127014.882667:0:8418:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b18cd800, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1746127014.882698:0:8418:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009915b400/0x34dc807b6ef1d9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 69632->139263) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4e6b4 expref: 9 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.882718:0:8418:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be47400/0x34dc807b6efbce8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544a1 expref: 8 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127014.882735:0:8418:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096621400/0x34dc807b6eef77c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3186688->3420159) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4d198 expref: 7 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.882767:0:8418:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb400/0x34dc807b6efbcf6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544bd expref: 6 pid: 3542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127014.882796:0:8418:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdac800/0x34dc807b6efbcfd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544a8 expref: 5 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746127014.882805:0:8418:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b18cd800, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1746127014.882815:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746127014.882817:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746127014.882818:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746127014.883005:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+2:2025:x1830945991992832:12345-192.168.203.42@tcp:9:umount.0 Request processed in 672us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.883011:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22460 00000100:00100000:0.0:1746127014.888259:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.888330:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991994112 00000100:00100000:2.0:1746127014.888338:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991994112 00000100:00100000:2.0:1746127014.888439:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22461 00000100:00100000:2.0:1746127014.888447:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+11:2025:x1830945991994112:12345-192.168.203.42@tcp:9:umount.0 00000020:00000080:2.0:1746127014.888470:0:9612:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee49e 00000020:00010000:2.0:1746127014.888475:0:9612:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a7ec8000: total 0 00000100:00080000:2.0:1746127014.888478:0:9612:0:(import.c:66:import_set_state_nolock()) ffff8800a7ec9800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1746127014.888595:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1746127014.888640:0:9612:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474843028 00000100:00100000:2.0:1746127014.888747:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+9:2025:x1830945991994112:12345-192.168.203.42@tcp:9:umount.0 Request processed in 300us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.888754:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22461 00000020:00010000:3.0:1746127014.888800:0:7249:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a7ec8000: total 0 00010000:00010000:3.0:1746127014.888830:0:7249:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a7ec8000, canceled 0 locks, left on hash table 6. 00010000:00010000:3.0:1746127014.888872:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc33a00/0x34dc807b6ef0e9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5337088->5349375) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4de4f expref: 8 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.889065:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdad600/0x34dc807b6efbcef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544af expref: 7 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.889085:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be46e00/0x34dc807b6efbce1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5449a expref: 6 pid: 9612 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.889104:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdac400/0x34dc807b6efbd04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544b6 expref: 5 pid: 16295 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.889119:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc33c00/0x34dc807b6ef0e97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2191360->2203647) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4de48 expref: 4 pid: 3148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.889162:0:7249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c35d000/0x34dc807b6ef1dc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 69632->139263) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4e6bb expref: 3 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.889174:0:7249:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a7ec8000, canceled 6 locks, left on hash table 0. 00010000:00010000:3.0:1746127014.889185:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746127014.889186:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746127014.889188:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127014.896186:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.896368:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991994496 00000100:00100000:2.0:1746127014.896377:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991994496 00000100:00100000:2.0:1746127014.896433:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17452 00000100:00100000:2.0:1746127014.896441:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+8:2025:x1830945991994496:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:2.0:1746127014.896473:0:13466:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee490 00000020:00010000:2.0:1746127014.896480:0:13466:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800948be000: total 0 00000100:00080000:2.0:1746127014.896484:0:13466:0:(import.c:66:import_set_state_nolock()) ffff8800a17da000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746127014.896508:0:13466:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589938433 00000100:00100000:2.0:1746127014.896620:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+7:2025:x1830945991994496:12345-192.168.203.42@tcp:39:umount.0 Request processed in 180us (445us total) trans 8589938434 rc 0/0 00000100:00100000:2.0:1746127014.896627:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17452 00000020:00010000:1.0:1746127014.897036:0:7248:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800948be000: total 0 00010000:00010000:1.0:1746127014.897086:0:7248:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800948be000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1746127014.897119:0:7248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127014.897122:0:7248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746127014.897152:0:7248:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099158a00/0x34dc807b6efbd51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544c4 expref: 6 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.897239:0:7248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:1.0:1746127014.897242:0:7248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746127014.897247:0:7248:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012158cc00/0x34dc807b6eee4b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e4c749 expref: 5 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.897258:0:7248:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800948be000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1746127014.897269:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746127014.897271:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746127014.897273:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127014.901239:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.901311:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991994624 00000100:00100000:2.0:1746127014.901320:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991994624 00000100:00100000:2.0:1746127014.901367:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17453 00000100:00100000:2.0:1746127014.901373:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+5:2025:x1830945991994624:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:2.0:1746127014.901404:0:7258:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x34dc807b6eee497 00000100:00080000:2.0:1746127014.901412:0:7258:0:(import.c:66:import_set_state_nolock()) ffff88012b701000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746127014.901439:0:7258:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977420 00010000:00010000:1.0:1746127014.901689:0:8418:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746127014.901892:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9aa25437-d8fd-42dc-83ee-e47ee25fa1a0+3:2025:x1830945991994624:12345-192.168.203.42@tcp:39:umount.0 Request processed in 516us (660us total) trans 4294977421 rc 0/0 00000100:00100000:2.0:1746127014.901899:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17453 00010000:00010000:3.0:1746127014.917356:0:7249:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746127014.927340:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.927444:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991994752 00000100:00100000:2.0:1746127014.927454:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991994752 00000100:00100000:2.0:1746127014.927503:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17454 00000100:00100000:2.0:1746127014.927515:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4741:x1830945991994752:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127014.927542:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127014.927560:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6efbd58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544cb expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.927630:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927642:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927651:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927663:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927668:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927673:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927753:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927761:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927766:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127014.927807:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:2.0:1746127014.927812:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746127014.927827:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927835:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927844:0:7258:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927849:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927854:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927860:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927866:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdade00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127014.927870:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927876:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927886:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880075c06100) 00010000:00010000:2.0:1746127014.927888:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127014.927893:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927898:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdade00/0x34dc807b6efbd5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927924:0:7258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927929:0:7258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927936:0:7258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927941:0:7258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdac600 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:2.0:1746127014.927943:0:7258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927947:0:7258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927953:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009662ef00) 00010000:00010000:2.0:1746127014.927954:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746127014.927956:0:7258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927960:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.927992:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6efbd58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 29 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.928003:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 28 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.928009:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127014.928010:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746127014.928012:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdad400, rc 0) 00000100:00100000:2.0:1746127014.928096:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4741:x1830945991994752:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 585us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.928102:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17454 00000100:00100000:2.0:1746127014.931067:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127014.931962:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991995008 00000100:00100000:3.0:1746127014.931971:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991995008 00000100:00100000:3.0:1746127014.932098:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17455 00000100:00100000:3.0:1746127014.932107:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4741:x1830945991995008:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127014.932124:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127014.932155:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6600/0x34dc807b6efbd74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544d2 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.932253:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127014.932266:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 29 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.932273:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127014.932306:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 29 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.932316:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 29 pid: 7258 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746127014.932327:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994388480:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127014.932428:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746127014.934945:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130a75180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994388480:192.168.203.42@tcp:104: 00010000:00010000:3.0:1746127014.934970:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127014.935163:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127014.935193:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991995136 00000100:00100000:1.0:1746127014.935200:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991995136 00010000:00010000:1.0:1746127014.935231:0:7245:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 30 pid: 7258 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746127014.935264:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10561 00000100:00100000:1.0:1746127014.935272:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991995136:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746127014.935283:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746127014.935288:0:7245:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 30 pid: 7258 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746127014.935298:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 30 pid: 7258 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746127014.935319:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdad400/0x34dc807b6efbd6d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544cb expref: 30 pid: 7258 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746127014.935345:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:1.0:1746127014.935349:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127014.935358:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127014.935365:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:1.0:1746127014.935395:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746127014.935434:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991995136:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 162us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.935441:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10561 00010000:00010000:2.0:1746127014.935676:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.935684:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:2.0:1746127014.935702:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:2.0:1746127014.935825:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6600/0x34dc807b6efbd74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 30 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.935842:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 29 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.935847:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127014.935849:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746127014.935851:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7c00, rc 0) 00000100:00100000:2.0:1746127014.935874:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4741:x1830945991995008:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3769us (4818us total) trans 8589938435 rc 0/0 00000100:00100000:2.0:1746127014.935880:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17455 00000100:00100000:0.0:1746127014.937319:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.937415:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991995264 00000100:00100000:2.0:1746127014.937420:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991995264 00000100:00100000:2.0:1746127014.937489:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17456 00000100:00100000:2.0:1746127014.937497:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4741:x1830945991995264:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127014.937517:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127014.937531:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6efbd89 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544d9 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.937601:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.937612:0:7258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 30 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.937619:0:7258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.937645:0:7258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 30 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.937655:0:7258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 30 pid: 7258 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746127014.937666:0:7258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994388608:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127014.937934:0:7258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c33b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746127014.938782:0:7258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7258:1830945994388608:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127014.938797:0:7258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000100:00100000:0.0:1746127014.938964:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.939005:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991995392 00000100:00100000:2.0:1746127014.939008:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991995392 00010000:00010000:2.0:1746127014.939025:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 31 pid: 7258 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746127014.939051:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10562 00000100:00100000:2.0:1746127014.939057:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945991995392:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746127014.939068:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127014.939073:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 31 pid: 7258 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746127014.939082:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 31 pid: 7258 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746127014.939098:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7c00/0x34dc807b6efbd7b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d2 expref: 31 pid: 7258 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746127014.939166:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127014.939171:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.939179:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.939186:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127014.939211:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127014.939248:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991995392:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 190us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.939254:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10562 00010000:00010000:3.0:1746127014.939338:0:7258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127014.939351:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127014.939470:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:3.0:1746127014.939474:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746127014.939488:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127014.939514:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdaca00/0x34dc807b6efbd89 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d9 expref: 30 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.939746:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d9 expref: 29 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.939752:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127014.939754:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746127014.939757:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdac600, rc 0) 00000100:00100000:3.0:1746127014.939945:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4741:x1830945991995264:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2448us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.939951:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17456 00000100:00100000:0.0:1746127014.941791:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127014.941997:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991995648 00000100:00100000:1.0:1746127014.942004:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991995648 00000100:00100000:1.0:1746127014.942351:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6692 00000100:00100000:1.0:1746127014.942360:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4bad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4741:x1830945991995648:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1746127014.943042:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4bad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4741:x1830945991995648:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 682us (1254us total) trans 8589938436 rc 0/0 00000100:00100000:1.0:1746127014.943050:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6692 00000100:00100000:0.0:1746127014.944366:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127014.944421:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991995904 00000100:00100000:3.0:1746127014.944427:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991995904 00000100:00100000:3.0:1746127014.944469:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17457 00000100:00100000:3.0:1746127014.944475:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4741:x1830945991995904:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127014.944490:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127014.944494:0:7258:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746127014.944519:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d2c3800/0x34dc807b6ef5864 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5094b expref: 30 pid: 7259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.944538:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127014.944542:0:7258:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746127014.944554:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbd97 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544e0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.944626:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6400/0x34dc807b6efbd9e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127014.944637:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6400/0x34dc807b6efbd9e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127014.944646:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6400/0x34dc807b6efbd9e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:3.0:1746127014.944656:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00010000:00010000:3.0:1746127014.944711:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbd97 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e0 expref: 32 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.944722:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6400/0x34dc807b6efbd9e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e0 expref: 31 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.944728:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127014.944730:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746127014.944733:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6400, rc 0) 00000100:00100000:3.0:1746127014.944772:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4741:x1830945991995904:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 297us (408us total) trans 8589938437 rc 0/0 00000100:00100000:3.0:1746127014.944778:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17457 00000100:00100000:0.0:1746127014.946208:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.946238:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.946261:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.946268:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991996032 00000100:00100000:2.0:1746127014.946275:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991996032 00000100:00100000:0.0:1746127014.946275:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.946288:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.946484:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991996288 00000100:00080000:1.0:1746127014.946485:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746127014.946488:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991996288 00000100:00100000:1.0:1746127014.946499:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991996544 00000100:00100000:0.0:1746127014.946503:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127014.946504:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991996544 00000100:00080000:1.0:1746127014.946508:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746127014.946515:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991996160 00000100:00100000:2.0:1746127014.946517:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991996160 00000100:00100000:0.0:1746127014.946528:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991996416 00000100:00100000:2.0:1746127014.946529:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991996672 00000100:00100000:2.0:1746127014.946531:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991996672 00000100:00100000:0.0:1746127014.946532:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991996416 00000100:00100000:1.0:1746127014.946534:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22462 00000100:00100000:1.0:1746127014.946540:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2026:x1830945991996032:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:2.0:1746127014.946545:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22463 00000100:00100000:2.0:1746127014.946551:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991996288:12345-192.168.203.42@tcp:1:lfs.0 00002000:00010000:2.0:1746127014.946582:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x808 00002000:00010000:1.0:1746127014.946582:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x7f8 00010000:00010000:2.0:1746127014.946590:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946590:0:12333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946601:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127014.946603:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127014.946607:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946616:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127014.946616:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946618:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.946621:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946624:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946628:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946630:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946633:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946637:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f560e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127014.946639:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946640:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946644:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946644:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946650:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946652:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946655:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bafee00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127014.946655:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f560e00/0x34dc807b6efbdac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946657:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946663:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946670:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946681:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bafee00/0x34dc807b6efbdb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127014.946696:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2026:x1830945991996032:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 157us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.946713:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22464 00000100:00100000:2.0:1746127014.946718:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2026:x1830945991996288:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 167us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.946720:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2026:x1830945991996544:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:2.0:1746127014.946724:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22463 00000100:00100000:2.0:1746127014.946737:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22465 00000100:00100000:2.0:1746127014.946741:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991996160:12345-192.168.203.42@tcp:1:lfs.0 00002000:00010000:0.0:1746127014.946742:0:12340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x14e0 00010000:00010000:0.0:1746127014.946747:0:12340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946754:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127014.946756:0:12340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127014.946758:0:12340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127014.946759:0:9612:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x800 00010000:00010000:2.0:1746127014.946763:0:9612:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946766:0:12340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946769:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.946770:0:9612:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.946773:0:9612:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946774:0:12340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946780:0:9612:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946780:0:12340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946784:0:12340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946788:0:9612:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946788:0:12340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099158e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127014.946790:0:12340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946793:0:9612:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946804:0:9612:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.946809:0:9612:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baff800 already unused, calling callback (ffffffffa087ad70) 00000100:00100000:3.0:1746127014.946812:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22466 00010000:00010000:2.0:1746127014.946812:0:9612:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127014.946816:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22462 00010000:00010000:2.0:1746127014.946817:0:9612:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127014.946820:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991996672:12345-192.168.203.42@tcp:1:lfs.0 00000100:00100000:1.0:1746127014.946824:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22467 00010000:00010000:2.0:1746127014.946825:0:9612:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127014.946827:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+19:2026:x1830945991996416:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1746127014.946830:0:9612:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012baff800/0x34dc807b6efbdc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9612 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746127014.946839:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x800 00010000:00010000:1.0:1746127014.946842:0:12333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127014.946845:0:1507:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x1008 00010000:00010000:1.0:1746127014.946846:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127014.946847:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127014.946848:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946853:0:12333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127014.946855:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2026:x1830945991996160:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 114us (579us total) trans 0 rc 0/0 00010000:00010000:1.0:1746127014.946857:0:12333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127014.946860:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22465 00010000:00010000:1.0:1746127014.946860:0:12333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946864:0:12333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946867:0:12333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f561400 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127014.946868:0:12333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946872:0:12333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946877:0:12333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127014.946880:0:12333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f561400/0x34dc807b6efbdc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127014.946896:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+19:2026:x1830945991996416:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 68us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.946899:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22467 00010000:00010000:0.0:1746127014.946908:0:12340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946917:0:12340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.946922:0:12340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099158e00/0x34dc807b6efbdba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127014.946969:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+18:2026:x1830945991996544:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 250us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.946985:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22464 00010000:00010000:3.0:1746127014.947123:0:1507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947148:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.947149:0:1507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.947152:0:1507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947161:0:1507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947172:0:1507:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947178:0:1507:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947184:0:1507:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947189:0:1507:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbf6e00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127014.947196:0:1507:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947202:0:1507:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947215:0:1507:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127014.947221:0:1507:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6e00/0x34dc807b6efbdcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127014.947270:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2026:x1830945991996672:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 451us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.947276:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22466 00000100:00100000:0.0:1746127014.953475:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.954960:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991996928 00000100:00100000:2.0:1746127014.954980:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991996928 00000100:00100000:2.0:1746127014.955028:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17458 00000100:00100000:2.0:1746127014.955036:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4741:x1830945991996928:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1746127014.955090:0:13466:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127014.955116:0:13466:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdac600/0x34dc807b6efbd90 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544d9 expref: 31 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.955155:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127014.955159:0:13466:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127014.955183:0:13466:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127014.955194:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:2.0:1746127014.955201:0:13466:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00000040:00080000:2.0:1746127014.955455:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1499, 88 off139528 00000004:00080000:2.0:1746127014.955462:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997332085ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955487:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1506, 88 off140232 00000004:00080000:2.0:1746127014.955491:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997362062ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127014.955519:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1507, 88 off140320 00000004:00080000:2.0:1746127014.955522:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997393143ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127014.955530:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1500, 88 off139616 00000004:00080000:2.0:1746127014.955533:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997403690ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955554:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1501, 88 off139704 00000004:00080000:2.0:1746127014.955557:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997427265ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955564:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1508, 88 off140408 00000004:00080000:2.0:1746127014.955567:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997437363ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127014.955575:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1509, 88 off140496 00000004:00080000:2.0:1746127014.955577:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997448017ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127014.955586:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1510, 88 off140584 00000004:00080000:2.0:1746127014.955588:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997458548ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127014.955596:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1502, 88 off139792 00000004:00080000:2.0:1746127014.955600:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997470457ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955608:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1511, 88 off140672 00000004:00080000:2.0:1746127014.955610:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997480547ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127014.955631:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1503, 88 off139880 00000004:00080000:2.0:1746127014.955635:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997505193ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955644:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1512, 88 off140760 00000004:00080000:2.0:1746127014.955646:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997516985ns, next at 895431202182ns, rc = 0 00000040:00080000:2.0:1746127014.955653:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1504, 88 off139968 00000004:00080000:2.0:1746127014.955656:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997526578ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955665:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1505, 88 off140056 00000004:00080000:2.0:1746127014.955668:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997538635ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955676:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1506, 88 off140144 00000004:00080000:2.0:1746127014.955679:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997549835ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955688:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1507, 88 off140232 00000004:00080000:2.0:1746127014.955690:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 909997561075ns, next at 847916292410ns, rc = 0 00000040:00080000:2.0:1746127014.955698:0:13466:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1513, 88 off140848 00000004:00080000:2.0:1746127014.955700:0:13466:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 909997571182ns, next at 895431202182ns, rc = 0 00000001:00080000:3.0:1746127014.960241:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938438 is committed 00000004:00080000:3.0:1746127014.960254:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1486 committed 00000004:00080000:3.0:1746127014.960274:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1480 committed 00000004:00080000:3.0:1746127014.960279:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1479 committed 00000004:00080000:3.0:1746127014.960281:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1478 committed 00000004:00080000:3.0:1746127014.960282:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1477 committed 00000004:00080000:3.0:1746127014.960284:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1485 committed 00000004:00080000:3.0:1746127014.960285:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1476 committed 00000004:00080000:3.0:1746127014.960287:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1484 committed 00000004:00080000:3.0:1746127014.960288:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1475 committed 00000004:00080000:3.0:1746127014.960290:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1483 committed 00000004:00080000:3.0:1746127014.960292:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1482 committed 00000004:00080000:3.0:1746127014.960293:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1481 committed 00000004:00080000:3.0:1746127014.960295:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1474 committed 00000004:00080000:3.0:1746127014.960296:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1473 committed 00000004:00080000:3.0:1746127014.960298:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1480 committed 00000004:00080000:3.0:1746127014.960299:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1479 committed 00000004:00080000:3.0:1746127014.960301:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1472 committed 00000001:00100000:3.0:1746127014.960314:0:8217:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9aa25437-d8fd-42dc-83ee-e47ee25fa1a0 00000001:00080000:3.0:1746127014.960320:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938434 is committed 00000001:00100000:3.0:1746127014.960323:0:8217:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fe8879d-be98-4482-9466-43db8bbe4a76 00000001:00080000:3.0:1746127014.960326:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938433 is committed 00000020:00000080:3.0:1746127014.960330:0:8217:0:(genops.c:904:class_export_put()) final put ffff88007be26800/9fe8879d-be98-4482-9466-43db8bbe4a76 00000020:00000080:3.0:1746127014.960342:0:8217:0:(genops.c:904:class_export_put()) final put ffff8800948be000/9aa25437-d8fd-42dc-83ee-e47ee25fa1a0 00000020:00000080:3.0:1746127014.960373:0:3040:0:(genops.c:863:class_export_destroy()) destroying export ffff88007be26800/9fe8879d-be98-4482-9466-43db8bbe4a76 for lustre-MDT0000 00000020:00000080:3.0:1746127014.960431:0:3040:0:(genops.c:863:class_export_destroy()) destroying export ffff8800948be000/9aa25437-d8fd-42dc-83ee-e47ee25fa1a0 for lustre-MDT0000 00000020:00000080:3.0:1746127014.960457:0:3040:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88007be23800 for lustre-MDT0000 00000020:00000080:3.0:1746127014.960462:0:3040:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a17da000 for lustre-MDT0000 00000004:00010000:3.0:1746127014.960512:0:13466:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c5e1500 reply state ffff8800991cd000 transno 8589938438 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960534:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960542:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127014.960545:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746127014.960549:0:13466:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746127014.960648:0:13466:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746127014.960664:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4741:x1830945991996928:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 5624us (7203us total) trans 8589938438 rc 0/0 00000100:00100000:3.0:1746127014.960672:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17458 00010000:00010000:3.0:1746127014.960705:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960711:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960718:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960723:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bafee00 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127014.960727:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960733:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960742:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127014.960743:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746127014.960745:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00010000:00010000:3.0:1746127014.960750:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bafee00/0x34dc807b6efbdd6 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13466 initiator: MDT0 00000100:00100000:2.0:1746127014.961107:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994388864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961107:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994388992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127014.961175:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.961309:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.961333:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994389504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961350:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.961370:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994388736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961391:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.961402:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994389248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961414:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.961425:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746127014.961428:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994389120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961442:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.961451:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994389632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961465:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.961483:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994388864 00000100:00100000:1.0:1746127014.961489:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994388864 00000100:00100000:1.0:1746127014.961517:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994388992 00000100:00100000:1.0:1746127014.961519:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994388992 00000100:00100000:1.0:1746127014.961527:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994389504 00000100:00100000:1.0:1746127014.961529:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994389504 00000100:00100000:1.0:1746127014.961536:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994388736 00000100:00100000:1.0:1746127014.961538:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994388736 00000100:00100000:1.0:1746127014.961546:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994389248 00000100:00100000:1.0:1746127014.961548:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994389248 00000100:00100000:1.0:1746127014.961553:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994389120 00000100:00100000:1.0:1746127014.961554:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994389120 00000100:00100000:1.0:1746127014.961559:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994389632 00000100:00100000:1.0:1746127014.961561:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994389632 00000100:00100000:1.0:1746127014.961569:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22468 00000100:00100000:1.0:1746127014.961574:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3782:x1830945994388864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961702:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3782:x1830945994388864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (527us total) trans 17179875749 rc 0/0 00000100:00100000:1.0:1746127014.961709:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22468 00000100:00100000:1.0:1746127014.961719:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22469 00000100:00100000:1.0:1746127014.961723:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3783:x1830945994388992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961774:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3783:x1830945994388992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (465us total) trans 17179875750 rc 0/0 00000100:00100000:1.0:1746127014.961779:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22469 00000100:00100000:1.0:1746127014.961788:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22470 00000100:00100000:1.0:1746127014.961792:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3783:x1830945994389504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.961848:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3783:x1830945994389504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (497us total) trans 17179875751 rc 0/0 00000100:00100000:1.0:1746127014.961854:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22470 00000100:00100000:1.0:1746127014.961950:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22471 00000100:00100000:1.0:1746127014.961955:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3785:x1830945994388736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.962020:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994388736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (628us total) trans 17179875752 rc 0/0 00000100:00100000:1.0:1746127014.962026:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22471 00000100:00100000:1.0:1746127014.962035:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22472 00000100:00100000:1.0:1746127014.962039:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3785:x1830945994389248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.962103:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994389248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (686us total) trans 17179875753 rc 0/0 00000100:00100000:1.0:1746127014.962108:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22472 00000100:00100000:1.0:1746127014.962116:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22473 00000100:00100000:1.0:1746127014.962120:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3785:x1830945994389120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.962187:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994389120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (743us total) trans 17179875754 rc 0/0 00000100:00100000:1.0:1746127014.962192:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22473 00000100:00100000:1.0:1746127014.962200:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22474 00000100:00100000:1.0:1746127014.962204:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3785:x1830945994389632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127014.962250:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3785:x1830945994389632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (784us total) trans 17179875755 rc 0/0 00000100:00100000:1.0:1746127014.962255:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22474 00000100:00100000:1.0:1746127014.962281:0:3783:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875748 gen 2 00000004:00080000:1.0:1746127014.962285:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e6ea00, transno 17179875668 00000004:00080000:1.0:1746127014.962291:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e6f100, transno 17179875669 00000004:00080000:1.0:1746127014.962295:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee8e00, transno 17179875670 00000004:00080000:1.0:1746127014.962298:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e6c700, transno 17179875671 00000004:00080000:1.0:1746127014.962300:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee9500, transno 17179875672 00000004:00080000:1.0:1746127014.962302:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee8700, transno 17179875673 00000004:00080000:1.0:1746127014.962305:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8ee8000, transno 17179875674 00000004:00080000:1.0:1746127014.962307:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e6dc00, transno 17179875675 00000004:00080000:1.0:1746127014.962310:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d2a00, transno 17179875676 00000004:00080000:1.0:1746127014.962313:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b99180, transno 17179875677 00000004:00080000:1.0:1746127014.962315:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b9aa00, transno 17179875678 00000004:00080000:1.0:1746127014.962317:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b9b480, transno 17179875679 00000004:00080000:1.0:1746127014.962320:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b98a80, transno 17179875680 00000004:00080000:1.0:1746127014.962322:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b9b800, transno 17179875681 00000004:00080000:1.0:1746127014.962324:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801303d1180, transno 17179875682 00000004:00080000:1.0:1746127014.962326:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b99f80, transno 17179875683 00000004:00080000:1.0:1746127014.962329:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba54a80, transno 17179875689 00000004:00080000:1.0:1746127014.962331:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba54380, transno 17179875690 00000004:00080000:1.0:1746127014.962333:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba55880, transno 17179875691 00000004:00080000:1.0:1746127014.962336:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba55500, transno 17179875692 00000004:00080000:1.0:1746127014.962338:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba54700, transno 17179875693 00000004:00080000:1.0:1746127014.962341:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba54000, transno 17179875694 00000004:00080000:1.0:1746127014.962343:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba56d80, transno 17179875695 00000004:00080000:1.0:1746127014.962345:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba56680, transno 17179875696 00000004:00080000:1.0:1746127014.962347:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba56a00, transno 17179875701 00000004:00080000:1.0:1746127014.962350:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba55f80, transno 17179875702 00000004:00080000:1.0:1746127014.962352:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481a680, transno 17179875703 00000004:00080000:1.0:1746127014.962355:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba57480, transno 17179875704 00000004:00080000:1.0:1746127014.962357:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481b800, transno 17179875705 00000004:00080000:1.0:1746127014.962359:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba54e00, transno 17179875706 00000004:00080000:1.0:1746127014.962361:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba57b80, transno 17179875707 00000004:00080000:1.0:1746127014.962364:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094819880, transno 17179875708 00000004:00080000:1.0:1746127014.962367:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0dc00, transno 17179875709 00000004:00080000:1.0:1746127014.962370:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0e680, transno 17179875710 00000004:00080000:1.0:1746127014.962372:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0ed80, transno 17179875711 00000004:00080000:1.0:1746127014.962374:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0ce00, transno 17179875712 00000004:00080000:1.0:1746127014.962376:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0fb80, transno 17179875713 00000004:00080000:1.0:1746127014.962378:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0ea00, transno 17179875714 00000004:00080000:1.0:1746127014.962380:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0d500, transno 17179875715 00000004:00080000:1.0:1746127014.962383:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ab0e300, transno 17179875716 00000004:00080000:1.0:1746127014.962385:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22e680, transno 17179875729 00000004:00080000:1.0:1746127014.962387:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22ca80, transno 17179875730 00000004:00080000:1.0:1746127014.962389:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3fc700, transno 17179875731 00000004:00080000:1.0:1746127014.962392:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f480, transno 17179875732 00000004:00080000:1.0:1746127014.962394:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22ce00, transno 17179875733 00000004:00080000:1.0:1746127014.962396:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801220f0a80, transno 17179875734 00000004:00080000:1.0:1746127014.962398:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d22f800, transno 17179875735 00000004:00080000:1.0:1746127014.962401:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d3ff100, transno 17179875736 00000004:00080000:1.0:1746127014.962404:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b7aa00, transno 17179875741 00000004:00080000:1.0:1746127014.962406:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b79f80, transno 17179875742 00000004:00080000:1.0:1746127014.962408:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc62300, transno 17179875743 00000004:00080000:1.0:1746127014.962410:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094819c00, transno 17179875744 00000004:00080000:1.0:1746127014.962412:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094818700, transno 17179875745 00000004:00080000:1.0:1746127014.962415:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc63b80, transno 17179875746 00000004:00080000:1.0:1746127014.962416:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094818380, transno 17179875747 00000004:00080000:1.0:1746127014.962418:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dc63800, transno 17179875748 00000100:00100000:1.0:1746127014.962424:0:3783:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88007ec46d80 x1830945994388992/t17179875750(17179875750) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127030 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746127014.962433:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec46d80/2, rc 0, transno 17179875750 00000100:00100000:1.0:1746127014.962438:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994388992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127014.962448:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec44380/2, rc 0, transno 17179875751 00000100:00100000:1.0:1746127014.962451:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994389504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127014.962627:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f15f80/2, rc 0, transno 17179875749 00000100:00100000:2.0:1746127014.962631:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994388864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127014.962636:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994389376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127014.962655:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127014.962678:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994389376 00000100:00100000:2.0:1746127014.962680:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994389376 00000100:00100000:2.0:1746127014.962697:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22475 00000100:00100000:2.0:1746127014.962702:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3782:x1830945994389376:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127014.962706:0:8233:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 56 done 00000004:00080000:1.0:1746127014.962724:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec47480/2, rc 0, transno 17179875754 00000100:00100000:1.0:1746127014.962727:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994389120:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127014.962733:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec45f80/2, rc 0, transno 17179875755 00000100:00100000:1.0:1746127014.962735:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994389632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127014.962741:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c428380/2, rc 0, transno 17179875752 00000100:00100000:1.0:1746127014.962743:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994388736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127014.962748:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec46300/2, rc 0, transno 17179875753 00000100:00100000:1.0:1746127014.962750:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994389248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127014.962760:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994389376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (105us total) trans 17179875756 rc 0/0 00000100:00100000:2.0:1746127014.962766:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22475 00000004:00080000:2.0:1746127014.962786:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec45880/2, rc 0, transno 17179875756 00000100:00100000:2.0:1746127014.962788:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994389376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127014.963323:0:3784:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746127014.963331:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994389760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.963355:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127014.963363:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994390016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.963379:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994390144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127014.963389:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127014.963406:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127014.963471:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994389888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127014.963554:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994390528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127014.963646:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994390272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.963990:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994390656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.964009:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127014.964372:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127014.964671:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994389760 00000100:00100000:0.0:1746127014.964677:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994389760 00000100:00100000:0.0:1746127014.964702:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994390016 00000100:00100000:0.0:1746127014.964704:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994390016 00000100:00100000:0.0:1746127014.964713:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994390144 00000100:00100000:0.0:1746127014.964715:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994390144 00000100:00100000:0.0:1746127014.964725:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994390656 00000100:00100000:0.0:1746127014.964726:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994390656 00000100:00100000:0.0:1746127014.964737:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22476 00000100:00100000:0.0:1746127014.964743:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3784:x1830945994389760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127014.964867:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3784:x1830945994389760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (1510us total) trans 21474843029 rc 0/0 00000100:00100000:0.0:1746127014.964873:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22476 00000100:00100000:0.0:1746127014.964886:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22477 00000100:00100000:0.0:1746127014.964891:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3783:x1830945994390016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127014.964941:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3783:x1830945994390016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (1551us total) trans 21474843030 rc 0/0 00000100:00100000:0.0:1746127014.964946:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22477 00000100:00100000:0.0:1746127014.964954:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22478 00000100:00100000:0.0:1746127014.964958:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3784:x1830945994390144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127014.965026:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3784:x1830945994390144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1618us total) trans 21474843031 rc 0/0 00000100:00100000:0.0:1746127014.965031:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22478 00000100:00100000:0.0:1746127014.965041:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22479 00000100:00100000:0.0:1746127014.965046:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3784:x1830945994390656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127014.965096:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3784:x1830945994390656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (1086us total) trans 21474843032 rc 0/0 00000100:00100000:0.0:1746127014.965101:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22479 00000100:00100000:0.0:1746127014.965183:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.965202:0:13466:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997056 00000100:00100000:0.0:1746127014.965205:0:13466:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997056 00000100:00100000:0.0:1746127014.965228:0:13466:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17459 00000100:00100000:0.0:1746127014.965232:0:13466:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4741:x1830945991997056:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127014.965248:0:13466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127014.965263:0:13466:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544e7 expref: -99 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.965309:0:13466:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 28 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.965322:0:13466:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 28 pid: 13466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127014.965325:0:3783:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843028 gen 2 00000004:00080000:3.0:1746127014.965331:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3d500, transno 21474842964 00000004:00080000:3.0:1746127014.965337:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3c380, transno 21474842965 00000004:00080000:3.0:1746127014.965340:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3c700, transno 21474842966 00010000:00010000:0.0:1746127014.965340:0:13466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00000004:00080000:3.0:1746127014.965342:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3ce00, transno 21474842967 00010000:00010000:0.0:1746127014.965343:0:13466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:3.0:1746127014.965344:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3d180, transno 21474842968 00000004:00080000:3.0:1746127014.965346:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3f480, transno 21474842969 00010000:00010000:0.0:1746127014.965346:0:13466:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009867fe00, rc 0) 00000004:00080000:3.0:1746127014.965349:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3dc00, transno 21474842970 00000004:00080000:3.0:1746127014.965352:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cc3d880, transno 21474842971 00000004:00080000:3.0:1746127014.965355:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007edd7800, transno 21474842972 00000004:00080000:3.0:1746127014.965358:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094819f80, transno 21474842977 00000004:00080000:3.0:1746127014.965360:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094818000, transno 21474842978 00000004:00080000:3.0:1746127014.965363:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481aa00, transno 21474842979 00000004:00080000:3.0:1746127014.965364:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481a300, transno 21474842980 00000004:00080000:3.0:1746127014.965367:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481ad80, transno 21474842981 00000004:00080000:3.0:1746127014.965369:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481bb80, transno 21474842982 00000004:00080000:3.0:1746127014.965371:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481b480, transno 21474842983 00000004:00080000:3.0:1746127014.965373:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009481b100, transno 21474842984 00000004:00080000:3.0:1746127014.965375:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094b78700, transno 21474842985 00000100:00100000:0.0:1746127014.965376:0:13466:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4741:x1830945991997056:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 143us (195us total) trans 0 rc 0/0 00000004:00080000:3.0:1746127014.965377:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a62d80, transno 21474842986 00000004:00080000:3.0:1746127014.965379:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a62300, transno 21474842987 00000100:00100000:0.0:1746127014.965381:0:13466:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17459 00000004:00080000:3.0:1746127014.965382:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60e00, transno 21474842988 00000100:00100000:2.0:1746127014.965383:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994390528 00000100:00100000:2.0:1746127014.965388:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994390528 00000004:00080000:3.0:1746127014.965389:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60700, transno 21474842989 00000004:00080000:3.0:1746127014.965392:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a61880, transno 21474842990 00000004:00080000:3.0:1746127014.965394:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a62a00, transno 21474842991 00000004:00080000:3.0:1746127014.965396:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60000, transno 21474842992 00000004:00080000:3.0:1746127014.965399:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a60a80, transno 21474842993 00000004:00080000:3.0:1746127014.965401:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a63b80, transno 21474842994 00000004:00080000:3.0:1746127014.965404:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1f80, transno 21474843007 00000004:00080000:3.0:1746127014.965406:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0a80, transno 21474843008 00000004:00080000:3.0:1746127014.965408:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2d80, transno 21474843009 00000100:00100000:2.0:1746127014.965411:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22480 00000004:00080000:3.0:1746127014.965413:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede3480, transno 21474843010 00000004:00080000:3.0:1746127014.965415:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0380, transno 21474843011 00000004:00080000:3.0:1746127014.965416:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede1500, transno 21474843012 00000100:00100000:2.0:1746127014.965417:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3783:x1830945994390528:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127014.965418:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede0700, transno 21474843013 00000004:00080000:3.0:1746127014.965421:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007ede2a00, transno 21474843014 00000004:00080000:3.0:1746127014.965423:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130a74a80, transno 21474843015 00000004:00080000:3.0:1746127014.965425:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099194000, transno 21474843020 00000004:00080000:3.0:1746127014.965428:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099195880, transno 21474843021 00000004:00080000:3.0:1746127014.965431:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099194e00, transno 21474843022 00000004:00080000:3.0:1746127014.965433:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099197100, transno 21474843023 00000004:00080000:3.0:1746127014.965435:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099195180, transno 21474843024 00000004:00080000:3.0:1746127014.965438:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099196680, transno 21474843025 00000004:00080000:3.0:1746127014.965440:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099194700, transno 21474843026 00000004:00080000:3.0:1746127014.965443:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099194a80, transno 21474843027 00000004:00080000:3.0:1746127014.965445:0:3783:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099197800, transno 21474843028 00000100:00100000:3.0:1746127014.965451:0:3783:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009c5e3100 x1830945994390016/t21474843030(21474843030) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746127030 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746127014.965460:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e3100/2, rc 0, transno 21474843030 00000100:00100000:3.0:1746127014.965464:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994390016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127014.965490:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3783:x1830945994390528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1117us total) trans 21474843033 rc 0/0 00000100:00100000:2.0:1746127014.965496:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22480 00000100:00100000:1.0:1746127014.965500:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127014.965505:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994390272 00000100:00100000:2.0:1746127014.965508:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994390272 00000100:00100000:2.0:1746127014.965519:0:1507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22481 00000100:00100000:2.0:1746127014.965523:0:1507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3785:x1830945994390272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127014.965590:0:1507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3785:x1830945994390272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (90us total) trans 21474843034 rc 0/0 00000100:00100000:2.0:1746127014.965595:0:1507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22481 00000100:00100000:2.0:1746127014.965614:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746127014.966833:0:8231:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 28 in progress, 7 in flight, 25 done 00000004:00080000:3.0:1746127014.967041:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e3b80/2, rc 0, transno 21474843033 00000100:00100000:3.0:1746127014.967047:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994390528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127014.967074:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e0e00/2, rc 0, transno 21474843031 00000100:00100000:3.0:1746127014.967078:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994390144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127014.967085:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e1c00/2, rc 0, transno 21474843032 00000100:00100000:3.0:1746127014.967087:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994390656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127014.967095:0:3784:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e3480/2, rc 0, transno 21474843029 00000100:00100000:3.0:1746127014.967098:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3784:1830945994389760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.967114:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994389888 00000100:00100000:3.0:1746127014.967118:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994389888 00000100:00100000:3.0:1746127014.967160:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22482 00000100:00100000:3.0:1746127014.967166:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3782:x1830945994389888:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746127014.967266:0:8231:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 3 in flight, 20 done 00000004:00080000:1.0:1746127014.967385:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e2a00/2, rc 0, transno 21474843034 00000100:00100000:1.0:1746127014.967389:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994390272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127014.967400:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994390784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127014.967427:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127014.967445:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994390784 00000100:00100000:1.0:1746127014.967448:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994390784 00000100:00100000:1.0:1746127014.967467:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22483 00000100:00100000:1.0:1746127014.967472:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3785:x1830945994390784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127014.967535:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994390784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (108us total) trans 21474843036 rc 0/0 00000100:00100000:1.0:1746127014.967541:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22483 00000004:00080000:1.0:1746127014.967963:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e1880/2, rc 0, transno 21474843036 00000100:00100000:1.0:1746127014.967968:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994390784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.968086:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3782:x1830945994389888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1644us total) trans 21474843035 rc 0/0 00000100:00100000:3.0:1746127014.968097:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22482 00000100:00100000:2.0:1746127014.968145:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994390400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127014.968177:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746127014.968218:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e0000/2, rc 0, transno 21474843035 00000100:00100000:2.0:1746127014.968222:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994389888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.968269:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994390400 00000100:00100000:3.0:1746127014.968273:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994390400 00000100:00100000:3.0:1746127014.968289:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22484 00000100:00100000:3.0:1746127014.968294:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3782:x1830945994390400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127014.968897:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3782:x1830945994390400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 601us (718us total) trans 21474843037 rc 0/0 00000100:00100000:3.0:1746127014.968903:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22484 00000004:00080000:2.0:1746127014.968960:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5e0700/2, rc 0, transno 21474843037 00000100:00100000:2.0:1746127014.968964:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994390400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127014.971346:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.971384:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997184 00000100:00100000:0.0:1746127014.971391:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997184 00000100:00100000:0.0:1746127014.971436:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17460 00000100:00100000:0.0:1746127014.971443:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4741:x1830945991997184:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127014.971459:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127014.971478:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5c00/0x34dc807b6efbde4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544ee expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.972064:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efbdeb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127014.972079:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efbdeb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127014.972093:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efbdeb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00200000:0.0:1746127014.972124:0:7258:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9022240 00000004:00200000:0.0:1746127014.972152:0:7258:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746127014.972167:0:7258:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efbdeb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:0.0:1746127014.972193:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b5c00/0x34dc807b6efbde4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544ee expref: 30 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.972209:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efbdeb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544ee expref: 29 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127014.972216:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127014.972218:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746127014.972221:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b4c00, rc 0) 00000100:00100000:0.0:1746127014.972266:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4741:x1830945991997184:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 823us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.972272:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17460 00000100:00100000:0.0:1746127014.975281:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.975516:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.975544:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.975569:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127014.975752:0:1507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997312 00000100:00100000:0.0:1746127014.975753:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.975761:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997440 00000100:00100000:1.0:1746127014.975761:0:1507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997312 00000100:00100000:2.0:1746127014.975766:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997440 00000100:00100000:0.0:1746127014.975769:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997696 00000100:00100000:0.0:1746127014.975772:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997696 00000100:00100000:0.0:1746127014.976049:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997568 00000100:00100000:0.0:1746127014.976052:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997568 00000100:00100000:0.0:1746127014.976275:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997824 00000100:00100000:0.0:1746127014.976278:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997824 00000100:00100000:3.0:1746127014.976325:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22485 00000100:00100000:2.0:1746127014.976337:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22486 00000100:00100000:3.0:1746127014.976342:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22487 00000100:00100000:2.0:1746127014.976345:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991997440:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:3.0:1746127014.976348:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991997312:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127014.976361:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127014.976361:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127014.976378:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544f5 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.976379:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e544fc expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127014.976399:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9c:0x0] initial LVB size: 1048576, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x7f8 00002000:00010000:2.0:1746127014.976399:0:9611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9f:0x0] initial LVB size: 2097152, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x800 00010000:00010000:3.0:1746127014.976416:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.976416:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.976418:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.976418:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.976426:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 21 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127014.976426:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 27 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.976440:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 21 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127014.976440:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 27 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.976449:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf7000, rc 0) 00010000:00010000:2.0:1746127014.976449:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dcc00, rc 0) 00000100:00100000:3.0:1746127014.976497:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991997312:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 150us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.976498:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991997440:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 154us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.976503:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22487 00000100:00100000:2.0:1746127014.976506:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22486 00000100:00100000:3.0:1746127014.976517:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22488 00000100:00100000:2.0:1746127014.976521:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22489 00000100:00100000:3.0:1746127014.976522:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945991997568:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1746127014.976527:0:12333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746127014.976527:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+20:2027:x1830945991997824:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127014.976532:0:9611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127014.976534:0:12333:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54503 expref: -99 pid: 12333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.976541:0:9611:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54511 expref: -99 pid: 9611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127014.976543:0:12333:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa0:0x0] initial LVB size: 2097152, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x808 00010000:00010000:3.0:1746127014.976549:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.976550:0:12333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746127014.976551:0:9611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9f:0x0] initial LVB size: 4827936, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x14e0 00010000:00010000:3.0:1746127014.976553:0:12333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 27 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127014.976558:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.976560:0:9611:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.976561:0:12333:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 27 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127014.976564:0:9611:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 21 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.976567:0:12333:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6000, rc 0) 00010000:00010000:2.0:1746127014.976573:0:9611:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 21 pid: 9611 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746127014.976579:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991997568:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 57us (1010us total) trans 0 rc 0/0 00010000:00010000:2.0:1746127014.976580:0:9611:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dd200, rc 0) 00000100:00100000:3.0:1746127014.976583:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22488 00000100:00100000:2.0:1746127014.976596:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991997824:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 69us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.976598:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991997696:12345-192.168.203.42@tcp:101:lfs.0 00000100:00100000:2.0:1746127014.976601:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22489 00010000:00010000:3.0:1746127014.976603:0:3148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746127014.976609:0:3148:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5450a expref: -99 pid: 3148 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746127014.976622:0:3148:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x800 00010000:00010000:3.0:1746127014.976627:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.976629:0:3148:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127014.976632:0:3148:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 21 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.976640:0:3148:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 21 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746127014.976646:0:3148:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbf6c00, rc 0) 00000100:00100000:2.0:1746127014.976649:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127014.976661:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991997696:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 329us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.976666:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22485 00000100:00100000:2.0:1746127014.976669:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991997952 00000100:00100000:2.0:1746127014.976672:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991997952 00000100:00100000:2.0:1746127014.976691:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22490 00000100:00100000:2.0:1746127014.976696:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2027:x1830945991997952:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127014.976702:0:9613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127014.976710:0:9613:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54518 expref: -99 pid: 9613 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127014.976724:0:9613:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0xa1:0x0] initial LVB size: 4194304, mtime: 0x6813c8a4, atime: 0x6813c8a4, ctime: 0x6813c8a4, blocks: 0x1008 00010000:00010000:2.0:1746127014.976731:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.976732:0:9613:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.976737:0:9613:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127014.976745:0:9613:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 28 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127014.976751:0:9613:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dce00, rc 0) 00000100:00100000:2.0:1746127014.976766:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991997952:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.976770:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22490 00000100:00100000:0.0:1746127014.980604:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.980644:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.980673:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.980689:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.980702:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.980727:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998208 00000100:00100000:0.0:1746127014.980735:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998208 00000100:00100000:0.0:1746127014.980786:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998464 00000100:00100000:0.0:1746127014.980789:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998464 00000100:00100000:1.0:1746127014.980799:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998720 00000100:00100000:1.0:1746127014.980803:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998720 00000100:00100000:0.0:1746127014.980803:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998080 00000100:00100000:0.0:1746127014.980805:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998080 00000100:00100000:0.0:1746127014.980814:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998336 00000100:00100000:0.0:1746127014.980816:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998336 00000100:00100000:1.0:1746127014.980830:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22491 00000100:00100000:1.0:1746127014.980837:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991998208:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127014.980939:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991998208:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.981091:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22492 00000100:00100000:0.0:1746127014.981098:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2027:x1830945991998464:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127014.981173:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2027:x1830945991998464:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 76us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.981180:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22492 00000100:00100000:0.0:1746127014.981197:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22493 00000100:00100000:0.0:1746127014.981201:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991998080:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127014.981231:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991998080:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.981236:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22493 00000100:00100000:0.0:1746127014.981245:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22494 00000100:00100000:0.0:1746127014.981250:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991998720:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127014.981277:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991998720:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.981282:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22494 00000100:00100000:0.0:1746127014.981290:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22495 00000100:00100000:0.0:1746127014.981294:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991998336:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127014.981317:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991998336:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.981322:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22495 00000100:00100000:0.0:1746127014.981363:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.981377:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998592 00000100:00100000:0.0:1746127014.981380:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998592 00000100:00100000:0.0:1746127014.981394:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22496 00000100:00100000:0.0:1746127014.981398:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991998592:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:0.0:1746127014.981428:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991998592:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 29us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127014.981432:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22496 00000100:00100000:1.0:1746127014.981715:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22491 00000100:00100000:0.0:1746127014.984721:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.985450:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.985572:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.985778:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127014.986041:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127014.986059:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998976 00000100:00100000:1.0:1746127014.986067:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998976 00000100:00100000:1.0:1746127014.986105:0:16295:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991999232 00000100:00100000:1.0:1746127014.986106:0:16295:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991999232 00000100:00100000:1.0:1746127014.986122:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991999488 00000100:00100000:1.0:1746127014.986124:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991999488 00000100:00100000:1.0:1746127014.986546:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991998848 00000100:00100000:1.0:1746127014.986550:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991998848 00000100:00100000:1.0:1746127014.986567:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991999104 00000100:00100000:1.0:1746127014.986568:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991999104 00000100:00100000:1.0:1746127014.986581:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22497 00000100:00100000:1.0:1746127014.986588:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991998976:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127014.986695:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991998976:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 107us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.986701:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22497 00000100:00100000:1.0:1746127014.986717:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22498 00000100:00100000:1.0:1746127014.986722:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2027:x1830945991999232:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127014.986763:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2027:x1830945991999232:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 41us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.986768:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22498 00000100:00100000:1.0:1746127014.986776:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22499 00000100:00100000:1.0:1746127014.986780:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991999488:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127014.986809:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991999488:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 28us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.986814:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22499 00000100:00100000:1.0:1746127014.986823:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22500 00000100:00100000:1.0:1746127014.986827:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991998848:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127014.986851:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991998848:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 24us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.986856:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22500 00000100:00100000:1.0:1746127014.986863:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22501 00000100:00100000:1.0:1746127014.986867:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991999104:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:1.0:1746127014.986894:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:2027:x1830945991999104:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 27us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746127014.986899:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22501 00000100:00100000:3.0:1746127014.987065:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127014.987083:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991999360 00000100:00100000:3.0:1746127014.987085:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991999360 00000100:00100000:3.0:1746127014.987106:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22502 00000100:00100000:3.0:1746127014.987111:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991999360:12345-192.168.203.42@tcp:23:lfs.0 00000100:00100000:3.0:1746127014.987166:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:2027:x1830945991999360:12345-192.168.203.42@tcp:23:lfs.0 Request processed in 54us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127014.987170:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22502 00000100:00100000:0.0:1746127014.989786:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.989880:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991999616 00000100:00100000:2.0:1746127014.989888:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991999616 00000100:00100000:2.0:1746127014.990562:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22503 00000100:00100000:2.0:1746127014.990572:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4741:x1830945991999616:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127014.990589:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127014.990610:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a8dc600/0x34dc807b6efbe1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5451f expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127014.990633:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x9e:0x0] initial LVB size: 2097152, mtime: 0x6813c877, atime: 0x6813c867, ctime: 0x6813c877, blocks: 0xf50 00010000:00010000:2.0:1746127014.990655:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.990657:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.990665:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8dc600/0x34dc807b6efbe1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5451f expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.990685:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dc600/0x34dc807b6efbe1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5451f expref: 29 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.990695:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dc600, rc 0) 00000100:00100000:2.0:1746127014.990751:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4741:x1830945991999616:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 180us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.990757:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22503 00000100:00100000:0.0:1746127014.993683:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.993835:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991999744 00000100:00100000:2.0:1746127014.993844:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991999744 00000100:00100000:2.0:1746127014.993901:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22504 00000100:00100000:2.0:1746127014.993909:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2027:x1830945991999744:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:2.0:1746127014.994127:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127014.994155:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127014.994157:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:2.0:1746127014.994159:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127014.994161:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:2.0:1746127014.994223:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945991999744:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 314us (548us total) trans 17179875757 rc 0/0 00000100:00100000:2.0:1746127014.994229:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22504 00000100:00100000:0.0:1746127014.996577:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127014.997398:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945991999872 00000100:00100000:2.0:1746127014.997409:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945991999872 00000100:00100000:2.0:1746127014.997466:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22505 00000100:00100000:2.0:1746127014.997474:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+21:4741:x1830945991999872:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127014.997593:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127014.997617:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd600/0x34dc807b6efbe23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54526 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746127014.997641:0:1964:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9d:0x0] initial LVB size: 4194304, mtime: 0x6813c877, atime: 0x0, ctime: 0x6813c877, blocks: 0x1f58 00010000:00010000:2.0:1746127014.997661:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.997663:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127014.997672:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd600/0x34dc807b6efbe23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54526 expref: 22 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.997688:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd600/0x34dc807b6efbe23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54526 expref: 22 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127014.997699:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dd600, rc 0) 00000100:00100000:2.0:1746127014.998890:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:4741:x1830945991999872:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 284us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127014.998899:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22505 00000100:00100000:0.0:1746127015.000932:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.002031:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992000000 00000100:00100000:2.0:1746127015.002041:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992000000 00000100:00100000:2.0:1746127015.002085:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22506 00000100:00100000:2.0:1746127015.002093:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+22:2026:x1830945992000000:12345-192.168.203.42@tcp:22:lfs.0 00002000:00010000:2.0:1746127015.002322:0:1964:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746127015.002326:0:1964:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127015.002328:0:1964:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127015.002329:0:1964:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127015.002331:0:1964:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00000100:00100000:2.0:1746127015.002690:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945992000000:12345-192.168.203.42@tcp:22:lfs.0 Request processed in 596us (1764us total) trans 21474843038 rc 0/0 00000100:00100000:2.0:1746127015.002700:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22506 00000100:00100000:0.0:1746127015.009121:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.009216:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992000256 00000100:00100000:2.0:1746127015.009226:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992000256 00000100:00100000:2.0:1746127015.009285:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9026 00000100:00100000:2.0:1746127015.009294:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945992000256:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127015.009329:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.009348:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.009351:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.009355:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.009369:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127015.011017:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127015.011099:0:9617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992000512 00000100:00100000:1.0:1746127015.011105:0:9617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992000512 00000100:00100000:1.0:1746127015.011175:0:9617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9027 00000100:00100000:1.0:1746127015.011183:0:9617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2028:x1830945992000512:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127015.011212:0:9617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.011224:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127015.011226:0:9617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127015.011230:0:9617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.011239:0:9617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127015.013302:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.013340:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.013375:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.013457:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992000768 00000100:00100000:2.0:1746127015.013466:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992000768 00000100:00100000:2.0:1746127015.013516:0:29586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992001024 00000100:00100000:2.0:1746127015.013518:0:29586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992001024 00000100:00100000:1.0:1746127015.013523:0:29587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992001280 00000100:00100000:1.0:1746127015.013526:0:29587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992001280 00000100:00100000:2.0:1746127015.013536:0:29586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9028 00000100:00100000:2.0:1746127015.013544:0:29586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945992000768:12345-192.168.203.42@tcp:3:lfs.0 00000100:00100000:1.0:1746127015.013548:0:29587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9029 00000100:00100000:1.0:1746127015.013552:0:29587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2029:x1830945992001024:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127015.013576:0:29586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.013576:0:29587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.013589:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127015.013589:0:29587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.013591:0:29586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127015.013591:0:29587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.013595:0:29586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.013595:0:29587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.013606:0:29586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.013606:0:29587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.014353:0:20411:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9030 00000100:00100000:3.0:1746127015.014363:0:20411:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2028:x1830945992001280:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127015.014383:0:20411:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.014391:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.014392:0:20411:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.014395:0:20411:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.014403:0:20411:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127015.016407:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.016435:0:13835:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992001664 00000100:00100000:2.0:1746127015.016444:0:13835:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992001664 00000100:00100000:2.0:1746127015.016503:0:13835:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9031 00000100:00100000:2.0:1746127015.016510:0:13835:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945992001664:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:2.0:1746127015.016549:0:13835:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.016563:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.016565:0:13835:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.016570:0:13835:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.016582:0:13835:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.017183:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127015.017197:0:9618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992001792 00000100:00100000:3.0:1746127015.017200:0:9618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992001792 00000100:00100000:3.0:1746127015.017223:0:9618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9032 00000100:00100000:3.0:1746127015.017227:0:9618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945992001792:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:3.0:1746127015.017246:0:9618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.017255:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.017256:0:9618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.017259:0:9618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.017268:0:9618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127015.019099:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127015.019140:0:9616:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992002048 00000100:00100000:1.0:1746127015.019146:0:9616:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992002048 00000100:00100000:1.0:1746127015.019202:0:9616:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9033 00000100:00100000:1.0:1746127015.019211:0:9616:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2029:x1830945992002048:12345-192.168.203.42@tcp:3:lfs.0 00010000:00010000:1.0:1746127015.019245:0:9616:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.019257:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127015.019259:0:9616:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746127015.019265:0:9616:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.019277:0:9616:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.023963:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.023990:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.023999:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.024011:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013084e600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127015.024015:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.024023:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.024045:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.024051:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013084e600/0x34dc807b6efbe2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127015.024339:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:2029:x1830945992000256:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 15040us (15223us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746127015.024349:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9026 00010000:00010000:1.0:1746127015.029565:0:9617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.029582:0:9617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.029590:0:9617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.029597:0:9617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c89dc00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127015.029601:0:9617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.029609:0:9617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.029629:0:9617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.029640:0:9617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c89dc00/0x34dc807b6efbe31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127015.029746:0:9617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+36:2028:x1830945992000512:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 18558us (18730us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127015.029757:0:9617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9027 00010000:00010000:3.0:1746127015.035218:0:29586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.035240:0:29586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.035252:0:29586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.035260:0:29586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013084e200 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127015.035264:0:29586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.035271:0:29586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.035518:0:29586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.035526:0:29586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013084e200/0x34dc807b6efbe38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.036533:0:29586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e76605d-9d1c-461f-a9b4-504f54f8c30c+34:2029:x1830945992000768:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 22981us (23238us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127015.036545:0:29586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9028 00010000:00010000:0.0:1746127015.036810:0:29587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.036820:0:29587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.036827:0:29587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.036833:0:29587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdac800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:0.0:1746127015.036836:0:29587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.036842:0:29587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.036856:0:29587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.036862:0:29587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdac800/0x34dc807b6efbe3f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746127015.036912:0:29587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:2029:x1830945992001024:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 23358us (23570us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746127015.036921:0:29587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9029 00010000:00010000:3.0:1746127015.040618:0:20411:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.040636:0:20411:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.040645:0:20411:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.040658:0:20411:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbf7800 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127015.040662:0:20411:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.040669:0:20411:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.040688:0:20411:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.040694:0:20411:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7800/0x34dc807b6efbe46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20411 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.040783:0:20411:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2028:x1830945992001280:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 26416us (27400us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127015.040793:0:20411:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9030 00010000:00010000:2.0:1746127015.045056:0:13835:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.045074:0:13835:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.045083:0:13835:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.045089:0:13835:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a17e9c00 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:2.0:1746127015.045093:0:13835:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.045102:0:13835:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.045119:0:13835:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.045125:0:13835:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a17e9c00/0x34dc807b6efbe4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746127015.045237:0:13835:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2029:x1830945992001664:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 28722us (28833us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746127015.045247:0:13835:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9031 00010000:00010000:3.0:1746127015.051201:0:9618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.051217:0:9618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.051225:0:9618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.051232:0:9618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbf6600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:3.0:1746127015.051235:0:9618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.051243:0:9618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.051261:0:9618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.051267:0:9618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6600/0x34dc807b6efbe54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.051376:0:9618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2029:x1830945992001792:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 34141us (34188us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746127015.051387:0:9618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9032 00010000:00010000:1.0:1746127015.054194:0:9616:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.054205:0:9616:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.054210:0:9616:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.054214:0:9616:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb600 already unused, calling callback (ffffffffa087ad70) 00010000:00010000:1.0:1746127015.054217:0:9616:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.054221:0:9616:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.054234:0:9616:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.054238:0:9616:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caeb600/0x34dc807b6efbe5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746127015.054347:0:9616:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2029:x1830945992002048:12345-192.168.203.42@tcp:3:lfs.0 Request processed in 35130us (35248us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746127015.054356:0:9616:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9033 00000100:00100000:0.0:1746127015.061199:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.061352:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992002304 00000100:00100000:2.0:1746127015.061362:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992002304 00000100:00080000:1.0:1746127015.061415:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746127015.061436:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17461 00000100:00100000:2.0:1746127015.061444:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+29:4741:x1830945992002304:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1746127015.061496:0:7258:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746127015.061524:0:7258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b4c00/0x34dc807b6efbdeb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544ee expref: 29 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.061557:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127015.061564:0:7258:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127015.061612:0:7258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127015.061624:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127015.061637:0:7258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00000004:00010000:2.0:1746127015.061738:0:7258:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ced4a80 reply state ffff880093610000 transno 8589938439 ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127015.061746:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:2.0:1746127015.061751:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127015.061753:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746127015.061755:0:7258:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746127015.061829:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4741:x1830945992002304:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 385us (637us total) trans 8589938439 rc 0/0 00000100:00100000:2.0:1746127015.061835:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17461 00000100:00100000:0.0:1746127015.063100:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.063237:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992002432 00000100:00100000:2.0:1746127015.063244:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992002432 00000100:00100000:2.0:1746127015.063275:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22507 00000100:00100000:2.0:1746127015.063282:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:4741:x1830945992002432:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127015.063296:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127015.063311:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efbe69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5452d expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.063336:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.063344:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.063346:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.063349:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efbe69 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5452d expref: 24 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.063377:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 24 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.063388:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 24 pid: 12333 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746127015.063398:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994390912:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127015.063487:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c33b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127015.066680:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.066873:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994390912:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127015.066899:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efbe69 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5452d expref: 24 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.066917:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450cc00, rc 0) 00000100:00100000:2.0:1746127015.066965:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ced6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4741:x1830945992002432:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3683us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127015.066982:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22507 00000100:00100000:3.0:1746127015.067065:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992002560 00000100:00100000:3.0:1746127015.067071:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992002560 00010000:00010000:3.0:1746127015.067095:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 24 pid: 12333 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746127015.067184:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10563 00000100:00100000:3.0:1746127015.067190:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2026:x1830945992002560:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127015.067201:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127015.067221:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 24 pid: 12333 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.067230:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 24 pid: 12333 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.067255:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf7000/0x34dc807b6efbdf9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544f5 expref: 24 pid: 12333 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.067513:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.067515:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.067522:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efbe69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5452d expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.067529:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efbe69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5452d expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.067555:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x34dc807b6efbe69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5452d expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.067566:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994391040:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127015.067626:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1746127015.068924:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994391040:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127015.068935:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127015.068967:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2026:x1830945992002560:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1776us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.068985:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10563 00000100:00100000:0.0:1746127015.069372:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.069506:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992002688 00000100:00100000:2.0:1746127015.069513:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992002688 00000100:00100000:2.0:1746127015.069543:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22508 00000100:00100000:2.0:1746127015.069549:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4741:x1830945992002688:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127015.069562:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127015.069576:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6efbe70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54534 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.069596:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 31 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.069603:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.069604:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.069607:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6efbe70 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54534 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.069624:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 31 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.069634:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 31 pid: 9611 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746127015.069643:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994391168:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127015.069699:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c33b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127015.070674:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994391168:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127015.070693:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6efbe70 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54534 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.070704:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450dc00, rc 0) 00000100:00100000:2.0:1746127015.070725:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4741:x1830945992002688:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1176us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127015.070731:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22508 00000100:00100000:0.0:1746127015.070893:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127015.071020:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992002816 00000100:00100000:3.0:1746127015.071024:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992002816 00010000:00010000:3.0:1746127015.071041:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 31 pid: 9611 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746127015.071061:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10564 00000100:00100000:3.0:1746127015.071065:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945992002816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127015.071074:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127015.071090:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 31 pid: 9611 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.071099:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 31 pid: 9611 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.071115:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dcc00/0x34dc807b6efbdf2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544fc expref: 31 pid: 9611 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.071124:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.071126:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.071147:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6efbe70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54534 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.071153:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6efbe70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54534 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.071171:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009450dc00/0x34dc807b6efbe70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54534 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.071180:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994391296:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127015.071237:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127015.072590:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.072649:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992002944 00000100:00100000:2.0:1746127015.072654:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992002944 00000100:00100000:2.0:1746127015.072685:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22509 00000100:00100000:2.0:1746127015.072691:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4741:x1830945992002944:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127015.072707:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127015.072718:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efbe77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e5453b expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.072735:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.072741:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.072743:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746127015.072744:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994391296:192.168.203.42@tcp:105: 00010000:00010000:2.0:1746127015.072746:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efbe77 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5453b expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.072756:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746127015.072762:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 32 pid: 12333 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.072772:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 32 pid: 12333 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746127015.072781:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994391424:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127015.072795:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945992002816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1728us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.072923:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10564 00000100:00100000:2.0:1746127015.073206:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c33b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746127015.074516:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.074568:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994391424:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127015.074591:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efbe77 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5453b expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.074605:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450ce00, rc 0) 00000100:00100000:3.0:1746127015.074710:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003072 00000100:00100000:2.0:1746127015.074710:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:4741:x1830945992002944:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2018us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.074715:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003072 00000100:00100000:2.0:1746127015.074717:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22509 00010000:00010000:3.0:1746127015.074736:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 31 pid: 12333 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746127015.074766:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10565 00000100:00100000:3.0:1746127015.074773:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945992003072:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127015.074782:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127015.074800:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 31 pid: 12333 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.074811:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 31 pid: 12333 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.074831:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbf6000/0x34dc807b6efbe00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54503 expref: 31 pid: 12333 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.074841:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.074843:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.074848:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efbe77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5453b expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.074860:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efbe77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5453b expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.074883:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009450ce00/0x34dc807b6efbe77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5453b expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.074893:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994391552:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127015.074960:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1746127015.078633:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994391552:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127015.078656:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127015.078666:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127015.078718:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945992003072:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3941us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.078728:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10565 00000100:00100000:2.0:1746127015.078758:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003200 00000100:00100000:2.0:1746127015.078766:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003200 00000100:00100000:2.0:1746127015.078965:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22510 00000100:00100000:2.0:1746127015.078985:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:4741:x1830945992003200:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127015.079002:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127015.079018:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c37e00/0x34dc807b6efbe7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54542 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.079045:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 24 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.079053:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.079055:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.079058:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37e00/0x34dc807b6efbe7e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54542 expref: 24 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.079089:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 24 pid: 3148 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.079100:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 24 pid: 3148 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746127015.079113:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994391680:192.168.203.42@tcp:104: 00000100:00100000:2.0:1746127015.079219:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c33b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127015.080876:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994391680:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127015.080898:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c37e00/0x34dc807b6efbe7e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54542 expref: 24 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.080911:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c37e00, rc 0) 00000100:00100000:2.0:1746127015.081402:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4741:x1830945992003200:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2427us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127015.081410:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22510 00000100:00100000:0.0:1746127015.081467:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127015.081676:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003328 00000100:00100000:3.0:1746127015.081682:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003328 00010000:00010000:3.0:1746127015.081705:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 24 pid: 3148 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746127015.081739:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10566 00000100:00100000:3.0:1746127015.081745:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945992003328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127015.081757:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127015.081778:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 24 pid: 3148 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.081795:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 24 pid: 3148 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.081817:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbf6c00/0x34dc807b6efbe0e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e5450a expref: 24 pid: 3148 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.081828:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.081830:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.081835:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c37e00/0x34dc807b6efbe7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54542 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.081843:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c37e00/0x34dc807b6efbe7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54542 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.081869:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c37e00/0x34dc807b6efbe7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54542 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.081880:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994391808:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127015.081953:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127015.084173:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127015.084317:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994391808:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127015.084334:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746127015.084431:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003456 00000100:00100000:2.0:1746127015.084436:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003456 00000100:00100000:2.0:1746127015.084474:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22511 00000100:00100000:2.0:1746127015.084481:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4741:x1830945992003456:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127015.084496:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127015.084511:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880077c36000/0x34dc807b6efbe85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54549 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.084536:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 25 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.084543:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.084544:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746127015.084548:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36000/0x34dc807b6efbe85 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54549 expref: 25 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.084566:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 25 pid: 9611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746127015.084575:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 25 pid: 9611 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746127015.084586:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994391936:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127015.084703:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2027:x1830945992003328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2957us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.084712:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10566 00000100:00100000:2.0:1746127015.085294:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c33b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746127015.086768:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b9a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1964:1830945994391936:192.168.203.42@tcp:104: 00010000:00010000:2.0:1746127015.086792:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880077c36000/0x34dc807b6efbe85 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54549 expref: 24 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.086807:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880077c36000, rc 0) 00000100:00100000:2.0:1746127015.086839:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:4741:x1830945992003456:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2359us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127015.086846:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22511 00000100:00100000:2.0:1746127015.087091:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127015.087157:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003584 00000100:00100000:3.0:1746127015.087163:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003584 00010000:00010000:3.0:1746127015.087186:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 24 pid: 9611 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746127015.087217:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10567 00000100:00100000:3.0:1746127015.087223:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945992003584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127015.087422:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127015.087441:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 24 pid: 9611 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.087452:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 24 pid: 9611 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.087471:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a8dd200/0x34dc807b6efbe07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54511 expref: 24 pid: 9611 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.087492:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.087494:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.087499:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880077c36000/0x34dc807b6efbe85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54549 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.087507:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880077c36000/0x34dc807b6efbe85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54549 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.087531:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880077c36000/0x34dc807b6efbe85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54549 expref: 23 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.087541:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994392064:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127015.087602:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:2.0:1746127015.090523:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.090574:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003712 00000100:00100000:0.0:1746127015.090583:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003712 00000100:00100000:0.0:1746127015.090630:0:1964:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22512 00000100:00100000:0.0:1746127015.090637:0:1964:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4741:x1830945992003712:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1746127015.090656:0:1964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746127015.090673:0:1964:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efbe8c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54550 expref: -99 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.090701:0:1964:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 31 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127015.090709:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127015.090711:0:1964:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746127015.090714:0:1964:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efbe8c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54550 expref: 31 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746127015.090745:0:1964:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 31 pid: 9613 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746127015.090755:0:1964:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 31 pid: 9613 timeout: 1010 lvb_type: 1 00000100:00100000:0.0:1746127015.090766:0:1964:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cc3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994392192:192.168.203.42@tcp:104: 00000100:00100000:0.0:1746127015.090835:0:1964:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa429900 going to sleep for 11 seconds 00000100:00100000:3.0:1746127015.090920:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11948:1830945994392064:192.168.203.42@tcp:105: 00010000:00010000:3.0:1746127015.090936:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746127015.090965:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945992003584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3742us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.090983:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10567 00000100:00100000:0.0:1746127015.092687:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.092771:0:1964:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cc3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1964:1830945994392192:192.168.203.42@tcp:104: 00000100:00100000:3.0:1746127015.092782:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003840 00000100:00100000:3.0:1746127015.092788:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003840 00010000:00010000:2.0:1746127015.092794:0:1964:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efbe8c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54550 expref: 32 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.092806:0:1964:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007dc11600, rc 0) 00010000:00010000:3.0:1746127015.092813:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 32 pid: 9613 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746127015.092833:0:1964:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:4741:x1830945992003712:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2197us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127015.092838:0:1964:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22512 00000100:00100000:3.0:1746127015.093037:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10568 00000100:00100000:3.0:1746127015.093044:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945992003840:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127015.093057:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127015.093074:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 31 pid: 9613 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.093085:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 31 pid: 9613 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.093106:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a8dce00/0x34dc807b6efbe15 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54518 expref: 31 pid: 9613 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746127015.093149:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.093151:0:11948:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746127015.093157:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efbe8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54550 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.093169:0:11948:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efbe8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54550 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746127015.093194:0:11948:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007dc11600/0x34dc807b6efbe8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54550 expref: 30 pid: 1964 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746127015.093203:0:11948:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994392320:192.168.203.42@tcp:105: 00000100:00100000:3.0:1746127015.093557:0:11948:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e5180 going to sleep for 11 seconds 00000100:00100000:0.0:1746127015.095251:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.095283:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.095303:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.095327:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992004096 00000100:00100000:0.0:1746127015.095334:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992004096 00000100:00100000:3.0:1746127015.095360:0:11948:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ab0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11948:1830945994392320:192.168.203.42@tcp:105: 00000100:00100000:0.0:1746127015.095368:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992004352 00000100:00100000:0.0:1746127015.095370:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992004352 00010000:00010000:3.0:1746127015.095378:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746127015.095382:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992004608 00000100:00100000:0.0:1746127015.095384:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992004608 00000100:00100000:0.0:1746127015.095396:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22513 00000100:00100000:0.0:1746127015.095402:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945992004096:12345-192.168.203.42@tcp:2:lfs.0 00000100:00100000:3.0:1746127015.095415:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945992003840:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2371us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.095424:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10568 00000100:00100000:3.0:1746127015.095453:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22514 00000100:00100000:3.0:1746127015.095458:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+23:2027:x1830945992004352:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:3.0:1746127015.095547:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127015.095547:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127015.095550:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.095550:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.095552:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.095552:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.095554:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127012 -> 1746127013 00002000:00010000:0.0:1746127015.095554:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127012 -> 1746127013 00002000:00010000:3.0:1746127015.095555:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746127015.095555:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746127015.095573:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945992004352:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 115us (289us total) trans 21474843039 rc 0/0 00000100:00100000:3.0:1746127015.095578:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22514 00000100:00100000:0.0:1746127015.095578:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945992004096:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 176us (337us total) trans 17179875758 rc 0/0 00000100:00100000:0.0:1746127015.095585:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22513 00000100:00100000:3.0:1746127015.095591:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22515 00000100:00100000:3.0:1746127015.095596:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945992004608:12345-192.168.203.42@tcp:2:lfs.0 00000100:00100000:0.0:1746127015.095612:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.095624:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992003968 00000100:00100000:0.0:1746127015.095627:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992003968 00002000:00010000:3.0:1746127015.095636:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746127015.095638:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.095640:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.095642:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127012 -> 1746127013 00002000:00010000:3.0:1746127015.095643:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746127015.095643:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22516 00000100:00100000:0.0:1746127015.095647:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+24:2027:x1830945992003968:12345-192.168.203.42@tcp:2:lfs.0 00000100:00100000:3.0:1746127015.095660:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945992004608:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 64us (356us total) trans 17179875759 rc 0/0 00000100:00100000:3.0:1746127015.095665:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22515 00002000:00010000:0.0:1746127015.095692:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746127015.095695:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.095697:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.095699:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127012 -> 1746127013 00002000:00010000:0.0:1746127015.095701:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746127015.095710:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1746127015.095719:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2027:x1830945992003968:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 70us (106us total) trans 21474843040 rc 0/0 00000100:00100000:0.0:1746127015.095724:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22516 00000100:00100000:3.0:1746127015.095726:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992004224 00000100:00100000:3.0:1746127015.095728:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992004224 00000100:00100000:3.0:1746127015.095751:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22517 00000100:00100000:3.0:1746127015.095759:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+32:2027:x1830945992004224:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:3.0:1746127015.095802:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127015.095804:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.095806:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.095807:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127012 -> 1746127013 00002000:00010000:3.0:1746127015.095809:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746127015.095900:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1746127015.095912:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e76605d-9d1c-461f-a9b4-504f54f8c30c+33:2027:x1830945992004224:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 156us (201us total) trans 17179875760 rc 0/0 00000100:00100000:3.0:1746127015.095918:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22517 00000100:00100000:1.0:1746127015.096375:0:12333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992004480 00000100:00100000:1.0:1746127015.096379:0:12333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992004480 00000100:00100000:1.0:1746127015.096467:0:12333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22518 00000100:00100000:1.0:1746127015.096473:0:12333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+25:2027:x1830945992004480:12345-192.168.203.42@tcp:2:lfs.0 00002000:00010000:1.0:1746127015.096517:0:12333:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:1.0:1746127015.096519:0:12333:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127015.096521:0:12333:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:1.0:1746127015.096522:0:12333:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127012 -> 1746127013 00002000:00010000:1.0:1746127015.096524:0:12333:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:1.0:1746127015.096543:0:12333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:2027:x1830945992004480:12345-192.168.203.42@tcp:2:lfs.0 Request processed in 71us (644us total) trans 21474843041 rc 0/0 00000100:00100000:1.0:1746127015.096548:0:12333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22518 00000100:00100000:0.0:1746127015.098583:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127015.098703:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992004864 00000100:00100000:1.0:1746127015.098710:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992004864 00000100:00100000:1.0:1746127015.098756:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6693 00000100:00100000:1.0:1746127015.098763:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:4741:x1830945992004864:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:1.0:1746127015.098815:0:7262:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6400/0x34dc807b6efbd9e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e0 expref: 30 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.098858:0:7262:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127015.098870:0:7262:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 30 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.098877:0:7262:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127015.098904:0:7262:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 30 pid: 13466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746127015.098914:0:7262:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 30 pid: 13466 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746127015.098927:0:7262:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7262:1830945994392448:192.168.203.42@tcp:104: 00000100:00100000:1.0:1746127015.099015:0:7262:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801297ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1746127015.101892:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1746127015.102088:0:7262:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7262:1830945994392448:192.168.203.42@tcp:104: 00010000:00010000:1.0:1746127015.102154:0:7262:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00000100:00100000:3.0:1746127015.102230:0:11948:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992004992 00000100:00100000:3.0:1746127015.102237:0:11948:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992004992 00010000:00010000:3.0:1746127015.102267:0:11948:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 31 pid: 13466 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746127015.102306:0:11948:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10569 00000100:00100000:3.0:1746127015.102314:0:11948:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+31:2027:x1830945992004992:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746127015.102327:0:11948:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746127015.102333:0:11948:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 31 pid: 13466 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746127015.102343:0:11948:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 31 pid: 13466 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746127015.102362:0:11948:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009867fe00/0x34dc807b6efbddd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e7 expref: 31 pid: 13466 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746127015.102378:0:11948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127015.102382:0:11948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00010000:00010000:3.0:1746127015.102391:0:11948:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7262 initiator: MDT0 00010000:00010000:3.0:1746127015.102397:0:11948:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7262 initiator: MDT0 00010000:00010000:3.0:1746127015.102412:0:11948:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746127015.102446:0:7262:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00010000:00010000:1.0:1746127015.102453:0:7262:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00000100:00100000:3.0:1746127015.102455:0:11948:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e76605d-9d1c-461f-a9b4-504f54f8c30c+30:2027:x1830945992004992:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 141us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.102460:0:11948:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10569 00000040:00080000:1.0:1746127015.102729:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1508, 88 off140320 00000004:00080000:1.0:1746127015.102736:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144606658ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102757:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1514, 88 off140936 00000004:00080000:1.0:1746127015.102761:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144631913ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127015.102773:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1515, 88 off141024 00000004:00080000:1.0:1746127015.102776:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144646841ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127015.102783:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1509, 88 off140408 00000004:00080000:1.0:1746127015.102786:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144656331ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102792:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1510, 88 off140496 00000004:00080000:1.0:1746127015.102794:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144664913ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102801:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1516, 88 off141112 00000004:00080000:1.0:1746127015.102803:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144674129ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127015.102810:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1517, 88 off141200 00000004:00080000:1.0:1746127015.102813:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144683198ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127015.102819:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1518, 88 off141288 00000004:00080000:1.0:1746127015.102821:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144691676ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127015.102828:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1511, 88 off140584 00000004:00080000:1.0:1746127015.102830:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144701058ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102837:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1519, 88 off141376 00000004:00080000:1.0:1746127015.102839:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144709941ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127015.102845:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1512, 88 off140672 00000004:00080000:1.0:1746127015.102848:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144718443ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102854:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1520, 88 off141464 00000004:00080000:1.0:1746127015.102856:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144727019ns, next at 895431202182ns, rc = 0 00000040:00080000:1.0:1746127015.102863:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1513, 88 off140760 00000004:00080000:1.0:1746127015.102865:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144735426ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102871:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1514, 88 off140848 00000004:00080000:1.0:1746127015.102873:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144744263ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102886:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1515, 88 off140936 00000004:00080000:1.0:1746127015.102889:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144759848ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102895:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1516, 88 off141024 00000004:00080000:1.0:1746127015.102898:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910144768429ns, next at 847916292410ns, rc = 0 00000040:00080000:1.0:1746127015.102905:0:7262:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1521, 88 off141552 00000004:00080000:1.0:1746127015.102908:0:7262:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910144778713ns, next at 895431202182ns, rc = 0 00000001:00080000:2.0:1746127015.104738:0:8217:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938440 is committed 00000004:00080000:2.0:1746127015.104754:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1494 committed 00000004:00080000:2.0:1746127015.104812:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1489 committed 00000004:00080000:2.0:1746127015.104845:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1488 committed 00000004:00080000:2.0:1746127015.104848:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1487 committed 00000004:00080000:2.0:1746127015.104849:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1486 committed 00000004:00080000:2.0:1746127015.104851:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1493 committed 00000004:00080000:2.0:1746127015.104852:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1485 committed 00000004:00080000:2.0:1746127015.104854:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1492 committed 00000004:00080000:2.0:1746127015.104855:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1484 committed 00000004:00080000:2.0:1746127015.104857:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1491 committed 00000004:00080000:2.0:1746127015.104858:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1490 committed 00000004:00080000:2.0:1746127015.104860:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1489 committed 00000004:00080000:2.0:1746127015.104862:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1483 committed 00000004:00080000:2.0:1746127015.104863:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1482 committed 00000004:00080000:2.0:1746127015.104864:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1488 committed 00000004:00080000:2.0:1746127015.104866:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1487 committed 00000004:00080000:2.0:1746127015.104867:0:8217:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1481 committed 00010000:00010000:3.0:1746127015.104930:0:3769:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127015.104944:0:3769:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127015.104950:0:3769:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127015.104956:0:3769:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009450c800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:3.0:1746127015.104960:0:3769:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127015.104966:0:3769:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127015.104990:0:3769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:3.0:1746127015.104992:0:3769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746127015.104996:0:3769:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00010000:00010000:3.0:1746127015.105001:0:3769:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c800/0x34dc807b6efbe62 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7258 initiator: MDT0 00000100:00100000:1.0:1746127015.105160:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994392960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127015.105214:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127015.105243:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127015.105258:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127015.105273:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127015.105287:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.105320:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994392576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127015.105341:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994392704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127015.106303:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994394496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127015.106326:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127015.106523:0:3785:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746127015.106528:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994392832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127015.106546:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.106563:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994392960 00000100:00100000:3.0:1746127015.106570:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994392960 00000100:00100000:2.0:1746127015.106628:0:1964:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393472 00000100:00100000:3.0:1746127015.106629:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393984 00000100:00100000:3.0:1746127015.106631:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393984 00000100:00100000:2.0:1746127015.106632:0:1964:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393472 00000100:00100000:3.0:1746127015.106646:0:9613:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994394496 00000100:00100000:3.0:1746127015.106648:0:9613:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994394496 00000100:00100000:3.0:1746127015.106669:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22519 00000100:00100000:2.0:1746127015.106673:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22520 00000100:00100000:3.0:1746127015.106675:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3785:x1830945994392960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127015.106679:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994393984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127015.106790:0:9613:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127015.106794:0:9613:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127015.106796:0:9613:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb atime from disk: 1746126951 -> 1746126951 00002000:00010000:3.0:1746127015.106798:0:9613:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:3.0:1746127015.106799:0:9613:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9e:0x0] updating lvb blocks from disk: 3920 -> 3920 00000100:00100000:2.0:1746127015.106807:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3785:x1830945994393984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (1518us total) trans 21474843042 rc 0/0 00000100:00100000:2.0:1746127015.106813:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22520 00000100:00100000:3.0:1746127015.106822:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994392960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (1612us total) trans 17179875761 rc 0/0 00000100:00100000:2.0:1746127015.106826:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22521 00000100:00100000:3.0:1746127015.106829:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22519 00000100:00100000:2.0:1746127015.106830:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994393472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127015.106845:0:9613:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22522 00000100:00100000:3.0:1746127015.106849:0:9613:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994394496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127015.106889:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3785:x1830945994393472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (1625us total) trans 17179875762 rc 0/0 00000100:00100000:2.0:1746127015.106894:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22521 00000100:00100000:3.0:1746127015.106901:0:9613:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3785:x1830945994394496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (575us total) trans 21474843043 rc 0/0 00000100:00100000:3.0:1746127015.106906:0:9613:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22522 00000100:00080000:3.0:1746127015.106922:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746127015.106925:0:7256:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746127015.107455:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127015.107474:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127015.107687:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994392832 00000100:00100000:2.0:1746127015.107691:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994392832 00000100:00100000:2.0:1746127015.107784:0:3148:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393344 00000100:00100000:2.0:1746127015.107787:0:3148:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393344 00000100:00100000:0.0:1746127015.107813:0:16295:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22523 00000100:00100000:0.0:1746127015.107820:0:16295:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3785:x1830945994392832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127015.107870:0:16295:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746127015.107873:0:16295:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.107875:0:16295:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.107877:0:16295:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb ctime from disk: 1746127013 -> 1746127013 00002000:00010000:0.0:1746127015.107878:0:16295:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa1:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746127015.107960:0:3148:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22524 00000100:00100000:2.0:1746127015.107966:0:3148:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3785:x1830945994393344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127015.108078:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.108097:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994393088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127015.108114:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.108125:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994393600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127015.108154:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.108165:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994394112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127015.108176:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.108196:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994392576 00000100:00100000:3.0:1746127015.108198:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994392576 00000100:00100000:3.0:1746127015.108208:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393088 00000100:00100000:3.0:1746127015.108210:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393088 00000100:00100000:3.0:1746127015.108215:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393600 00000100:00100000:3.0:1746127015.108217:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393600 00000100:00100000:3.0:1746127015.108222:0:3542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994394112 00000100:00100000:3.0:1746127015.108223:0:3542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994394112 00000100:00100000:3.0:1746127015.108230:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22525 00000100:00100000:3.0:1746127015.108235:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3782:x1830945994392576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746127015.108274:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746127015.108276:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.108278:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.108280:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb ctime from disk: 1746127013 -> 1746127013 00002000:00010000:3.0:1746127015.108281:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746127015.108300:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994392576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (222us total) trans 17179875765 rc 0/0 00000100:00100000:3.0:1746127015.108305:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22525 00000100:00100000:3.0:1746127015.108313:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22526 00000100:00100000:3.0:1746127015.108316:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3782:x1830945994393088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746127015.108357:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3782:x1830945994393088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (242us total) trans 17179875766 rc 0/0 00000100:00100000:3.0:1746127015.108361:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22526 00000100:00100000:3.0:1746127015.108367:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22527 00000100:00100000:3.0:1746127015.108371:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3782:x1830945994393600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746127015.108405:0:3542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746127015.108406:0:3542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.108408:0:3542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:3.0:1746127015.108410:0:3542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746127013 -> 1746127013 00002000:00010000:3.0:1746127015.108412:0:3542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746127015.108425:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3782:x1830945994393600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (271us total) trans 21474843044 rc 0/0 00000100:00100000:3.0:1746127015.108429:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22527 00000100:00100000:3.0:1746127015.108435:0:3542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22528 00000100:00100000:3.0:1746127015.108439:0:3542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3782:x1830945994394112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127015.108485:0:3542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3782:x1830945994394112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (308us total) trans 21474843045 rc 0/0 00000100:00100000:3.0:1746127015.108489:0:3542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22528 00000100:00100000:0.0:1746127015.108507:0:16295:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994392832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 686us (1958us total) trans 17179875763 rc 0/0 00000100:00100000:0.0:1746127015.108514:0:16295:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22523 00000004:00080000:3.0:1746127015.108521:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec7aa00/2, rc 0, transno 17179875765 00000100:00100000:3.0:1746127015.108526:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994392576:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127015.108532:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec7bb80/2, rc 0, transno 17179875766 00000100:00100000:3.0:1746127015.108534:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994393088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746127015.108540:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60700/2, rc 0, transno 21474843044 00000100:00100000:2.0:1746127015.108583:0:3148:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3785:x1830945994393344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 618us (1108us total) trans 17179875764 rc 0/0 00000100:00100000:2.0:1746127015.108588:0:3148:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22524 00000004:00080000:1.0:1746127015.108682:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec7ad80/2, rc 0, transno 17179875764 00000100:00100000:1.0:1746127015.108685:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746127015.108690:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127015.108705:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746127015.108715:0:3785:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994394368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127015.108720:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393856 00000100:00100000:0.0:1746127015.108724:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393856 00000100:00100000:1.0:1746127015.108726:0:3785:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746127015.108736:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd7480/2, rc 0, transno 21474843043 00000100:00100000:0.0:1746127015.108739:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994394368 00000100:00100000:0.0:1746127015.108741:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994394368 00000100:00100000:0.0:1746127015.108751:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22529 00000100:00100000:0.0:1746127015.108756:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3785:x1830945994393856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127015.108766:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127015.108781:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007ec7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994393216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127015.108794:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127015.108802:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994393728:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746127015.108803:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb size from disk: 4827936 -> 4827936 00002000:00010000:0.0:1746127015.108806:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.108808:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.108809:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb ctime from disk: 1746127013 -> 1746127013 00002000:00010000:0.0:1746127015.108811:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9f:0x0] updating lvb blocks from disk: 5344 -> 5344 00000100:00100000:2.0:1746127015.108812:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746127015.108820:0:3783:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994394240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127015.108833:0:3783:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127015.108834:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3785:x1830945994393856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (127us total) trans 21474843046 rc 0/0 00000100:00100000:0.0:1746127015.108839:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22529 00000100:00100000:0.0:1746127015.108848:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994392704 00000100:00100000:2.0:1746127015.108850:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393216 00000100:00100000:0.0:1746127015.108850:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994392704 00000100:00100000:2.0:1746127015.108852:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393216 00000100:00100000:0.0:1746127015.108858:0:12340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994393728 00000100:00100000:0.0:1746127015.108860:0:12340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994393728 00000100:00100000:2.0:1746127015.108862:0:9611:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994394240 00000100:00100000:2.0:1746127015.108864:0:9611:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994394240 00000100:00100000:0.0:1746127015.108870:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22530 00000100:00100000:2.0:1746127015.108874:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22531 00000100:00100000:0.0:1746127015.108874:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3785:x1830945994394368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746127015.108877:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3783:x1830945994392704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746127015.108913:0:12340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746127015.108914:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746127015.108915:0:12340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb mtime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127015.108916:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.108917:0:12340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746127015.108918:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:0.0:1746127015.108918:0:12340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb ctime from disk: 1746126967 -> 1746126967 00002000:00010000:2.0:1746127015.108920:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb ctime from disk: 1746127013 -> 1746127013 00002000:00010000:0.0:1746127015.108920:0:12340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9d:0x0] updating lvb blocks from disk: 8024 -> 8024 00002000:00010000:2.0:1746127015.108921:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0xa0:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746127015.108941:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3783:x1830945994392704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (175us total) trans 17179875767 rc 0/0 00000100:00100000:0.0:1746127015.108941:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ec79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3785:x1830945994394368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (214us total) trans 21474843047 rc 0/0 00000100:00100000:0.0:1746127015.108946:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22530 00000100:00100000:2.0:1746127015.108949:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22531 00000100:00100000:0.0:1746127015.108956:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22532 00000100:00100000:2.0:1746127015.108959:0:9611:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22533 00000100:00100000:0.0:1746127015.108961:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3783:x1830945994393216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746127015.108963:0:9611:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3783:x1830945994393728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746127015.109008:0:9611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746127015.109011:0:9611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746127012 -> 1746127012 00002000:00010000:2.0:1746127015.109012:0:9611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 1746127012 -> 1746127012 00002000:00010000:2.0:1746127015.109014:0:9611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746127013 -> 1746127013 00002000:00010000:2.0:1746127015.109015:0:9611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746127015.109027:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3783:x1830945994393216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (230us total) trans 17179875768 rc 0/0 00000100:00100000:2.0:1746127015.109032:0:9611:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3783:x1830945994393728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (219us total) trans 21474843048 rc 0/0 00000100:00100000:0.0:1746127015.109032:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22532 00000100:00100000:2.0:1746127015.109037:0:9611:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22533 00000100:00100000:0.0:1746127015.109041:0:12340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22534 00000100:00100000:0.0:1746127015.109045:0:12340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3783:x1830945994394240:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127015.109055:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec79500/2, rc 0, transno 17179875767 00000100:00100000:2.0:1746127015.109058:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994392704:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127015.109065:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec7b800/2, rc 0, transno 17179875768 00000100:00100000:2.0:1746127015.109067:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994393216:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746127015.109073:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a61880/2, rc 0, transno 21474843048 00000100:00100000:0.0:1746127015.109096:0:12340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3783:x1830945994394240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (262us total) trans 21474843049 rc 0/0 00000100:00100000:0.0:1746127015.109106:0:12340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22534 00000004:00010000:0.0:1746127015.109173:0:7262:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094a60e00 reply state ffff880095f05800 transno 8589938440 ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109190:0:7262:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109199:0:7262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127015.109201:0:7262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746127015.109205:0:7262:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746127015.109210:0:7262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127015.109212:0:7262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746127015.109218:0:7262:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbf6400/0x34dc807b6efbd9e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e544e0 expref: 27 pid: 7258 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746127015.109295:0:7262:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746127015.109306:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4741:x1830945992004864:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 10544us (10729us total) trans 8589938440 rc 0/0 00000100:00100000:0.0:1746127015.109313:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6693 00010000:00010000:0.0:1746127015.109356:0:3768:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109363:0:3768:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109369:0:3768:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109375:0:3768:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caeb800 already unused, calling callback (ffffffffa0f14690) 00010000:00010000:0.0:1746127015.109378:0:3768:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109384:0:3768:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109393:0:3768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:0.0:1746127015.109395:0:3768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746127015.109397:0:3768:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7262 initiator: MDT0 00010000:00010000:0.0:1746127015.109402:0:3768:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caeb800/0x34dc807b6efbe93 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7262 initiator: MDT0 00000100:00100000:3.0:1746127015.109730:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994393600:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746127015.109744:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a61f80/2, rc 0, transno 21474843045 00000100:00100000:3.0:1746127015.109747:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994394112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127015.109761:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994394624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127015.109782:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.109813:0:9612:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994394624 00000100:00100000:3.0:1746127015.109816:0:9612:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994394624 00000100:00100000:3.0:1746127015.109833:0:9612:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22535 00000100:00100000:2.0:1746127015.109909:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994393728:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746127015.109920:0:3783:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a63800/2, rc 0, transno 21474843049 00000100:00100000:2.0:1746127015.109923:0:3783:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3783:1830945994394240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746127015.110292:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994394496:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127015.110310:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a60000/2, rc 0, transno 21474843042 00000100:00100000:1.0:1746127015.110313:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127015.110322:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec7a300/2, rc 0, transno 17179875761 00000100:00100000:1.0:1746127015.110324:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994392960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127015.110331:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec78a80/2, rc 0, transno 17179875762 00000100:00100000:1.0:1746127015.110334:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127015.110342:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007ec78e00/2, rc 0, transno 17179875763 00000100:00100000:1.0:1746127015.110344:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007ec78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994392832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746127015.110349:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a62a00/2, rc 0, transno 21474843046 00000100:00100000:1.0:1746127015.110352:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994393856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746127015.110357:0:3785:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd7800/2, rc 0, transno 21474843047 00000100:00100000:1.0:1746127015.110358:0:3785:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3785:1830945994394368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127015.110603:0:9612:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3782:x1830945994394624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746127015.110699:0:9612:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3782:x1830945994394624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 860us (916us total) trans 21474843050 rc 0/0 00000100:00100000:3.0:1746127015.110708:0:9612:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22535 00000004:00080000:2.0:1746127015.110833:0:3782:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007edd6680/2, rc 0, transno 21474843050 00000100:00100000:2.0:1746127015.110837:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3782:1830945994394624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746127015.116073:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.116276:0:7258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992005120 00000100:00100000:2.0:1746127015.116286:0:7258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992005120 00000100:00100000:2.0:1746127015.116339:0:7258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17462 00000100:00100000:2.0:1746127015.116347:0:7258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+26:4741:x1830945992005120:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1746127015.116374:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746127015.116395:0:7258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6efbe9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5a90bd4206e54557 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.116458:0:7258:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6efbe9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54557 expref: 27 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.116471:0:7258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a8dce00/0x34dc807b6efbe9a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x5a90bd4206e54557 expref: 27 pid: 7258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746127015.116488:0:7258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800991db400) 00010000:00010000:2.0:1746127015.116491:0:7258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746127015.116494:0:7258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a8dce00, rc 0) 00000100:00100000:2.0:1746127015.116541:0:7258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4741:x1830945992005120:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 195us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746127015.116548:0:7258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17462 00000100:00100000:0.0:1746127015.127552:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1746127015.127645:0:7262:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945992005376 00000100:00100000:2.0:1746127015.127654:0:7262:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945992005376 00000100:00100000:2.0:1746127015.127705:0:7262:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6694 00000100:00100000:2.0:1746127015.127712:0:7262:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+27:4741:x1830945992005376:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1746127015.128056:0:7262:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e76605d-9d1c-461f-a9b4-504f54f8c30c+28:4741:x1830945992005376:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 342us (514us total) trans 8589938441 rc 0/0 00000100:00100000:2.0:1746127015.128062:0:7262:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6694 00000001:02000400:3.0:1746127015.711076:0:13893:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:1.0:1746127015.919555:0:7248:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746127015.933681:0:3782:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746127015.933698:0:3782:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994394752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1746127015.933751:0:3782:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746127015.934416:0:9615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994394752 00000100:00100000:0.0:1746127015.934423:0:9615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994394752 00000100:00100000:0.0:1746127015.934458:0:9615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1746127015.934464:0:9615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994394752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746127015.934491:0:9615:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490126656 pending 0 free 3907129344 avail 3675607040 00000100:00100000:0.0:1746127015.934525:0:9615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ab0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3782:x1830945994394752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1746127015.934530:0:9615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1746127015.934873:0:3782:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801303d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3782:1830945994394752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746127015.949715:0:3784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007edd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994394880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746127015.949766:0:3784:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746127015.950472:0:9614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830945994394880 00000100:00100000:3.0:1746127015.950480:0:9614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830945994394880 00000100:00100000:3.0:1746127015.950667:0:9614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1746127015.950674:0:9614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3784:x1830945994394880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746127015.950697:0:9614:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490126656 pending 0 free 3910705152 avail 3679182848 00000100:00100000:3.0:1746127015.950741:0:9614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801303d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3784:x1830945994394880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746127015.950746:0:9614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1746127015.950886:0:3784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007edd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3784:1830945994394880:0@lo:13:osp-pre-1-1.0 Debug log: 69916 lines, 69916 kept, 0 dropped, 0 bad.